00000001:02000400:3.0F:1790945637.679589:0:3301:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1790945658.502074:0:3524:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1790945660.902817:0:3565:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 371 MB/s 00000001:01000000:2.0:1790945661.152775:0:3565:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 799 MB/s 00000001:01000000:3.0:1790945661.402375:0:3565:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3943 MB/s 00000020:02000000:3.0:1790945661.937440:0:3615:0:(class_obd.c:846:obdclass_init()) Lustre: Build Version: 2.17.59_2_gbfaf0e7 00000400:02000000:3.0:1790945662.482763:0:3630:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.204.120@tcp [8/256/0/180] 00008000:02000000:3.0:1790945665.627152:0:3780:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0F:1790945728.977935:0:5748:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1790945742.140973:0:6498:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790945742.140982:0:6498:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1790945742.140983:0:6498:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0F:1790945742.150309:0:6498:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000f7072b2e 00000080:02000400:1.0:1790945742.150902:0:6498:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' or install '{/usr}/sbin/mount.lustre_tgt' 00000020:01000004:1.0:1790945742.174153:0:6498:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1790945742.174197:0:6498:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1790945742.174230:0:6498:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000016593b77) 00000020:00000080:1.0:1790945742.174248:0:6498:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1790945742.247335:0:6498:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1790945742.247435:0:6498:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:1.0:1790945742.259987:0:6498:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1790945742.260271:0:6498:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1790945742.260278:0:6498:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:1.0:1790945742.260702:0:6498:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd9f4181e0d27cc2f 00000020:01000004:1.0:1790945742.260711:0:6498:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1790945742.260789:0:6498:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1790945742.260794:0:6498:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f7072b2e from MGS 00000020:01000004:1.0:1790945742.260810:0:6498:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1790945742.260821:0:6498:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000ce1efd7f) 00000020:00000080:1.0:1790945742.260832:0:6498:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1790945742.260897:0:6498:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f7072b2e from MGS, refs=2 00080000:01000000:1.0:1790945742.260902:0:6498:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790945742.260907:0:6498:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd9f4181e0d27cc3d 00000100:00100000:1.0:1790945742.261018:0:6498:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1790945742.261151:0:6498:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1790945742.261158:0:6498:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1790945742.263240:0:6498:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1790945742.263252:0:6498:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1790945742.266806:0:6498:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790945742.267069:0:6498:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1790945742.267075:0:6498:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1790945742.268237:0:6498:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1790945742.268248:0:6498:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1790945742.268974:0:6498:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1790945742.268981:0:6498:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1790945742.270629:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945742.270635:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945742.270637:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945742.270933:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945742.270936:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945742.270937:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945742.271824:0:6498:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1790945742.291503:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1790945742.521229:0:6498:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3883 MB/s 00000001:01000000:3.0:1790945742.771885:0:6498:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 5015 MB/s 00000001:01000000:0.0:1790945743.021778:0:6498:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 415 MB/s 00000001:01000000:3.0:1790945743.271747:0:6498:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 855 MB/s 00080000:10000000:3.0:1790945743.287512:0:6498:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:1.0:1790945743.305438:0:6498:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1790945743.309006:0:6512:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1790945743.309317:0:6498:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1790945743.309398:0:6498:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1790945743.309607:0:6498:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1790945743.309636:0:6498:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1790945743.311560:0:6498:0:(service.c:173:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790945743.313051:0:6498:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1790945743.313063:0:6498:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1790945743.315477:0:6498:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1790945743.315561:0:6498:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1790945743.316482:0:6498:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1790945743.316491:0:6498:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1790945743.317676:0:6498:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1790945743.317701:0:6498:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.120@tcp' 00000020:01000004:2.0:1790945743.317703:0:6498:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1790945743.317771:0:6498:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.120@tcp (typ=mgc) 00000020:00000080:2.0:1790945743.317793:0:6498:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.120@tcp (0000000011f0cec7) 00000020:00000080:2.0:1790945743.317838:0:6498:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1790945743.317940:0:6498:0:(ldlm_lib.c:102:import_set_conn()) imp 000000006d7a47bd@MGC192.168.204.120@tcp: add connection 192.168.204.120@tcp at head 00010000:00010000:2.0:1790945743.318087:0:6498:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.120@tcp-0 is initialized 00000040:01000000:2.0:1790945743.318323:0:6498:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.120@tcp ctxt 1 is initialized 00000100:00080000:3.0:1790945743.321568:0:6517:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1790945743.328329:0:6519:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1790945743.328466:0:6498:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.120@tcp (uuid 8841fcfb-fb47-4307-92c2-97500c1c82bd) 00000020:00000080:3.0:1790945743.328494:0:6498:0:(genops.c:1384:class_connect()) connect: client 8841fcfb-fb47-4307-92c2-97500c1c82bd, cookie 0xd9f4181e0d27cc4b 00000100:00080000:3.0:1790945743.328506:0:6498:0:(import.c:545:import_select_connection()) MGC192.168.204.120@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790945743.328517:0:6498:0:(import.c:666:import_select_connection()) MGC192.168.204.120@tcp: import 000000006d7a47bd using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1790945743.328569:0:6498:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002def6ccb x1877942638477440/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790945743.328696:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002def6ccb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8841fcfb-fb47-4307-92c2-97500c1c82bd:3646:1877942638477440:0@lo:250: 00000100:00100000:3.0:1790945743.328776:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945743.328953:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638477440 00000100:00100000:2.0:1790945743.328961:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638477440 00000100:00100000:2.0:1790945743.328997:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790945743.329003:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000078edfb31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3646:x1877942638477440:12345-0@lo:250: 00010000:00080000:2.0:1790945743.329025:0:6515:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 8841fcfb-fb47-4307-92c2-97500c1c82bd@0@lo t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:2.0:1790945743.329048:0:6515:0:(genops.c:1384:class_connect()) connect: client 8841fcfb-fb47-4307-92c2-97500c1c82bd, cookie 0xd9f4181e0d27cc52 00000100:00080000:3.0:1790945743.329275:0:6498:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 8841fcfb-fb47-4307-92c2-97500c1c82bd->MGS 00000020:01000004:3.0:1790945743.329301:0:6498:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1790945743.329306:0:6498:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1790945743.329329:0:6498:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000fd34b0d2) 00000020:00000080:3.0:1790945743.329341:0:6498:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:2.0:1790945743.329989:0:6515:0:(import.c:65:import_set_state_nolock()) 00000000e9060db1 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790945743.330107:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000078edfb31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+5:3646:x1877942638477440:12345-0@lo:250: Request processed in 1100us (1329us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945743.330117:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790945743.330322:0:3646:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.120@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1790945743.330332:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.120@tcp: connect to target with instance 0 00000100:00080000:2.0:1790945743.330339:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.120@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1790945743.330350:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1790945743.330353:0:3646:0:(import.c:65:import_set_state_nolock()) 000000006d7a47bd MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1790945743.330356:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1790945743.330365:0:3646:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1790945743.330370:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002def6ccb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8841fcfb-fb47-4307-92c2-97500c1c82bd:3646:1877942638477440:0@lo:250: 00010000:00010000:1.0:1790945743.332192:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945743.358975:0:6498:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790945743.360802:0:6498:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1790945743.360945:0:6498:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1790945743.378387:0:6498:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1790945743.378406:0:6498:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1790945743.379954:0:6498:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1790945743.379966:0:6498:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1790945743.386067:0:6498:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790945743.386575:0:6498:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1790945743.386581:0:6498:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1790945743.395932:0:6498:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1790945743.395953:0:6498:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1790945743.454985:0:6498:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790945743.455382:0:6498:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1790945743.455389:0:6498:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1790945743.457253:0:6498:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1790945743.457268:0:6498:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1790945743.458272:0:6498:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790945743.458479:0:6498:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1790945743.458485:0:6498:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1790945743.459934:0:6498:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790945743.459950:0:6498:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1790945743.461374:0:6498:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790945743.461579:0:6498:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790945743.461586:0:6498:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1790945743.462514:0:6498:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790945743.462525:0:6498:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1790945743.463156:0:6498:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790945743.463465:0:6498:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790945743.463470:0:6498:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1790945743.463944:0:6498:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790945743.463951:0:6498:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1790945743.483002:0:6498:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790945743.483543:0:6498:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1790945743.483550:0:6498:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1790945743.484766:0:6498:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790945743.484778:0:6498:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1790945743.485700:0:6498:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790945743.485711:0:6498:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1790945743.486813:0:6498:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1790945743.486843:0:6498:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1790945743.486850:0:6498:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.120@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1790945743.486965:0:6498:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.120@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790945743.487000:0:6498:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.120@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1790945743.487004:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790945743.487005:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790945743.487007:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790945743.487008:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790945743.487009:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790945743.487010:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790945743.487011:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790945743.487012:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790945743.487014:0:6498:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790945743.487015:0:6498:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790945743.487017:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790945743.487018:0:6498:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790945743.487020:0:6498:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1790945743.487100:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790945743.487101:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790945743.487102:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790945743.487103:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790945743.487104:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790945743.487105:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790945743.487106:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790945743.487106:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790945743.487107:0:6498:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790945743.487108:0:6498:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790945743.487109:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790945743.487110:0:6498:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790945743.487143:0:6498:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1790945743.487160:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000224cb39a pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:6498:1877942638477568:0@lo:253: 00000100:00100000:3.0:1790945743.487373:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945743.487487:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 0000000067423e92 going to sleep for 11 seconds 00000100:00100000:1.0:1790945743.487574:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638477568 00000100:00100000:1.0:1790945743.487583:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638477568 00000100:00100000:1.0:1790945743.487668:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790945743.487677:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000006978886f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+5:6498:x1877942638477568:12345-0@lo:253: 20000000:01000000:1.0:1790945743.487725:0:6516:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790945743.487728:0:6516:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1790945743.488063:0:6537:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1790945743.488197:0:6516:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1790945743.488485:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790945743.489552:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1790945743.489758:0:6516:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1790945743.489762:0:6516:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1790945743.489767:0:6516:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1790945743.489770:0:6516:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1790945743.489779:0:6516:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1790945743.489932:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790945743.490152:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1790945743.490288:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1790945743.490313:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1790945743.490331:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1790945743.490345:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1790945743.490396:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1790945743.490404:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1790945743.490416:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1790945743.490421:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1790945743.490431:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1790945743.490436:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1790945743.490458:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1790945743.490471:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1790945743.490496:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1790945743.490501:0:6516:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1790945743.490507:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790945743.490606:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1790945743.490615:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1790945743.490643:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1790945743.490659:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1790945743.490673:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1790945743.490682:0:6516:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1790945743.490705:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1790945743.490711:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1790945743.490721:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1790945743.490733:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1790945743.490745:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1790945743.490753:0:6516:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1790945743.490774:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1790945743.490780:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1790945743.490793:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1790945743.490808:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1790945743.490869:0:6516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1790945743.490892:0:6516:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1790945743.490912:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1790945743.491617:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1790945743.491818:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1790945743.491838:0:6516:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.120@tcp for mdt 20000000:01000000:3.0:1790945743.491840:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.120@tcp (null) (null) (null) 00000040:00080000:3.0:1790945743.491855:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1790945743.491861:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1790945743.491874:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1790945743.491880:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.120@tcp (null) (null) 00000040:00080000:3.0:1790945743.491891:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1790945743.491919:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1790945743.491935:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1790945743.491952:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1790945743.491977:0:6516:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1790945743.491980:0:6516:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1790945743.491983:0:6516:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1790945743.492112:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1790945743.492114:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1790945743.492536:0:6540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1790945743.492691:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1790945743.492710:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1790945743.492723:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:3.0:1790945743.492733:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1790945743.492735:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1790945743.492994:0:6541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1790945743.493417:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1790945743.493439:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1790945743.493453:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1790945743.493464:0:6516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790945743.493466:0:6516:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1790945743.493470:0:6516:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1790945743.493472:0:6516:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1790945743.493476:0:6516:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1790945743.493482:0:6516:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1790945743.493726:0:6542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1790945743.493813:0:6516:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1790945743.501778:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1790945743.501816:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1790945743.501833:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1790945743.501853:0:6516:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1790945743.501875:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f89886d8/0xd9f4181e0d27cc60 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945743.501893:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f89886d8/0xd9f4181e0d27cc60 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945743.501912:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f89886d8/0xd9f4181e0d27cc60 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945743.501918:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f89886d8/0xd9f4181e0d27cc60 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945743.501924:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f89886d8/0xd9f4181e0d27cc60 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945743.501952:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f89886d8/0xd9f4181e0d27cc60 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945743.501959:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f89886d8 already unused, calling callback (00000000b60b8e97) 00010000:00010000:2.0:1790945743.501962:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f89886d8/0xd9f4181e0d27cc60 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945743.501969:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f89886d8/0xd9f4181e0d27cc60 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945743.501982:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f89886d8/0xd9f4181e0d27cc60 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945743.501988:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f89886d8/0xd9f4181e0d27cc60 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945743.501994:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f89886d8/0xd9f4181e0d27cc60 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790945743.502012:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1790945743.510425:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000006978886f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+5:6498:x1877942638477568:12345-0@lo:253: Request processed in 22741us (23044us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945743.510441:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790945743.510599:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000224cb39a pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:6498:1877942638477568:0@lo:253: 10000000:01000000:3.0:1790945743.510618:0:6498:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1790945743.510622:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790945743.510624:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790945743.510626:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790945743.510627:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1790945743.510628:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790945743.510630:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790945743.510631:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790945743.510633:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790945743.510634:0:6498:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1790945743.510635:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790945743.510636:0:6498:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790945743.510657:0:6498:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f7072b2e from lustre-MDT0000 10000000:01000000:3.0:1790945743.510687:0:6498:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1790945743.510691:0:6498:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1790945743.510695:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9d40af68cd40 10000000:01000000:3.0:1790945743.510699:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790945743.510707:0:6498:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9d40af68cd40 from 1 10000000:01000000:3.0:1790945743.510722:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790945743.510762:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: 00000000b1724efa/0xd9f4181e0d27cc67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945743.510772:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: 00000000b1724efa/0xd9f4181e0d27cc67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945743.510781:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: 00000000b1724efa/0xd9f4181e0d27cc67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945743.510799:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000224cb39a pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:6498:1877942638477696:0@lo:101: 00000100:00100000:3.0:1790945743.510834:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945743.510937:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fafb14f4 going to sleep for 11 seconds 00000100:00100000:2.0:1790945743.511011:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638477696 00000100:00100000:2.0:1790945743.511018:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638477696 00000100:00100000:2.0:1790945743.511159:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790945743.511199:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000003122bbe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+5:6498:x1877942638477696:12345-0@lo:101: 00010000:00010000:2.0:1790945743.511212:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945743.511225:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f89886d8/0xd9f4181e0d27cc6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27cc67 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945743.511254:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f89886d8/0xd9f4181e0d27cc6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27cc67 expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945743.511265:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f89886d8/0xd9f4181e0d27cc6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27cc67 expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945743.511273:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f89886d8, rc 0) 00000100:00100000:2.0:1790945743.511312:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000003122bbe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+6:6498:x1877942638477696:12345-0@lo:101: Request processed in 145us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945743.511318:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790945743.511400:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000224cb39a pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:6498:1877942638477696:0@lo:101: 00010000:00010000:0.0:1790945743.511413:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: 00000000b1724efa/0xd9f4181e0d27cc67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cc6e expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945743.511421:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: 00000000b1724efa/0xd9f4181e0d27cc67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27cc6e expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945743.511489:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ea0ea839 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:6498:1877942638477824:0@lo:501: 00000100:00100000:0.0:1790945743.511517:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945743.511731:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 000000000e0e6f74 going to sleep for 11 seconds 00000100:00100000:3.0:1790945743.511803:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638477824 00000100:00100000:3.0:1790945743.511809:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638477824 00000100:00100000:3.0:1790945743.511833:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790945743.511839:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000003f55aaa8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+6:6498:x1877942638477824:12345-0@lo:501: 00000100:00100000:3.0:1790945743.511948:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000003f55aaa8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+6:6498:x1877942638477824:12345-0@lo:501: Request processed in 110us (431us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790945743.511956:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790945743.512064:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ea0ea839 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:6498:1877942638477824:0@lo:501: 10000000:01000000:0.0:1790945743.512091:0:6498:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1790945743.512107:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: 00000000b1724efa/0xd9f4181e0d27cc67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cc6e expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945743.512115:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: 00000000b1724efa/0xd9f4181e0d27cc67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cc6e expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945743.512124:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d4087223000 10000000:01000000:0.0:1790945743.512129:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1790945743.512133:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9d4087223000 10000000:01000000:0.0:1790945743.512136:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1790945743.512138:0:6498:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9d4087223000 from 1 10000000:01000000:0.0:1790945743.512140:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1790945743.512160:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: 000000008c72025c/0xd9f4181e0d27cc75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945743.512195:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: 000000008c72025c/0xd9f4181e0d27cc75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945743.512213:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: 000000008c72025c/0xd9f4181e0d27cc75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945743.512225:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ea0ea839 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:6498:1877942638477952:0@lo:101: 00000100:00100000:0.0:1790945743.512253:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945743.512273:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 000000000e0e6f74 going to sleep for 11 seconds 00000100:00100000:3.0:1790945743.512428:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638477952 00000100:00100000:3.0:1790945743.512433:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638477952 00000100:00100000:3.0:1790945743.512466:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790945743.512472:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000001a25aed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+6:6498:x1877942638477952:12345-0@lo:101: 00010000:00010000:3.0:1790945743.512481:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945743.512492:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003d2d4b74/0xd9f4181e0d27cc7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27cc75 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945743.512506:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003d2d4b74/0xd9f4181e0d27cc7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27cc75 expref: 7 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945743.512522:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003d2d4b74/0xd9f4181e0d27cc7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27cc75 expref: 7 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945743.512529:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003d2d4b74, rc 0) 00000100:00100000:3.0:1790945743.512577:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000001a25aed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+7:6498:x1877942638477952:12345-0@lo:101: Request processed in 105us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945743.512583:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790945743.512727:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ea0ea839 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:6498:1877942638477952:0@lo:101: 00010000:00010000:0.0:1790945743.512737:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: 000000008c72025c/0xd9f4181e0d27cc75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cc7c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945743.512745:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: 000000008c72025c/0xd9f4181e0d27cc75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27cc7c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945743.512756:0:6498:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1790945743.512802:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: 000000008c72025c/0xd9f4181e0d27cc75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cc7c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945743.512810:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: 000000008c72025c/0xd9f4181e0d27cc75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cc7c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945743.512816:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1790945743.512820:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790945743.512825:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9d4087223000 10000000:01000000:0.0:1790945743.512828:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1790945743.512831:0:6498:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1790945743.512833:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1790945743.512846:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: 00000000541844e0/0xd9f4181e0d27cc83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945743.512858:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: 00000000541844e0/0xd9f4181e0d27cc83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945743.512866:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: 00000000541844e0/0xd9f4181e0d27cc83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945743.512877:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ea0ea839 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:6498:1877942638478080:0@lo:101: 00000100:00100000:0.0:1790945743.512914:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945743.512935:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 000000000e0e6f74 going to sleep for 11 seconds 00000100:00100000:3.0:1790945743.513202:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638478080 00000100:00100000:3.0:1790945743.513207:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638478080 00000100:00100000:3.0:1790945743.513238:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790945743.513244:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000e850c446 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+7:6498:x1877942638478080:12345-0@lo:101: 00010000:00010000:3.0:1790945743.513252:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945743.513260:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000321f0f41/0xd9f4181e0d27cc8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27cc83 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945743.513273:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000321f0f41/0xd9f4181e0d27cc8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27cc83 expref: 8 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945743.513280:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000321f0f41/0xd9f4181e0d27cc8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27cc83 expref: 8 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945743.513286:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000321f0f41, rc 0) 00000100:00100000:3.0:1790945743.513315:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000e850c446 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+8:6498:x1877942638478080:12345-0@lo:101: Request processed in 72us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945743.513321:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790945743.513420:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ea0ea839 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:6498:1877942638478080:0@lo:101: 00010000:00010000:0.0:1790945743.513430:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: 00000000541844e0/0xd9f4181e0d27cc83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cc8a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945743.513436:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: 00000000541844e0/0xd9f4181e0d27cc83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27cc8a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945743.513501:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ea0ea839 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:6498:1877942638478208:0@lo:501: 00000100:00100000:0.0:1790945743.513525:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945743.513568:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 000000000e0e6f74 going to sleep for 11 seconds 00000100:00100000:3.0:1790945743.513662:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638478208 00000100:00100000:3.0:1790945743.513667:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638478208 00000100:00100000:3.0:1790945743.513694:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790945743.513707:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000139daaf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+8:6498:x1877942638478208:12345-0@lo:501: 00000100:00100000:3.0:1790945743.513795:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000139daaf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+9:6498:x1877942638478208:12345-0@lo:501: Request processed in 88us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945743.513801:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790945743.513977:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ea0ea839 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:6498:1877942638478208:0@lo:501: 00000100:00100000:0.0:1790945743.514004:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ea0ea839 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:6498:1877942638478336:0@lo:503: 00000100:00100000:0.0:1790945743.514108:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945743.514128:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 000000000e0e6f74 going to sleep for 11 seconds 00000100:00100000:3.0:1790945743.514190:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638478336 00000100:00100000:3.0:1790945743.514195:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638478336 00000100:00100000:3.0:1790945743.514224:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790945743.514229:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000001aff57b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+9:6498:x1877942638478336:12345-0@lo:503: 00000100:00100000:3.0:1790945743.514305:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000001aff57b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+9:6498:x1877942638478336:12345-0@lo:503: Request processed in 76us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945743.514312:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790945743.514433:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ea0ea839 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:6498:1877942638478336:0@lo:503: 00000100:00100000:0.0:1790945743.515009:0:6543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ea0ea839 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:6543:1877942638478464:0@lo:502: 00000100:00100000:0.0:1790945743.515128:0:6543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945743.515280:0:6543:0:(client.c:2716:ptlrpc_set_wait()) set 000000009fb36d05 going to sleep for 11 seconds 00000100:00100000:2.0:1790945743.515336:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638478464 00000100:00100000:2.0:1790945743.515341:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638478464 00000100:00100000:2.0:1790945743.515405:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790945743.515412:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000cac89dd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+9:6543:x1877942638478464:12345-0@lo:502: 00000100:00100000:2.0:1790945743.515513:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000cac89dd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+9:6543:x1877942638478464:12345-0@lo:502: Request processed in 101us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945743.515520:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790945743.515645:0:6543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ea0ea839 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:6543:1877942638478464:0@lo:502: 00000020:01000000:0.0:1790945743.515668:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790945743.515677:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945743.515680:0:6543:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1790945743.515684:0:6543:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1790945743.515688:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790945743.515707:0:6543:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000002c3884b4) 00000020:00000080:0.0:1790945743.515725:0:6543:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1790945743.515731:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1790945743.515933:0:6543:0:(osd_handler.c:8931:osd_obd_connect()) connect #2 00000020:00000080:0.0:1790945743.515941:0:6543:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd9f4181e0d27cc98 00000020:00000080:0.0:1790945743.516165:0:6543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1790945743.516208:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790945743.516212:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945743.516213:0:6543:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1790945743.516215:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790945743.516219:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945743.516220:0:6543:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1790945743.516223:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790945743.516229:0:6543:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000027c4ccbe) 00000020:00000080:0.0:1790945743.516239:0:6543:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1790945743.516242:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1790945743.516244:0:6543:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1790945743.516247:0:6543:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1790945743.516252:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790945743.516295:0:6543:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f7072b2e from lustre-MDT0000, refs=3 00000020:00000080:0.0:1790945743.516306:0:6543:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000d3fbf951) 00000020:00000080:0.0:1790945743.516314:0:6543:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1790945743.516386:0:6543:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1790945743.516395:0:6543:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd9f4181e0d27ccad 00000020:00000080:0.0:1790945743.516501:0:6543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1790945743.516507:0:6543:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1790945743.516512:0:6543:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xd9f4181e0d27ccb4 00080000:01000000:0.0:1790945743.516517:0:6543:0:(osd_handler.c:8931:osd_obd_connect()) connect #3 00000020:00000080:0.0:1790945743.516520:0:6543:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd9f4181e0d27ccbb 00080000:10000000:0.0:1790945743.517367:0:6543:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1790945743.517532:0:6543:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1790945743.524952:0:6543:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1790945743.615483:0:6543:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1790945743.615884:0:6543:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1790945743.621364:0:6543:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1790945743.622660:0:6543:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1790945743.628119:0:6543:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000004369b27d) 00000020:00000080:3.0:1790945743.628144:0:6543:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1790945743.628456:0:6543:0:(osd_handler.c:8931:osd_obd_connect()) connect #4 00000020:00000080:2.0:1790945743.628469:0:6543:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd9f4181e0d27ccc9 00000020:00000080:3.0:1790945743.629061:0:6543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1790945743.637045:0:6543:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:2.0:1790945743.643375:0:6543:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:2.0:1790945743.646103:0:6543:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:2.0:1790945743.651598:0:6543:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:2.0:1790945743.655802:0:6543:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:2.0:1790945743.663430:0:6543:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:2.0:1790945743.670276:0:6543:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xd9f4181e0d27ccd0 00000020:00000080:3.0:1790945743.672511:0:6543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1790945743.672526:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790945743.672535:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945743.672537:0:6543:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1790945743.672541:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790945743.672693:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945743.672695:0:6543:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790945743.672700:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790945743.672701:0:6543:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1790945743.672704:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790945743.672706:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945743.672948:0:6543:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:3.0:1790945743.672953:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790945743.672958:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945743.672959:0:6543:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1790945743.672964:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1790945743.673027:0:6543:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1790945743.673087:0:6543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a243eb29 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:6543:1877942638478592:0@lo:502: 00000100:00100000:3.0:1790945743.673445:0:6543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945743.673613:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638478592 00000100:00100000:1.0:1790945743.673621:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638478592 00000100:00100000:1.0:1790945743.673670:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790945743.673678:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000fc1d384c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+9:6543:x1877942638478592:12345-0@lo:502: 00000100:00100000:3.0:1790945743.673937:0:6543:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e64889f3 going to sleep for 11 seconds 00000100:00100000:1.0:1790945743.674161:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000fc1d384c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+9:6543:x1877942638478592:12345-0@lo:502: Request processed in 483us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945743.674188:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790945743.674397:0:6543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a243eb29 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:6543:1877942638478592:0@lo:502: 00000020:01000000:3.0:1790945743.674433:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790945743.674440:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945743.674442:0:6543:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1790945743.674445:0:6543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1790945743.674856:0:6498:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1790945743.674960:0:6498:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1790945743.675029:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: 00000000541844e0/0xd9f4181e0d27cc83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cc8a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945743.675040:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: 00000000541844e0/0xd9f4181e0d27cc83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cc8a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945743.675048:0:6498:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d4087223000 from 1 10000000:01000000:1.0:1790945743.675051:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790945743.675097:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: 000000005ffcaf1c/0xd9f4181e0d27ccd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945743.675116:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: 000000005ffcaf1c/0xd9f4181e0d27ccd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945743.675138:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: 000000005ffcaf1c/0xd9f4181e0d27ccd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945743.675157:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005dba1930 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:6498:1877942638478720:0@lo:101: 00000100:00100000:1.0:1790945743.675246:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945743.675272:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e9389a87 going to sleep for 11 seconds 00000100:00100000:0.0:1790945743.675415:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638478720 00000100:00100000:0.0:1790945743.675423:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638478720 00000100:00100000:0.0:1790945743.675452:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790945743.675459:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c23e6270 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+9:6498:x1877942638478720:12345-0@lo:101: 00010000:00010000:0.0:1790945743.675472:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945743.675485:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000df3e836e/0xd9f4181e0d27ccde lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27ccd7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945743.675510:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000df3e836e/0xd9f4181e0d27ccde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27ccd7 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945743.675520:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000df3e836e/0xd9f4181e0d27ccde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ccd7 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945743.675527:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000df3e836e, rc 0) 00000100:00100000:0.0:1790945743.675570:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c23e6270 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+10:6498:x1877942638478720:12345-0@lo:101: Request processed in 112us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945743.675577:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790945743.675664:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005dba1930 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:6498:1877942638478720:0@lo:101: 00010000:00010000:1.0:1790945743.675676:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: 000000005ffcaf1c/0xd9f4181e0d27ccd7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ccde expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945743.675683:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: 000000005ffcaf1c/0xd9f4181e0d27ccd7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27ccde expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945743.676799:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005dba1930 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:6498:1877942638478848:0@lo:256: 00000100:00100000:1.0:1790945743.676857:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945743.676917:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e9389a87 going to sleep for 11 seconds 00000100:00100000:2.0:1790945743.676981:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638478848 00000100:00100000:2.0:1790945743.676996:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638478848 00000100:00100000:2.0:1790945743.677042:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790945743.677050:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000088f03c53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+10:6498:x1877942638478848:12345-0@lo:256: 20000000:01000000:2.0:1790945743.677067:0:6516:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1790945743.677074:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1790945743.677203:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000088f03c53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+10:6498:x1877942638478848:12345-0@lo:256: Request processed in 117us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945743.677212:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790945743.677470:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005dba1930 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:6498:1877942638478848:0@lo:256: 10000000:01000000:1.0:1790945743.678052:0:6498:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790945743.678076:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: 000000005ffcaf1c/0xd9f4181e0d27ccd7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ccde expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945743.678086:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: 000000005ffcaf1c/0xd9f4181e0d27ccd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ccde expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945743.678104:0:6498:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d4087223000 from 1 10000000:01000000:1.0:1790945743.678107:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790945743.678135:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: 00000000040757f7/0xd9f4181e0d27cce5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945743.678141:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: 00000000040757f7/0xd9f4181e0d27cce5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945743.678149:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: 00000000040757f7/0xd9f4181e0d27cce5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945743.678162:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005dba1930 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:6498:1877942638478976:0@lo:101: 00000100:00100000:1.0:1790945743.678227:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945743.678259:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e9389a87 going to sleep for 11 seconds 00000100:00100000:0.0:1790945743.680787:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638478976 00000100:00100000:0.0:1790945743.680806:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638478976 00000100:00100000:0.0:1790945743.680874:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790945743.680882:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000008cc2ebb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+10:6498:x1877942638478976:12345-0@lo:101: 00010000:00010000:0.0:1790945743.680923:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945743.680943:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000087760eb3/0xd9f4181e0d27ccec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27cce5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945743.680969:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000087760eb3/0xd9f4181e0d27ccec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27cce5 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945743.680980:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000087760eb3/0xd9f4181e0d27ccec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27cce5 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945743.680989:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000087760eb3, rc 0) 00000100:00100000:0.0:1790945743.681081:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000008cc2ebb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+11:6498:x1877942638478976:12345-0@lo:101: Request processed in 201us (2854us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945743.681088:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790945743.684736:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005dba1930 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:6498:1877942638478976:0@lo:101: 00010000:00010000:1.0:1790945743.684770:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: 00000000040757f7/0xd9f4181e0d27cce5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ccec expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945743.684782:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: 00000000040757f7/0xd9f4181e0d27cce5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27ccec expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945743.684911:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005dba1930 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:6498:1877942638479104:0@lo:501: 00000100:00100000:1.0:1790945743.684973:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945743.685022:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e9389a87 going to sleep for 11 seconds 00000100:00100000:3.0:1790945743.685090:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638479104 00000100:00100000:3.0:1790945743.685097:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638479104 00000100:00100000:3.0:1790945743.685133:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790945743.685140:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000017aedc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+11:6498:x1877942638479104:12345-0@lo:501: 00000100:00100000:3.0:1790945743.685353:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000017aedc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+11:6498:x1877942638479104:12345-0@lo:501: Request processed in 214us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945743.685362:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790945743.685539:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005dba1930 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:6498:1877942638479104:0@lo:501: 00000100:00100000:1.0:1790945743.685566:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005dba1930 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:6498:1877942638479232:0@lo:503: 00000100:00100000:1.0:1790945743.685614:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945743.685799:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e9389a87 going to sleep for 11 seconds 00000100:00100000:3.0:1790945743.685841:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638479232 00000100:00100000:3.0:1790945743.685846:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638479232 00000100:00100000:3.0:1790945743.685865:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790945743.685870:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000033e8f6df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+11:6498:x1877942638479232:12345-0@lo:503: 00000040:00080000:3.0:1790945743.685913:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790945743.685999:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000033e8f6df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+11:6498:x1877942638479232:12345-0@lo:503: Request processed in 128us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945743.686006:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790945743.689917:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005dba1930 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:6498:1877942638479232:0@lo:503: 00000040:00080000:1.0:1790945743.693123:0:6547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1790945743.693445:0:6498:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1790945743.693469:0:6498:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790945743.693485:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: 00000000040757f7/0xd9f4181e0d27cce5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ccec expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945743.693497:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: 00000000040757f7/0xd9f4181e0d27cce5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ccec expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945743.693547:0:6498:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790945743.693550:0:6498:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d4087223000 10000000:01000000:2.0:1790945743.693553:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d4087223000 10000000:01000000:2.0:1790945743.693557:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790945743.693562:0:6498:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d4087223000 from 1 10000000:01000000:2.0:1790945743.693564:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790945743.693633:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: 0000000033ec8847/0xd9f4181e0d27ccf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945743.693642:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: 0000000033ec8847/0xd9f4181e0d27ccf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945743.693652:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: 0000000033ec8847/0xd9f4181e0d27ccf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945743.693685:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001671231d pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:6498:1877942638479360:0@lo:101: 00000100:00100000:2.0:1790945743.693750:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945743.693793:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 00000000546030fd going to sleep for 11 seconds 00000100:00100000:0.0:1790945743.694091:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638479360 00000100:00100000:0.0:1790945743.694100:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638479360 00000100:00100000:0.0:1790945743.694158:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790945743.694192:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000a7b3ec15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+11:6498:x1877942638479360:12345-0@lo:101: 00010000:00010000:0.0:1790945743.694207:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945743.694218:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000023ee331e/0xd9f4181e0d27ccfa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27ccf3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945743.694239:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000023ee331e/0xd9f4181e0d27ccfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27ccf3 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945743.694249:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000023ee331e/0xd9f4181e0d27ccfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ccf3 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945743.694257:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000023ee331e, rc 0) 00000100:00100000:0.0:1790945743.694309:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000a7b3ec15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+12:6498:x1877942638479360:12345-0@lo:101: Request processed in 143us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945743.694316:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790945743.694688:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001671231d pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:6498:1877942638479360:0@lo:101: 00010000:00010000:1.0:1790945743.694703:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: 0000000033ec8847/0xd9f4181e0d27ccf3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ccfa expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945743.694712:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: 0000000033ec8847/0xd9f4181e0d27ccf3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27ccfa expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945743.694768:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005dba1930 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:6498:1877942638479488:0@lo:501: 00000100:00100000:1.0:1790945743.694800:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945743.694828:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b29de7cb going to sleep for 11 seconds 00000100:00100000:0.0:1790945743.694878:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638479488 00000100:00100000:0.0:1790945743.694884:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638479488 00000100:00100000:0.0:1790945743.694923:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790945743.694931:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000062957e12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+12:6498:x1877942638479488:12345-0@lo:501: 00000100:00100000:0.0:1790945743.695048:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000062957e12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+12:6498:x1877942638479488:12345-0@lo:501: Request processed in 118us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945743.695055:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790945743.695133:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005dba1930 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:6498:1877942638479488:0@lo:501: 00000100:00100000:1.0:1790945743.695159:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005dba1930 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:6498:1877942638479616:0@lo:503: 00000100:00100000:1.0:1790945743.695226:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945743.695239:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b29de7cb going to sleep for 11 seconds 00000100:00100000:2.0:1790945743.695347:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638479616 00000100:00100000:2.0:1790945743.695352:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638479616 00000100:00100000:2.0:1790945743.695376:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790945743.695382:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005cd44569 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+12:6498:x1877942638479616:12345-0@lo:503: 00000100:00100000:2.0:1790945743.695464:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005cd44569 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+12:6498:x1877942638479616:12345-0@lo:503: Request processed in 82us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945743.695471:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790945743.695660:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005dba1930 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:6498:1877942638479616:0@lo:503: 00000100:00100000:0.0:1790945743.696127:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ea0ea839 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:6548:1877942638479744:0@lo:502: 00000100:00100000:0.0:1790945743.696347:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945743.696411:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638479744 00000100:00100000:3.0:1790945743.696417:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638479744 00000100:00100000:3.0:1790945743.696481:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790945743.696489:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c570274a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+12:6548:x1877942638479744:12345-0@lo:502: 00000100:00100000:3.0:1790945743.696577:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c570274a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+12:6548:x1877942638479744:12345-0@lo:502: Request processed in 89us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945743.696584:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790945743.696653:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set 0000000009e7106e going to sleep for 11 seconds 00000100:00100000:1.0:1790945743.696668:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ea0ea839 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:6548:1877942638479744:0@lo:502: 00000020:01000004:1.0:1790945743.696721:0:6548:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1790945743.696737:0:6548:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000ce316e02) 00000020:00000080:1.0:1790945743.696756:0:6548:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1790945743.696840:0:6548:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f7072b2e from lustre-MDT0000, refs=4 00000020:01000004:1.0:1790945743.696844:0:6548:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000f7072b2e from lustre-MDT0000, refs=4 00000020:01000004:1.0:1790945743.696852:0:6548:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000f7072b2e 4 00010000:00080000:1.0:1790945743.696878:0:6548:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002809a6a4@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.120@tcp at head 00010000:00010000:1.0:1790945743.698512:0:6548:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1790945743.698699:0:6548:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1790945743.698740:0:6548:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790945743.698754:0:6548:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xd9f4181e0d27cd08 00000100:00080000:1.0:1790945743.698763:0:6548:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790945743.698775:0:6548:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000002809a6a4 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1790945743.698813:0:6548:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005dba1930 x1877942638479872/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790945743.698846:0:6548:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1790945743.699117:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005dba1930 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1877942638479872:0@lo:38: 00000100:00100000:2.0:1790945743.699220:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945743.703550:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638479872 00000100:00100000:1.0:1790945743.703567:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638479872 00000100:00100000:1.0:1790945743.703763:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790945743.703771:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000001433bb1b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1877942638479872:12345-0@lo:38: 00000100:00100000:1.0:1790945743.705063:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000001433bb1b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1877942638479872:12345-0@lo:38: Request processed in 1285us (5837us total) trans 0 rc -11/-11 00000100:00100000:1.0:1790945743.705076:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790945743.705231:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000050e9c4f0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:6548:1877942638480000:0@lo:502: 00000100:00100000:1.0:1790945743.705542:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945743.705588:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dab9fc01 going to sleep for 11 seconds 00000100:00100000:0.0:1790945743.705637:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638480000 00000100:00100000:0.0:1790945743.705645:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638480000 00000100:00100000:0.0:1790945743.705693:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790945743.705701:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000090aca9ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+12:6548:x1877942638480000:12345-0@lo:502: 00000100:00100000:0.0:1790945743.705819:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000090aca9ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+12:6548:x1877942638480000:12345-0@lo:502: Request processed in 118us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945743.705826:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790945743.705918:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000050e9c4f0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:6548:1877942638480000:0@lo:502: 00000040:00080000:1.0:1790945743.705942:0:6548:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1790945743.707210:0:6498:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1790945743.707243:0:6498:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790945743.707262:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: 0000000033ec8847/0xd9f4181e0d27ccf3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ccfa expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945743.707277:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: 0000000033ec8847/0xd9f4181e0d27ccf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ccfa expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790945743.707343:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790945743.707350:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790945743.707351:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790945743.707352:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790945743.707353:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790945743.707355:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790945743.707356:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790945743.707357:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790945743.707358:0:6498:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790945743.707359:0:6498:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790945743.707361:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790945743.707362:0:6498:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790945743.707366:0:6498:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1790945743.707369:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790945743.707370:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790945743.707371:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790945743.707372:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790945743.707372:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790945743.707373:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790945743.707374:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790945743.707375:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790945743.707376:0:6498:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790945743.707377:0:6498:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790945743.707378:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790945743.707379:0:6498:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790945743.707399:0:6498:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1790945743.707411:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e0c71b41 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:6498:1877942638480128:0@lo:253: 00000100:00100000:0.0:1790945743.707460:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945743.707485:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 0000000009e7106e going to sleep for 11 seconds 00000100:00100000:3.0:1790945743.707619:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638480128 00000100:00100000:3.0:1790945743.707626:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638480128 00000100:00100000:3.0:1790945743.707671:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790945743.707679:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000ef99232f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+12:6498:x1877942638480128:12345-0@lo:253: 20000000:01000000:3.0:1790945743.707702:0:6515:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1790945743.707715:0:6515:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1790945743.708127:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790945743.708136:0:3646:0:(import.c:65:import_set_state_nolock()) 000000002809a6a4 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790945743.708140:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1790945743.708144:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005dba1930 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1877942638479872:0@lo:38: 20000000:01000000:3.0:1790945743.713815:0:6515:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1790945743.713873:0:6515:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1790945743.714140:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000ef99232f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+12:6498:x1877942638480128:12345-0@lo:253: Request processed in 6459us (6676us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945743.714153:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790945743.714520:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e0c71b41 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:6498:1877942638480128:0@lo:253: 10000000:01000000:0.0:1790945743.714535:0:6498:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1790945743.714538:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790945743.714540:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790945743.714542:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790945743.714543:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790945743.714544:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790945743.714546:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790945743.714547:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790945743.714549:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790945743.714562:0:6498:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790945743.714563:0:6498:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790945743.714564:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790945743.714566:0:6498:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790945743.714579:0:6498:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1790945743.719344:0:6498:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:0.0:1790945743.719513:0:6498:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 20000000:01000000:1.0:1790945743.719578:0:6537:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1790945743.719585:0:6537:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1790945743.719605:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000029c6f988/0xd9f4181e0d27cd0f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945743.719640:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000df3e836e/0xd9f4181e0d27ccde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ccd7 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945743.719648:0:6537:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000029c6f988/0xd9f4181e0d27cd0f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945743.719685:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000df3e836e/0xd9f4181e0d27ccde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27ccd7 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945743.719701:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000df3e836e/0xd9f4181e0d27ccde lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27ccd7 expref: 11 pid: 6514 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945743.719720:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000050e9c4f0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1877942638480256:0@lo:104: 00000100:00100000:1.0:1790945743.719797:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945743.719844:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dab9fc01 going to sleep for 11 seconds 00000100:00100000:1.0:1790945743.719882:0:6504:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638480256 00000100:00100000:1.0:1790945743.719890:0:6504:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638480256 00000100:00100000:1.0:1790945743.719949:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790945743.719957:0:6504:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000834133db pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+3:6537:x1877942638480256:12345-0@lo:104: 00010000:00010000:1.0:1790945743.719969:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: 000000005ffcaf1c/0xd9f4181e0d27ccd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27ccde expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945743.720018:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790945743.720023:0:6504:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000834133db pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+3:6537:x1877942638480256:12345-0@lo:104: Request processed in 68us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945743.720030:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790945743.720065:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000050e9c4f0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1877942638480256:0@lo:104: 00010000:00010000:1.0:1790945743.720081:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000029c6f988/0xd9f4181e0d27cd0f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945743.720146:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00080000:10000000:0.0:1790945743.720244:0:6498:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00010000:00010000:2.0:1790945743.720285:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: 000000005ffcaf1c/0xd9f4181e0d27ccd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27ccde expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945743.720295:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005ffcaf1c already unused, calling callback (00000000744480de) 10000000:00010000:2.0:1790945743.720298:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: 000000005ffcaf1c/0xd9f4181e0d27ccd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27ccde expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945743.720307:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: 000000005ffcaf1c/0xd9f4181e0d27ccd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27ccde expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790945743.720323:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: 000000005ffcaf1c/0xd9f4181e0d27ccd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27ccde expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945743.720329:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00080000:10000000:0.0:1790945743.720402:0:6498:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00010000:00010000:2.0:1790945743.720441:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: 000000005ffcaf1c/0xd9f4181e0d27ccd7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ccde expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945743.720448:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790945743.720463:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: 000000005ffcaf1c/0xd9f4181e0d27ccd7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ccde expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945743.720469:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: 000000005ffcaf1c/0xd9f4181e0d27ccd7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ccde expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945743.720485:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945743.720486:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945743.720488:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1790945743.720599:0:6498:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000100:00100000:2.0:1790945743.720778:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790945743.720788:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000646bed3b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638480384:0@lo:103: 00000100:00100000:2.0:1790945743.720824:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945743.721240:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638480384 00000100:00100000:1.0:1790945743.721246:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638480384 00010000:00010000:1.0:1790945743.721266:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000df3e836e/0xd9f4181e0d27ccde lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27ccd7 expref: 12 pid: 6514 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945743.721291:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790945743.721297:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000070ab42b2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+12:3647:x1877942638480384:12345-0@lo:103: 00010000:00010000:1.0:1790945743.721307:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945743.721311:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000df3e836e/0xd9f4181e0d27ccde lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27ccd7 expref: 12 pid: 6514 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945743.721320:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000df3e836e/0xd9f4181e0d27ccde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27ccd7 expref: 12 pid: 6514 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1790945743.721338:0:6498:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00010000:00010000:1.0:1790945743.721403:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000df3e836e/0xd9f4181e0d27ccde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27ccd7 expref: 12 pid: 6514 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945743.721416:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000029c6f988/0xd9f4181e0d27cd0f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945743.721424:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000029c6f988/0xd9f4181e0d27cd0f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790945743.721437:0:6506:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001854473s 00010000:00010000:1.0:1790945743.721441:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000029c6f988/0xd9f4181e0d27cd0f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945743.721447:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000029c6f988/0xd9f4181e0d27cd0f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945743.721462:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000029c6f988/0xd9f4181e0d27cd0f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945743.721467:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000029c6f988/0xd9f4181e0d27cd0f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945743.721471:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000029c6f988 already unused, calling callback (00000000b60b8e97) 00010000:00010000:1.0:1790945743.721474:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000029c6f988/0xd9f4181e0d27cd0f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945743.721480:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000029c6f988/0xd9f4181e0d27cd0f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945743.721498:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000029c6f988/0xd9f4181e0d27cd0f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945743.721508:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945743.721540:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000070ab42b2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+11:3647:x1877942638480384:12345-0@lo:103: Request processed in 244us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945743.721547:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1790945743.721686:0:6537:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000029c6f988/0xd9f4181e0d27cd0f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945743.721696:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000029c6f988/0xd9f4181e0d27cd0f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945743.721701:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000029c6f988/0xd9f4181e0d27cd0f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945743.721854:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000646bed3b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638480384:0@lo:103: 00080000:10000000:0.0:1790945743.722675:0:6498:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:0.0:1790945743.722870:0:6498:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1790945743.723052:0:6498:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:0.0:1790945743.723265:0:6498:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1790945743.723461:0:6498:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:0.0:1790945743.723611:0:6498:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:0.0:1790945743.735524:0:6498:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1790945743.753494:0:6498:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1790945743.753641:0:6553:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1790945743.753646:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1790945743.754775:0:6554:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1790945743.760220:0:6498:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1790945743.760344:0:6498:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1790945743.760788:0:6498:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1790945743.760796:0:6498:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1790945743.760949:0:6498:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790945743.768881:0:6498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1790945743.770246:0:6554:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790945743.771454:0:6498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1790945743.771527:0:6498:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1790945743.772288:0:6498:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1790945743.773421:0:6498:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:2.0:1790945743.776153:0:6498:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1790945743.778848:0:6498:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1790945743.779117:0:6498:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1790945743.779308:0:6498:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1790945743.779444:0:6498:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00000040:00080000:0.0:1790945743.780653:0:6554:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1790945743.780734:0:6554:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1790945743.780739:0:6554:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:2.0:1790945743.781761:0:6498:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1790945743.782023:0:6498:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1790945743.785535:0:6498:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1790945743.785845:0:6498:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1790945743.786009:0:6498:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1790945743.786153:0:6498:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1790945743.786320:0:6498:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1790945743.786456:0:6498:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1790945743.786580:0:6498:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1790945743.786905:0:6498:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1790945743.787096:0:6498:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1790945743.787397:0:6498:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1790945743.787873:0:6498:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1790945743.788017:0:6498:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1790945743.788162:0:6498:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1790945743.788322:0:6498:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1790945743.788478:0:6498:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1790945743.788663:0:6498:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1790945743.788785:0:6498:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1790945743.788917:0:6498:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1790945743.789051:0:6498:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1790945743.789203:0:6498:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1790945743.789342:0:6498:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1790945743.789485:0:6498:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1790945743.789643:0:6498:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1790945743.789769:0:6498:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1790945743.789923:0:6498:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1790945743.790129:0:6498:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1790945743.803966:0:6498:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1790945743.804009:0:6498:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb827c1c63988 00100000:10000000:3.0:1790945743.804017:0:6498:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1790945743.805341:0:6498:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790945743.805360:0:6498:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.120@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790945743.805380:0:6498:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1790945743.805402:0:6498:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1790945743.807078:0:6498:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790945743.807270:0:6498:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1790945744.353263:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945745.375801:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945746.404626:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945747.425352:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790945748.336650:0:6798:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1790945748.447335:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790945748.831456:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1790945748.831467:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1790945748.831470:0:8:0:(import.c:65:import_set_state_nolock()) 000000002809a6a4 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790945748.831489:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000002809a6a4 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1790945748.831511:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d67899ab x1877942638480640/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790945748.831687:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790945748.831700:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000050e9c4f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638480512:0@lo:400: 00000100:00100000:2.0:1790945748.831784:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945748.832259:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d67899ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1877942638480640:0@lo:38: 00000100:00100000:3.0:1790945748.832302:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945748.832374:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638480640 00000100:00100000:0.0:1790945748.832383:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638480640 00000100:00100000:0.0:1790945748.832425:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790945748.832431:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000a243eb29 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1877942638480640:12345-0@lo:38: 00010000:00080000:0.0:1790945748.832457:0:6523:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:0.0:1790945748.832491:0:6523:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xd9f4181e0d27cd16 00000004:00100000:0.0:1790945748.832535:0:6523:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790945748.832646:0:6523:0:(import.c:65:import_set_state_nolock()) 00000000002bf794 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790945748.832722:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000a243eb29 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1877942638480640:12345-0@lo:38: Request processed in 290us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945748.832730:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790945748.833019:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d67899ab x1877942638480640/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790945758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790945748.833035:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1790945748.833043:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1790945748.833048:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790945748.833050:0:3646:0:(import.c:65:import_set_state_nolock()) 000000002809a6a4 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790945748.833055:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d67899ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1877942638480640:0@lo:38: 00000100:00100000:1.0:1790945748.833459:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638480512 00000100:00100000:1.0:1790945748.833465:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638480512 00000100:00100000:1.0:1790945748.833504:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790945748.833510:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000043ede053 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+11:3650:x1877942638480512:12345-0@lo:400: 00000100:00100000:1.0:1790945748.833566:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000043ede053 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+11:3650:x1877942638480512:12345-0@lo:400: Request processed in 56us (1783us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945748.833572:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790945748.833650:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000050e9c4f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638480512:0@lo:400: 00000020:00000004:0.0:1790945749.441496:0:6851:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790945749.442721:0:6851:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790945749.472396:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945750.497536:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945751.520282:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1790945752.525632:0:6952:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790945752.525838:0:6952:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1790945752.543377:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790945753.440916:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790945753.440925:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d4087223000 from 3 10000000:01000000:0.0:1790945753.440930:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790945753.440978:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: 00000000bc664630/0xd9f4181e0d27cd1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945753.440990:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: 00000000bc664630/0xd9f4181e0d27cd1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945753.440999:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: 00000000bc664630/0xd9f4181e0d27cd1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945753.441040:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e0c71b41 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638480768:0@lo:101: 00000100:00100000:0.0:1790945753.441102:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945753.441148:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 0000000013f4b332 going to sleep for 11 seconds 00000100:00100000:2.0:1790945753.441267:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638480768 00000100:00100000:2.0:1790945753.441275:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638480768 00000100:00100000:2.0:1790945753.441334:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790945753.441342:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000000fea14f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+11:6519:x1877942638480768:12345-0@lo:101: 00010000:00010000:2.0:1790945753.441356:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945753.441396:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e7d09c74/0xd9f4181e0d27cd24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27cd1d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945753.441420:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e7d09c74/0xd9f4181e0d27cd24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27cd1d expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945753.441430:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e7d09c74/0xd9f4181e0d27cd24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27cd1d expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945753.441438:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e7d09c74, rc 0) 00000100:00100000:2.0:1790945753.441483:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000000fea14f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+12:6519:x1877942638480768:12345-0@lo:101: Request processed in 142us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945753.441490:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790945753.441545:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e0c71b41 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638480768:0@lo:101: 00010000:00010000:2.0:1790945753.441561:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: 00000000bc664630/0xd9f4181e0d27cd1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cd24 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945753.441569:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: 00000000bc664630/0xd9f4181e0d27cd1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27cd24 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945753.441626:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000646bed3b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638480896:0@lo:256: 00000100:00100000:2.0:1790945753.441655:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945753.441854:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638480896 00000100:00100000:0.0:1790945753.441860:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638480896 00000100:00100000:0.0:1790945753.441888:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790945753.441894:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000000f7eebfc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+12:6519:x1877942638480896:12345-0@lo:256: 20000000:01000000:0.0:1790945753.441907:0:6514:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790945753.441922:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790945753.441926:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1790945753.441966:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fa07869e going to sleep for 11 seconds 00000100:00100000:0.0:1790945753.448215:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000000f7eebfc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+12:6519:x1877942638480896:12345-0@lo:256: Request processed in 6313us (6551us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945753.448234:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790945753.451029:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000646bed3b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638480896:0@lo:256: 10000000:01000000:2.0:1790945753.451106:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790945753.451117:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: 00000000bc664630/0xd9f4181e0d27cd1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cd24 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945753.451129:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: 00000000bc664630/0xd9f4181e0d27cd1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cd24 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945753.579416:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945753.952619:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eb6f774b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877942638481024:0@lo:400: 00000100:00100000:3.0:1790945753.953360:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945753.953842:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638481024 00000100:00100000:0.0:1790945753.953851:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638481024 00000100:00100000:0.0:1790945753.953899:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790945753.953906:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000020a695c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877942638481024:12345-0@lo:400: 00000100:00100000:0.0:1790945753.953962:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000020a695c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877942638481024:12345-0@lo:400: Request processed in 57us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945753.953969:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1790945753.954009:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000eb6f774b x1877942638481024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945753.954022:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eb6f774b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877942638481024:0@lo:400: 00010000:00010000:0.0:1790945754.594189:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945755.616732:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945756.641815:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945757.671134:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945758.687280:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945759.071542:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e5de1b1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638481152:0@lo:400: 00000100:00100000:2.0:1790945759.071633:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945759.071769:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007d9a73a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877942638481280:0@lo:400: 00000100:00100000:0.0:1790945759.071806:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945759.071950:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638481152 00000100:00100000:1.0:1790945759.071958:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638481152 00000100:00100000:1.0:1790945759.072008:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790945759.072016:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000004c840339 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+12:3647:x1877942638481152:12345-0@lo:400: 00000100:00100000:3.0:1790945759.075487:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638481280 00000100:00100000:3.0:1790945759.075505:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638481280 00000100:00100000:3.0:1790945759.075565:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790945759.075573:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c964f7b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1877942638481280:12345-0@lo:400: 00000100:00100000:3.0:1790945759.075682:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c964f7b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1877942638481280:12345-0@lo:400: Request processed in 110us (3874us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945759.075689:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790945759.075747:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007d9a73a0 x1877942638481280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945759.075763:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007d9a73a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877942638481280:0@lo:400: 00000100:00100000:1.0:1790945759.076939:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000004c840339 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+12:3647:x1877942638481152:12345-0@lo:400: Request processed in 4920us (5302us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945759.076952:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790945759.078847:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e5de1b1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638481152:0@lo:400: 00010000:00010000:2.0:1790945759.711439:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945760.741798:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945761.761800:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790945761.968755:0:7450:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790945761.968760:0:7450:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1790945761.968761:0:7450:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1790945761.968890:0:7450:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000dd2f6be8 00000020:01000004:3.0:1790945761.968907:0:7450:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:3.0:1790945761.968917:0:7450:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1790945761.968930:0:7450:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (0000000036a37b93) 00000020:00000080:3.0:1790945761.968943:0:7450:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1790945762.048766:0:7450:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:3.0:1790945762.048845:0:7450:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:3.0:1790945762.097248:0:7450:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1790945762.100431:0:7450:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1790945762.100448:0:7450:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790945762.100460:0:7450:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd9f4181e0d27cd32 00000020:01000004:3.0:1790945762.100468:0:7450:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1790945762.100490:0:7450:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.120@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1790945762.100494:0:7450:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1790945762.100500:0:7450:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1790945762.100548:0:7450:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1790945762.100553:0:7450:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.120@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1790945762.136518:0:7450:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.120@tcp ctxt 0 is initialized 00000020:01000004:1.0:1790945762.138562:0:7450:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.120@tcp, index=0001, flags=0x20061 00000020:01000004:1.0:1790945762.138570:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1790945762.138572:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1790945762.138573:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790945762.138574:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790945762.138575:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790945762.138576:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790945762.138577:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790945762.138579:0:7450:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790945762.138580:0:7450:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790945762.138582:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790945762.138583:0:7450:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790945762.138587:0:7450:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:1.0:1790945762.138589:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790945762.138597:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1790945762.138598:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790945762.138599:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790945762.138599:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790945762.138601:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790945762.138601:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790945762.138602:0:7450:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790945762.138603:0:7450:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790945762.138604:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790945762.138604:0:7450:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790945762.138643:0:7450:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1790945762.138663:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000583535a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:7450:1877942638481408:0@lo:253: 00000100:00100000:1.0:1790945762.138763:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945762.138819:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 0000000010b958f3 going to sleep for 11 seconds 00000100:00100000:0.0:1790945762.139231:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638481408 00000100:00100000:0.0:1790945762.139241:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638481408 00000100:00100000:0.0:1790945762.139319:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790945762.139328:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000d2aff504 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+12:7450:x1877942638481408:12345-0@lo:253: 20000000:01000000:0.0:1790945762.139361:0:6514:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1790945762.139366:0:6514:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:0.0:1790945762.139371:0:6514:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:0.0:1790945762.139375:0:6514:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:0.0:1790945762.139422:0:6514:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:0.0:1790945762.139731:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790945762.139879:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1790945762.139899:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1790945762.139918:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1790945762.139937:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1790945762.139952:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1790945762.140009:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:0.0:1790945762.140018:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:0.0:1790945762.140030:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:0.0:1790945762.140035:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:0.0:1790945762.140047:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:0.0:1790945762.140052:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:0.0:1790945762.140064:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1790945762.140075:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1790945762.140164:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:0.0:1790945762.140224:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.120@tcp (null) (null) (null) 00000040:00080000:0.0:1790945762.140241:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:0.0:1790945762.140248:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1790945762.140261:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:0.0:1790945762.140277:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.204.120@tcp (null) (null) 00000040:00080000:0.0:1790945762.140292:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:0.0:1790945762.140297:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1790945762.140324:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1790945762.140343:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1790945762.140354:0:6514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1790945762.140434:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:0.0:1790945762.140444:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:0.0:1790945762.140457:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1790945762.140471:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1790945762.140488:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:0.0:1790945762.140494:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:0.0:1790945762.140505:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1790945762.140526:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1790945762.140543:0:6514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:0.0:1790945762.140565:0:6514:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1790945762.140572:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:2.0:1790945762.148418:0:7456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1790945762.148822:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1790945762.148850:0:6514:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.120@tcp for mdt 20000000:01000000:0.0:1790945762.148853:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.120@tcp (null) (null) (null) 00000040:00080000:0.0:1790945762.148869:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1790945762.148874:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1790945762.148887:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1790945762.148892:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.204.120@tcp (null) (null) 00000040:00080000:0.0:1790945762.148907:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1790945762.148915:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:0.0:1790945762.148928:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:0.0:1790945762.148944:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:0.0:1790945762.148999:0:6514:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:0.0:1790945762.149009:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:2.0:1790945762.150666:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:0.0:1790945762.150949:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1790945762.150982:0:6514:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.204.120@tcp for mdt 20000000:01000000:0.0:1790945762.150985:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.120@tcp (null) (null) (null) 00000040:00080000:0.0:1790945762.151001:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1790945762.151008:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1790945762.151022:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1790945762.151028:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.204.120@tcp (null) (null) 00000040:00080000:0.0:1790945762.151039:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1790945762.151046:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:0.0:1790945762.151056:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1790945762.151068:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:0.0:1790945762.151088:0:6514:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1790945762.151090:0:6514:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1790945762.151094:0:6514:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1790945762.151156:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1790945762.151158:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1790945762.153987:0:7458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1790945762.154034:0:7458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1790945762.154050:0:7458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1790945762.154366:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1790945762.154391:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1790945762.154421:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1790945762.154435:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1790945762.154438:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1790945762.154967:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1790945762.154991:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1790945762.155004:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1790945762.155160:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:0.0:1790945762.155219:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:0.0:1790945762.155253:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:0.0:1790945762.155268:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1790945762.155271:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1790945762.157314:0:7460:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1790945762.157457:0:7460:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1790945762.157477:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1790945762.160837:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1790945762.160872:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1790945762.160886:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1790945762.160899:0:6514:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1790945762.160901:0:6514:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1790945762.160920:0:6514:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1790945762.160926:0:6514:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1790945762.161591:0:7461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:1.0:1790945762.161740:0:6514:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:1.0:1790945762.180517:0:6514:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1790945762.180558:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000005e23926f/0xd9f4181e0d27cd39 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945762.180579:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f89886d8/0xd9f4181e0d27cc6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27cc67 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945762.180587:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000321f0f41/0xd9f4181e0d27cc8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27cc83 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945762.180593:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000023ee331e/0xd9f4181e0d27ccfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ccf3 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945762.180599:0:6514:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000005e23926f/0xd9f4181e0d27cd39 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945762.181259:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000023ee331e/0xd9f4181e0d27ccfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27ccf3 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945762.181297:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000023ee331e/0xd9f4181e0d27ccfa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27ccf3 expref: 12 pid: 6515 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945762.181312:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000059e2613f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1877942638481536:0@lo:104: 00000100:00100000:1.0:1790945762.181379:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790945762.181448:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000321f0f41/0xd9f4181e0d27cc8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27cc83 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945762.181456:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000321f0f41/0xd9f4181e0d27cc8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27cc83 expref: 12 pid: 6515 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945762.181464:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000058fa5805 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1877942638481664:0@lo:104: 00000100:00100000:1.0:1790945762.181485:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790945762.181763:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f89886d8/0xd9f4181e0d27cc6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27cc67 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945762.181771:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f89886d8/0xd9f4181e0d27cc6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27cc67 expref: 12 pid: 6514 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945762.181780:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000036ab77cb pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1877942638481792:0@lo:104: 00000100:00100000:1.0:1790945762.181802:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945762.184904:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set 00000000abe2eed1 going to sleep for 11 seconds 00000100:00100000:2.0:1790945762.184968:0:6505:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638481536 00000100:00100000:2.0:1790945762.184978:0:6505:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638481536 00000100:00100000:2.0:1790945762.185044:0:6505:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638481664 00000100:00100000:2.0:1790945762.185048:0:6505:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638481664 00000100:00100000:2.0:1790945762.185058:0:6505:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638481792 00000100:00100000:2.0:1790945762.185061:0:6505:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638481792 00000100:00100000:2.0:1790945762.185076:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790945762.185083:0:6505:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000e24bc74c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+5:6514:x1877942638481536:12345-0@lo:104: 00010000:00010000:2.0:1790945762.185097:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: 0000000033ec8847/0xd9f4181e0d27ccf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27ccfa expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.185313:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790945762.185319:0:6505:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000e24bc74c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+5:6514:x1877942638481536:12345-0@lo:104: Request processed in 237us (3941us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945762.185328:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790945762.185346:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790945762.185352:0:6505:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c737838f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+4:6514:x1877942638481664:12345-0@lo:104: 00010000:00010000:2.0:1790945762.185360:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: 00000000541844e0/0xd9f4181e0d27cc83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27cc8a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.185394:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790945762.185398:0:6505:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c737838f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+4:6514:x1877942638481664:12345-0@lo:104: Request processed in 48us (3914us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945762.185404:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790945762.185416:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790945762.185421:0:6505:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000008ad2c539 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+3:6514:x1877942638481792:12345-0@lo:104: 00010000:00010000:2.0:1790945762.185428:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: 00000000b1724efa/0xd9f4181e0d27cc67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27cc6e expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.185453:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1790945762.185464:0:6505:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000008ad2c539 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+3:6514:x1877942638481792:12345-0@lo:104: Request processed in 44us (3662us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945762.185469:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1790945762.185487:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790945762.185493:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: 0000000033ec8847/0xd9f4181e0d27ccf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27ccfa expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.185570:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000033ec8847 already unused, calling callback (00000000744480de) 10000000:00010000:2.0:1790945762.185576:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: 0000000033ec8847/0xd9f4181e0d27ccf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27ccfa expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.185586:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: 0000000033ec8847/0xd9f4181e0d27ccf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27ccfa expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790945762.185592:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: 0000000033ec8847/0xd9f4181e0d27ccf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27ccfa expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945762.185597:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790945762.185760:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: 0000000033ec8847/0xd9f4181e0d27ccf3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ccfa expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.185767:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790945762.185789:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: 0000000033ec8847/0xd9f4181e0d27ccf3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ccfa expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.185795:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: 0000000033ec8847/0xd9f4181e0d27ccf3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ccfa expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.185806:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790945762.185808:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: 00000000541844e0/0xd9f4181e0d27cc83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27cc8a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.185824:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000541844e0 already unused, calling callback (00000000744480de) 10000000:00010000:2.0:1790945762.185826:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: 00000000541844e0/0xd9f4181e0d27cc83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27cc8a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.185832:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: 00000000541844e0/0xd9f4181e0d27cc83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27cc8a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790945762.185837:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: 00000000541844e0/0xd9f4181e0d27cc83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27cc8a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945762.185841:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790945762.185853:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: 00000000541844e0/0xd9f4181e0d27cc83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cc8a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.185859:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790945762.185863:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: 00000000541844e0/0xd9f4181e0d27cc83 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cc8a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.185869:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: 00000000541844e0/0xd9f4181e0d27cc83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cc8a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.185878:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790945762.185880:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: 00000000b1724efa/0xd9f4181e0d27cc67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27cc6e expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.185885:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b1724efa already unused, calling callback (00000000744480de) 10000000:00010000:2.0:1790945762.185888:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: 00000000b1724efa/0xd9f4181e0d27cc67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27cc6e expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.185903:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: 00000000b1724efa/0xd9f4181e0d27cc67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27cc6e expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790945762.185908:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: 00000000b1724efa/0xd9f4181e0d27cc67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27cc6e expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945762.185913:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790945762.185925:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: 00000000b1724efa/0xd9f4181e0d27cc67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cc6e expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.185930:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790945762.185943:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: 00000000b1724efa/0xd9f4181e0d27cc67 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cc6e expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.185949:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: 00000000b1724efa/0xd9f4181e0d27cc67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cc6e expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.185964:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945762.185965:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945762.185966:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945762.185991:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000646bed3b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638481920:0@lo:103: 00000100:00100000:2.0:1790945762.186041:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945762.186082:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790945762.186088:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d645e3e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638482048:0@lo:103: 00000100:00100000:2.0:1790945762.186109:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945762.186139:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d6ed8592 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638482176:0@lo:103: 00000100:00100000:2.0:1790945762.186161:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790945762.186256:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945762.186303:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638481920 00000100:00100000:2.0:1790945762.186317:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638481920 00010000:00010000:2.0:1790945762.186344:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000023ee331e/0xd9f4181e0d27ccfa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27ccf3 expref: 13 pid: 6515 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945762.186361:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638482048 00000100:00100000:2.0:1790945762.186364:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638482048 00010000:00010000:2.0:1790945762.186373:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000321f0f41/0xd9f4181e0d27cc8a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27cc83 expref: 14 pid: 6515 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945762.186383:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638482176 00000100:00100000:2.0:1790945762.186385:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638482176 00010000:00010000:2.0:1790945762.186397:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f89886d8/0xd9f4181e0d27cc6e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27cc67 expref: 15 pid: 6514 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945762.186409:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790945762.186416:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000356744b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:3649:x1877942638481920:12345-0@lo:103: 00010000:00010000:2.0:1790945762.186429:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945762.186435:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: 0000000023ee331e/0xd9f4181e0d27ccfa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27ccf3 expref: 15 pid: 6515 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.186444:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000023ee331e/0xd9f4181e0d27ccfa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27ccf3 expref: 15 pid: 6515 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.186462:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945762.186793:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000356744b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:3649:x1877942638481920:12345-0@lo:103: Request processed in 377us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945762.186801:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790945762.186819:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790945762.186825:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000da35019a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+14:3649:x1877942638482048:12345-0@lo:103: 00000100:00100000:0.0:1790945762.186830:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000646bed3b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638481920:0@lo:103: 00010000:00010000:2.0:1790945762.186832:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945762.186841:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: 00000000321f0f41/0xd9f4181e0d27cc8a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27cc83 expref: 14 pid: 6515 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.186849:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000321f0f41/0xd9f4181e0d27cc8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27cc83 expref: 14 pid: 6515 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.186859:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945762.186897:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000da35019a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+14:3649:x1877942638482048:12345-0@lo:103: Request processed in 74us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945762.186905:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790945762.186919:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790945762.186926:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000014cff365 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+13:3647:x1877942638482176:12345-0@lo:103: 00010000:00010000:2.0:1790945762.186933:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945762.186938:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: 00000000f89886d8/0xd9f4181e0d27cc6e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27cc67 expref: 13 pid: 6514 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.186946:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f89886d8/0xd9f4181e0d27cc6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27cc67 expref: 13 pid: 6514 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.186958:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000005e23926f/0xd9f4181e0d27cd39 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.186967:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005e23926f/0xd9f4181e0d27cd39 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.186982:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005e23926f/0xd9f4181e0d27cd39 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.186988:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005e23926f/0xd9f4181e0d27cd39 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.186993:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000005e23926f/0xd9f4181e0d27cd39 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.187004:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000005e23926f/0xd9f4181e0d27cd39 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.187010:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005e23926f already unused, calling callback (00000000b60b8e97) 00010000:00010000:2.0:1790945762.187013:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000005e23926f/0xd9f4181e0d27cd39 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.187021:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000005e23926f/0xd9f4181e0d27cd39 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.187028:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000005e23926f/0xd9f4181e0d27cd39 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.187037:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945762.187051:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d645e3e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638482048:0@lo:103: 00000100:00100000:2.0:1790945762.187079:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000014cff365 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+13:3647:x1877942638482176:12345-0@lo:103: Request processed in 154us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945762.187085:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790945762.187154:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d6ed8592 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638482176:0@lo:103: 00010000:00010000:1.0:1790945762.187470:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000023ee331e/0xd9f4181e0d27ccfa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27ccf3 expref: 12 pid: 6515 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945762.187483:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000059e2613f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1877942638481536:0@lo:104: 00010000:00010000:1.0:1790945762.187493:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000321f0f41/0xd9f4181e0d27cc8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27cc83 expref: 11 pid: 6515 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945762.187574:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000058fa5805 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1877942638481664:0@lo:104: 00010000:00010000:1.0:1790945762.187586:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f89886d8/0xd9f4181e0d27cc6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27cc67 expref: 10 pid: 6514 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945762.187593:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000036ab77cb pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1877942638481792:0@lo:104: 00010000:00010000:1.0:1790945762.187621:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000005e23926f/0xd9f4181e0d27cd39 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945762.187630:0:6514:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000005e23926f/0xd9f4181e0d27cd39 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945762.187635:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000005e23926f/0xd9f4181e0d27cd39 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945762.187640:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005e23926f/0xd9f4181e0d27cd39 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790945762.187660:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1790945762.193032:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000d2aff504 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+9:7450:x1877942638481408:12345-0@lo:253: Request processed in 53696us (54260us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945762.193061:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790945762.193499:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000583535a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:7450:1877942638481408:0@lo:253: 10000000:01000000:3.0:1790945762.193516:0:7450:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1790945762.193519:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790945762.193521:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1790945762.193522:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790945762.193523:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:3.0:1790945762.193525:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790945762.193526:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790945762.193527:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790945762.193528:0:7450:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1790945762.193540:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790945762.193541:0:7450:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790945762.193562:0:7450:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000dd2f6be8 from lustre-MDT0001 10000000:01000000:3.0:1790945762.193685:0:7450:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1790945762.193689:0:7450:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1790945762.193696:0:7450:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d40af68cd40 local copy 10000000:01000000:3.0:1790945762.193700:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790945762.193735:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: 00000000b3cf7344/0xd9f4181e0d27cd40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945762.193745:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.120@tcp lock: 00000000b3cf7344/0xd9f4181e0d27cd40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945762.193753:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: 00000000b3cf7344/0xd9f4181e0d27cd40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945762.193778:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007d9a73a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:7450:1877942638482304:0@lo:101: 00000100:00100000:3.0:1790945762.193817:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945762.193959:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ee41fa0d going to sleep for 11 seconds 00000100:00100000:0.0:1790945762.194008:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638482304 00000100:00100000:0.0:1790945762.194017:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638482304 00000100:00100000:0.0:1790945762.194460:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790945762.194470:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000006c7fc6f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+9:7450:x1877942638482304:12345-0@lo:101: 00010000:00010000:0.0:1790945762.194486:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945762.194501:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b5d01de2/0xd9f4181e0d27cd47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27cd40 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945762.194526:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b5d01de2/0xd9f4181e0d27cd47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27cd40 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945762.194546:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b5d01de2/0xd9f4181e0d27cd47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27cd40 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945762.194555:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b5d01de2, rc 0) 00000100:00100000:0.0:1790945762.194728:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000006c7fc6f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+10:7450:x1877942638482304:12345-0@lo:101: Request processed in 261us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945762.194735:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790945762.194800:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007d9a73a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:7450:1877942638482304:0@lo:101: 00010000:00010000:3.0:1790945762.194815:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: 00000000b3cf7344/0xd9f4181e0d27cd40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd9f4181e0d27cd47 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945762.194824:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: 00000000b3cf7344/0xd9f4181e0d27cd40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd9f4181e0d27cd47 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945762.194926:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007d9a73a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:7450:1877942638482432:0@lo:501: 00000100:00100000:3.0:1790945762.194956:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945762.195053:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ee41fa0d going to sleep for 11 seconds 00000100:00100000:1.0:1790945762.195157:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638482432 00000100:00100000:1.0:1790945762.195163:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638482432 00000100:00100000:0.0:1790945762.198813:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790945762.198825:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000b77c71b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+10:7450:x1877942638482432:12345-0@lo:501: 00000100:00100000:0.0:1790945762.199016:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000b77c71b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+10:7450:x1877942638482432:12345-0@lo:501: Request processed in 192us (4059us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790945762.199049:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790945762.199455:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007d9a73a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:7450:1877942638482432:0@lo:501: 10000000:01000000:3.0:1790945762.199482:0:7450:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1790945762.199656:0:7450:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1790945762.199664:0:7450:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: 00000000b3cf7344/0xd9f4181e0d27cd40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd9f4181e0d27cd47 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945762.199673:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: 00000000b3cf7344/0xd9f4181e0d27cd40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd9f4181e0d27cd47 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945762.199680:0:7450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: 00000000b3cf7344/0xd9f4181e0d27cd40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd9f4181e0d27cd47 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945762.199704:0:7450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790945762.199775:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790945762.199793:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: 00000000b3cf7344/0xd9f4181e0d27cd40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xd9f4181e0d27cd47 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.199800:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b3cf7344 already unused, calling callback (00000000744480de) 10000000:00010000:2.0:1790945762.199803:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: 00000000b3cf7344/0xd9f4181e0d27cd40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xd9f4181e0d27cd47 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.199811:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: 00000000b3cf7344/0xd9f4181e0d27cd40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xd9f4181e0d27cd47 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790945762.199818:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: 00000000b3cf7344/0xd9f4181e0d27cd40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xd9f4181e0d27cd47 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790945762.199828:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d40bacd0800 10000000:01000000:2.0:1790945762.199830:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790945762.199833:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790945762.199837:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9d40af68cd40 10000000:01000000:3.0:1790945762.199839:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1790945762.199841:0:7450:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9d40af68cd40 from 1 10000000:01000000:3.0:1790945762.199844:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1790945762.199857:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: 00000000b3cf7344/0xd9f4181e0d27cd40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xd9f4181e0d27cd47 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.199863:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790945762.199869:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: 0000000028a4153d/0xd9f4181e0d27cd4e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945762.199875:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: 0000000028a4153d/0xd9f4181e0d27cd4e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945762.199882:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: 0000000028a4153d/0xd9f4181e0d27cd4e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.199894:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: 00000000b3cf7344/0xd9f4181e0d27cd40 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xd9f4181e0d27cd47 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945762.199897:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007d9a73a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:7450:1877942638482688:0@lo:101: 00010000:00010000:2.0:1790945762.199901:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: 00000000b3cf7344/0xd9f4181e0d27cd40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xd9f4181e0d27cd47 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.199917:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945762.199918:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945762.199919:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945762.199934:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945762.200001:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790945762.200013:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000367e5d91 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638482560:0@lo:103: 00000100:00100000:1.0:1790945762.200060:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945762.200400:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000947c908d going to sleep for 11 seconds 00000100:00100000:2.0:1790945762.200729:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638482688 00000100:00100000:2.0:1790945762.200738:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638482688 00000100:00100000:2.0:1790945762.200785:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790945762.200792:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000ba5e8e95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+10:7450:x1877942638482688:12345-0@lo:101: 00010000:00010000:2.0:1790945762.200804:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945762.200819:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000033ec8847/0xd9f4181e0d27cd55 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27cd4e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.200839:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000033ec8847/0xd9f4181e0d27cd55 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27cd4e expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.200849:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000033ec8847/0xd9f4181e0d27cd55 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27cd4e expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.200857:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000033ec8847, rc 0) 00000100:00100000:2.0:1790945762.200916:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000ba5e8e95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+11:7450:x1877942638482688:12345-0@lo:101: Request processed in 124us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945762.200922:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790945762.200956:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638482560 00000100:00100000:2.0:1790945762.200962:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638482560 00000100:00100000:2.0:1790945762.200988:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790945762.200993:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000036ab77cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+11:3647:x1877942638482560:12345-0@lo:103: 00010000:00010000:2.0:1790945762.201001:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945762.201012:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b5d01de2/0xd9f4181e0d27cd47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd9f4181e0d27cd40 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.201023:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945762.201064:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000036ab77cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+10:3647:x1877942638482560:12345-0@lo:103: Request processed in 71us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945762.201071:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790945762.201102:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000367e5d91 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638482560:0@lo:103: 00000100:00100000:1.0:1790945762.201201:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007d9a73a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:7450:1877942638482688:0@lo:101: 00010000:00010000:1.0:1790945762.201214:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: 0000000028a4153d/0xd9f4181e0d27cd4e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cd55 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945762.201231:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: 0000000028a4153d/0xd9f4181e0d27cd4e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27cd55 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945762.201248:0:7450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1790945762.201259:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: 0000000028a4153d/0xd9f4181e0d27cd4e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cd55 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945762.201266:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: 0000000028a4153d/0xd9f4181e0d27cd4e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cd55 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945762.201274:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9d40bacd0800 10000000:01000000:1.0:1790945762.201279:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1790945762.201283:0:7450:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9d40bacd0800 from 1 10000000:01000000:1.0:1790945762.201285:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1790945762.201302:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: 000000005e23926f/0xd9f4181e0d27cd5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945762.201308:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: 000000005e23926f/0xd9f4181e0d27cd5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945762.201315:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: 000000005e23926f/0xd9f4181e0d27cd5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945762.201328:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000058fa5805 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:7450:1877942638482816:0@lo:101: 00000100:00100000:1.0:1790945762.201355:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945762.201369:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 0000000038177a13 going to sleep for 11 seconds 00000100:00100000:0.0:1790945762.201682:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638482816 00000100:00100000:0.0:1790945762.201689:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638482816 00000100:00100000:0.0:1790945762.201728:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790945762.201735:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000076209ede pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+10:7450:x1877942638482816:12345-0@lo:101: 00010000:00010000:0.0:1790945762.201744:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945762.201754:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001f8140ef/0xd9f4181e0d27cd63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27cd5c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945762.201769:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001f8140ef/0xd9f4181e0d27cd63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27cd5c expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945762.201777:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001f8140ef/0xd9f4181e0d27cd63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27cd5c expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945762.201783:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001f8140ef, rc 0) 00000100:00100000:0.0:1790945762.201814:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000076209ede pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+11:7450:x1877942638482816:12345-0@lo:101: Request processed in 80us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945762.201820:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790945762.201930:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000058fa5805 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:7450:1877942638482816:0@lo:101: 00010000:00010000:1.0:1790945762.201943:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: 000000005e23926f/0xd9f4181e0d27cd5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cd63 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945762.201958:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: 000000005e23926f/0xd9f4181e0d27cd5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27cd63 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945762.201971:0:7450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1790945762.201986:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: 000000005e23926f/0xd9f4181e0d27cd5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cd63 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945762.201992:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: 000000005e23926f/0xd9f4181e0d27cd5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cd63 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945762.201997:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1790945762.202000:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790945762.202004:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9d40bacd0800 10000000:01000000:1.0:1790945762.202006:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1790945762.202009:0:7450:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1790945762.202011:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1790945762.202024:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: 00000000446ab762/0xd9f4181e0d27cd6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945762.202029:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: 00000000446ab762/0xd9f4181e0d27cd6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945762.202046:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: 00000000446ab762/0xd9f4181e0d27cd6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945762.202058:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000058fa5805 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:7450:1877942638482944:0@lo:101: 00000100:00100000:1.0:1790945762.202085:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945762.202111:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 0000000038177a13 going to sleep for 11 seconds 00000100:00100000:0.0:1790945762.202197:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638482944 00000100:00100000:0.0:1790945762.202202:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638482944 00000100:00100000:0.0:1790945762.202233:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790945762.202239:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000001142a3eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+11:7450:x1877942638482944:12345-0@lo:101: 00010000:00010000:0.0:1790945762.202246:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945762.202254:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000011aa29a/0xd9f4181e0d27cd71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27cd6a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945762.202266:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000011aa29a/0xd9f4181e0d27cd71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27cd6a expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945762.202280:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000011aa29a/0xd9f4181e0d27cd71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27cd6a expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945762.202287:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000011aa29a, rc 0) 00000100:00100000:0.0:1790945762.202314:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000001142a3eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+12:7450:x1877942638482944:12345-0@lo:101: Request processed in 76us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945762.202321:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790945762.202811:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000058fa5805 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:7450:1877942638482944:0@lo:101: 00010000:00010000:1.0:1790945762.202825:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: 00000000446ab762/0xd9f4181e0d27cd6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cd71 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945762.202831:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: 00000000446ab762/0xd9f4181e0d27cd6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27cd71 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945762.202936:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000058fa5805 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:7450:1877942638483072:0@lo:501: 00000100:00100000:1.0:1790945762.202965:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945762.202995:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 0000000038177a13 going to sleep for 11 seconds 00000100:00100000:1.0:1790945762.203013:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638483072 00000100:00100000:1.0:1790945762.203017:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638483072 00000100:00100000:1.0:1790945762.203055:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790945762.203063:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000086c2a3d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+12:7450:x1877942638483072:12345-0@lo:501: 00000100:00100000:1.0:1790945762.203362:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000086c2a3d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+12:7450:x1877942638483072:12345-0@lo:501: Request processed in 300us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945762.203370:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790945762.203405:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000058fa5805 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:7450:1877942638483072:0@lo:501: 00000100:00100000:1.0:1790945762.203431:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000058fa5805 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:7450:1877942638483200:0@lo:503: 00000100:00100000:1.0:1790945762.203477:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945762.203502:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 0000000038177a13 going to sleep for 11 seconds 00000100:00100000:2.0:1790945762.203562:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638483200 00000100:00100000:2.0:1790945762.203568:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638483200 00000100:00100000:2.0:1790945762.203612:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790945762.203619:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000434ac374 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+12:7450:x1877942638483200:12345-0@lo:503: 00000100:00100000:2.0:1790945762.203702:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000434ac374 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+12:7450:x1877942638483200:12345-0@lo:503: Request processed in 85us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945762.203710:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790945762.203901:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000058fa5805 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:7450:1877942638483200:0@lo:503: 00000040:00080000:1.0:1790945762.204146:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790945762.204260:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000058fa5805 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:7450:1877942638483328:0@lo:502: 00000100:00100000:1.0:1790945762.204297:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945762.204328:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 0000000038177a13 going to sleep for 11 seconds 00000100:00100000:1.0:1790945762.204350:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638483328 00000100:00100000:1.0:1790945762.204354:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638483328 00000100:00100000:1.0:1790945762.204386:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790945762.204392:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000e1ca90e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+12:7450:x1877942638483328:12345-0@lo:502: 00000100:00100000:1.0:1790945762.204478:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000e1ca90e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+12:7450:x1877942638483328:12345-0@lo:502: Request processed in 87us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945762.204485:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790945762.204522:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000058fa5805 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:7450:1877942638483328:0@lo:502: 00000040:00080000:1.0:1790945762.205159:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1790945762.205573:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:0.0:1790945762.205674:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:0.0:1790945762.205691:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:0.0:1790945762.205706:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:0.0:1790945762.205720:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:0.0:1790945762.205733:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:0.0:1790945762.205745:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:0.0:1790945762.205758:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:0.0:1790945762.205907:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:0.0:1790945762.205931:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:0.0:1790945762.205946:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:0.0:1790945762.205959:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:0.0:1790945762.205972:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:0.0:1790945762.205985:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:0.0:1790945762.205999:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:0.0:1790945762.206013:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:0.0:1790945762.206027:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:0.0:1790945762.206118:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:0.0:1790945762.206138:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:0.0:1790945762.206336:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:0.0:1790945762.206360:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:0.0:1790945762.206373:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:0.0:1790945762.206409:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006aa2fd83 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:7450:1877942638483456:0@lo:502: 00000100:00100000:0.0:1790945762.206479:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945762.206566:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000005be5dc2c going to sleep for 11 seconds 00000100:00100000:1.0:1790945762.206677:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638483456 00000100:00100000:1.0:1790945762.206687:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638483456 00000100:00100000:1.0:1790945762.206768:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790945762.206776:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000b880986b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+12:7450:x1877942638483456:12345-0@lo:502: 00000100:00100000:1.0:1790945762.206890:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000b880986b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+12:7450:x1877942638483456:12345-0@lo:502: Request processed in 115us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945762.206898:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790945762.206977:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006aa2fd83 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:7450:1877942638483456:0@lo:502: 00000040:00080000:2.0:1790945762.207033:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:2.0:1790945762.207057:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:2.0:1790945762.207543:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790945762.207560:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945762.207562:0:7462:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1790945762.207568:0:7462:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1790945762.207571:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790945762.207596:0:7462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (000000005026562e) 00000020:00000080:2.0:1790945762.207618:0:7462:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:2.0:1790945762.207624:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1790945762.207707:0:7462:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790945762.207714:0:7462:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd9f4181e0d27cd7f 00000020:00000080:2.0:1790945762.207952:0:7462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1790945762.207957:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790945762.207960:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945762.207962:0:7462:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1790945762.207964:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790945762.207968:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945762.207969:0:7462:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1790945762.207972:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790945762.207979:0:7462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000b6d21ef7) 00000020:00000080:2.0:1790945762.207989:0:7462:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:2.0:1790945762.207993:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1790945762.207994:0:7462:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1790945762.207997:0:7462:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1790945762.208004:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790945762.208043:0:7462:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000dd2f6be8 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1790945762.208054:0:7462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (000000007308d014) 00000020:00000080:2.0:1790945762.208061:0:7462:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:2.0:1790945762.208118:0:7462:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1790945762.208124:0:7462:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd9f4181e0d27cd94 00000020:00000080:2.0:1790945762.208251:0:7462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1790945762.208258:0:7462:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1790945762.208263:0:7462:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xd9f4181e0d27cd9b 00080000:01000000:2.0:1790945762.208269:0:7462:0:(osd_handler.c:8931:osd_obd_connect()) connect #2 00000020:00000080:2.0:1790945762.208272:0:7462:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd9f4181e0d27cda2 00080000:10000000:2.0:1790945762.208712:0:7462:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1790945762.208851:0:7462:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:3.0:1790945762.376589:0:7462:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:3.0:1790945762.376823:0:7462:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:3.0:1790945762.386288:0:7462:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1790945762.387754:0:7462:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1790945762.406929:0:7462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1790945762.406945:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790945762.406951:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945762.406954:0:7462:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1790945762.406957:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790945762.406964:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945762.406966:0:7462:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1790945762.406969:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790945762.406974:0:7462:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.120@tcp to nid 0x20000c0a8cc78 (192.168.204.120@tcp) 00000020:00000080:2.0:1790945762.407001:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790945762.407025:0:7462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000083792b3) 00000020:00000080:2.0:1790945762.407048:0:7462:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1790945762.407055:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790945762.407123:0:7462:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1790945762.407129:0:7462:0:(osd_handler.c:8931:osd_obd_connect()) connect #3 00000020:00000080:2.0:1790945762.407136:0:7462:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd9f4181e0d27cdb0 00010000:00080000:2.0:1790945762.407204:0:7462:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c62826fe@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.120@tcp at head 00010000:00010000:2.0:1790945762.410099:0:7462:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:2.0:1790945762.411387:0:7462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1790945762.411402:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1790945762.411437:0:7462:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1790945762.411458:0:7462:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd9f4181e0d27cdb7 00000100:00080000:2.0:1790945762.411468:0:7462:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790945762.411479:0:7462:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000c62826fe using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1790945762.411515:0:7462:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000367e5d91 x1877942638483584/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790945762.411582:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000367e5d91 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638483584:0@lo:38: 00000100:00100000:3.0:1790945762.411726:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945762.411888:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638483584 00000100:00100000:1.0:1790945762.411897:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638483584 00000100:00100000:1.0:1790945762.411929:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790945762.411935:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000045f89240 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1877942638483584:12345-0@lo:38: 00010000:00080000:1.0:1790945762.411962:0:6526:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:1.0:1790945762.411992:0:6526:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd9f4181e0d27cdbe 00000004:00100000:1.0:1790945762.412006:0:6526:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1790945762.412011:0:6526:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1790945762.412104:0:7462:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1790945762.412209:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000049b0ce21 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877942638483712:0@lo:400: 00000100:00100000:2.0:1790945762.412243:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945762.412305:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638483712 00000100:00100000:2.0:1790945762.412310:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638483712 00000100:00100000:2.0:1790945762.412341:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790945762.412346:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000003a2f1037 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877942638483712:12345-0@lo:400: 00000100:00100000:2.0:1790945762.412392:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000003a2f1037 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877942638483712:12345-0@lo:400: Request processed in 47us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945762.412399:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1790945762.412524:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000049b0ce21 x1877942638483712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945762.412546:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000049b0ce21 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877942638483712:0@lo:400: 00000020:01000000:2.0:1790945762.412622:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790945762.412627:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945762.412629:0:7462:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1790945762.412631:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790945762.412633:0:7462:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1790945762.412635:0:7462:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790945762.412636:0:7462:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790945762.412637:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790945762.412639:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945762.412640:0:7462:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790945762.412642:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790945762.412646:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945762.412647:0:7462:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1790945762.412651:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1790945762.412688:0:7462:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1790945762.412700:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790945762.412703:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945762.412704:0:7462:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1790945762.412706:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790945762.412709:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945762.412710:0:7462:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790945762.412721:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790945762.412723:0:7462:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790945762.412885:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790945762.412890:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945762.412892:0:7462:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1790945762.412895:0:7462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:2.0:1790945762.413305:0:7450:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:2.0:1790945762.413340:0:7450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1790945762.413356:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: 00000000446ab762/0xd9f4181e0d27cd6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cd71 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.413368:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: 00000000446ab762/0xd9f4181e0d27cd6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cd71 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945762.413377:0:7450:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d40bacd0800 from 1 10000000:01000000:2.0:1790945762.413381:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790945762.413409:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: 00000000d6311fca/0xd9f4181e0d27cdc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.413416:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: 00000000d6311fca/0xd9f4181e0d27cdc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.413425:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: 00000000d6311fca/0xd9f4181e0d27cdc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945762.413440:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000049b0ce21 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:7450:1877942638483840:0@lo:101: 00000100:00100000:2.0:1790945762.413482:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945762.413503:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f93e1e67 going to sleep for 11 seconds 00000100:00100000:2.0:1790945762.413543:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638483840 00000100:00100000:2.0:1790945762.413549:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638483840 00000100:00100000:2.0:1790945762.413690:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790945762.413711:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000007167ca08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+12:7450:x1877942638483840:12345-0@lo:101: 00010000:00010000:2.0:1790945762.413722:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945762.413733:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000262913e3/0xd9f4181e0d27cdcc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27cdc5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.413765:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000262913e3/0xd9f4181e0d27cdcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27cdc5 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.413776:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000262913e3/0xd9f4181e0d27cdcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27cdc5 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.413784:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000262913e3, rc 0) 00000100:00100000:2.0:1790945762.413820:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000007167ca08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+13:7450:x1877942638483840:12345-0@lo:101: Request processed in 112us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945762.413826:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790945762.413994:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000049b0ce21 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:7450:1877942638483840:0@lo:101: 00010000:00010000:3.0:1790945762.414008:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: 00000000d6311fca/0xd9f4181e0d27cdc5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cdcc expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945762.414016:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: 00000000d6311fca/0xd9f4181e0d27cdc5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27cdcc expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945762.414878:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000053ea417b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:7450:1877942638483968:0@lo:256: 00000100:00100000:3.0:1790945762.414930:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945762.415058:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 0000000057aa80d6 going to sleep for 11 seconds 00000100:00100000:1.0:1790945762.415109:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638483968 00000100:00100000:1.0:1790945762.415117:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638483968 00000100:00100000:1.0:1790945762.415146:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790945762.415201:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000d054f46f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+13:7450:x1877942638483968:12345-0@lo:256: 20000000:01000000:1.0:1790945762.415220:0:6515:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1790945762.415236:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1790945762.415239:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1790945762.415327:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000d054f46f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+13:7450:x1877942638483968:12345-0@lo:256: Request processed in 166us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945762.415335:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790945762.415568:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000053ea417b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:7450:1877942638483968:0@lo:256: 00000100:00080000:2.0:1790945762.421032:0:6526:0:(import.c:65:import_set_state_nolock()) 00000000fd11eddf : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790945762.421148:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000045f89240 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1877942638483584:12345-0@lo:38: Request processed in 9210us (9420us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945762.421195:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790945762.421260:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790945762.421270:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1790945762.421278:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1790945762.421283:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790945762.421286:0:3646:0:(import.c:65:import_set_state_nolock()) 00000000c62826fe lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790945762.421300:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000367e5d91 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638483584:0@lo:38: 00000100:00100000:2.0:1790945762.421366:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000367e5d91 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638484096:0@lo:41: 00000100:00100000:2.0:1790945762.421400:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945762.421456:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638484096 00000100:00100000:2.0:1790945762.421463:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638484096 00000100:00100000:2.0:1790945762.421493:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790945762.421500:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000edfaa453 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3650:x1877942638484096:12345-0@lo:41: 10000000:01000000:3.0:1790945762.423241:0:7450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790945762.423266:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: 00000000d6311fca/0xd9f4181e0d27cdc5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cdcc expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945762.423279:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: 00000000d6311fca/0xd9f4181e0d27cdc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cdcc expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790945762.423289:0:7450:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d40bacd0800 from 1 10000000:01000000:3.0:1790945762.423292:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790945762.423328:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: 000000007b91929b/0xd9f4181e0d27cdd3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945762.423336:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: 000000007b91929b/0xd9f4181e0d27cdd3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945762.423344:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: 000000007b91929b/0xd9f4181e0d27cdd3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945762.423364:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000053ea417b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:7450:1877942638484224:0@lo:101: 00000100:00100000:3.0:1790945762.423419:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945762.423443:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 0000000057aa80d6 going to sleep for 11 seconds 00000100:00100000:3.0:1790945762.423479:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638484224 00000100:00100000:3.0:1790945762.423486:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638484224 00000004:00000024:2.0:1790945762.426728:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1790945762.426841:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000edfaa453 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3650:x1877942638484096:12345-0@lo:41: Request processed in 5340us (5439us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945762.426853:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790945762.426916:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000367e5d91 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638484096:0@lo:41: 00000100:00100000:3.0:1790945762.427931:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790945762.427939:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000006081893 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+13:7450:x1877942638484224:12345-0@lo:101: 00010000:00010000:3.0:1790945762.427953:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945762.427969:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007a364e35/0xd9f4181e0d27cdda lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27cdd3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945762.427993:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007a364e35/0xd9f4181e0d27cdda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27cdd3 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945762.428003:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007a364e35/0xd9f4181e0d27cdda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27cdd3 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945762.428012:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007a364e35, rc 0) 00000100:00100000:3.0:1790945762.428059:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000006081893 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+14:7450:x1877942638484224:12345-0@lo:101: Request processed in 121us (4640us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945762.428066:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790945762.428730:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000053ea417b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:7450:1877942638484224:0@lo:101: 00010000:00010000:1.0:1790945762.428762:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: 000000007b91929b/0xd9f4181e0d27cdd3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cdda expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945762.428772:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: 000000007b91929b/0xd9f4181e0d27cdd3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27cdda expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945762.428889:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000058fa5805 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:7450:1877942638484352:0@lo:501: 00000100:00100000:1.0:1790945762.428931:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945762.429891:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000033a0e2c going to sleep for 11 seconds 00000100:00100000:2.0:1790945762.429952:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638484352 00000100:00100000:2.0:1790945762.429961:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638484352 00000100:00100000:2.0:1790945762.429998:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790945762.430006:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000bf5e5464 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+14:7450:x1877942638484352:12345-0@lo:501: 00000100:00100000:2.0:1790945762.430141:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000bf5e5464 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+14:7450:x1877942638484352:12345-0@lo:501: Request processed in 136us (1210us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945762.430149:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790945762.430396:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000058fa5805 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:7450:1877942638484352:0@lo:501: 00000100:00100000:1.0:1790945762.430435:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000058fa5805 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:7450:1877942638484480:0@lo:503: 00000100:00100000:1.0:1790945762.430481:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945762.430510:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000033a0e2c going to sleep for 11 seconds 00000100:00100000:2.0:1790945762.430570:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638484480 00000100:00100000:2.0:1790945762.430575:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638484480 00000100:00100000:2.0:1790945762.430593:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790945762.430598:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000cff8b778 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+14:7450:x1877942638484480:12345-0@lo:503: 00000040:00080000:2.0:1790945762.430737:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790945762.430853:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000cff8b778 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+14:7450:x1877942638484480:12345-0@lo:503: Request processed in 254us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945762.430860:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790945762.430903:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000058fa5805 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:7450:1877942638484480:0@lo:503: 00000040:00080000:2.0:1790945762.431596:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790945762.431718:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:2.0:1790945762.432574:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790945762.435567:0:7467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:2.0:1790945762.436674:0:7450:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1790945762.436713:0:7450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790945762.436733:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: 000000007b91929b/0xd9f4181e0d27cdd3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cdda expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.436826:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: 000000007b91929b/0xd9f4181e0d27cdd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cdda expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945762.436892:0:7450:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790945762.436894:0:7450:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d40bacd0800 10000000:01000000:2.0:1790945762.436897:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d40bacd0800 10000000:01000000:2.0:1790945762.436902:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790945762.436909:0:7450:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d40bacd0800 from 1 10000000:01000000:2.0:1790945762.436911:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790945762.436954:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: 00000000f2ad6a52/0xd9f4181e0d27cde1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.436963:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: 00000000f2ad6a52/0xd9f4181e0d27cde1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945762.436974:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: 00000000f2ad6a52/0xd9f4181e0d27cde1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945762.436999:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000367e5d91 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:7450:1877942638484608:0@lo:101: 00000100:00100000:2.0:1790945762.437071:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945762.437154:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 0000000002d55842 going to sleep for 11 seconds 00000100:00100000:3.0:1790945762.437464:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638484608 00000100:00100000:3.0:1790945762.437472:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638484608 00000100:00100000:3.0:1790945762.437520:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790945762.437537:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000007c0c4acd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+14:7450:x1877942638484608:12345-0@lo:101: 00010000:00010000:3.0:1790945762.437550:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945762.437561:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004d602fbe/0xd9f4181e0d27cde8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27cde1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945762.437585:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004d602fbe/0xd9f4181e0d27cde8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27cde1 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945762.437594:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004d602fbe/0xd9f4181e0d27cde8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27cde1 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945762.437736:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004d602fbe, rc 0) 00000100:00100000:3.0:1790945762.437871:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000007c0c4acd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:7450:x1877942638484608:12345-0@lo:101: Request processed in 344us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945762.437878:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790945762.437962:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000367e5d91 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:7450:1877942638484608:0@lo:101: 00010000:00010000:1.0:1790945762.437978:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: 00000000f2ad6a52/0xd9f4181e0d27cde1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cde8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945762.437986:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: 00000000f2ad6a52/0xd9f4181e0d27cde1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27cde8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945762.438092:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000059e2613f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:7450:1877942638484736:0@lo:501: 00000100:00100000:1.0:1790945762.438124:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945762.438157:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c678581b going to sleep for 11 seconds 00000100:00100000:3.0:1790945762.438316:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638484736 00000100:00100000:3.0:1790945762.438322:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638484736 00000100:00100000:3.0:1790945762.438427:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790945762.438435:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000004ed2f52c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:7450:x1877942638484736:12345-0@lo:501: 00000100:00100000:3.0:1790945762.438550:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000004ed2f52c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:7450:x1877942638484736:12345-0@lo:501: Request processed in 116us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945762.438557:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790945762.438595:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000059e2613f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:7450:1877942638484736:0@lo:501: 00000100:00100000:0.0:1790945762.438625:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cf55a588 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:7450:1877942638484864:0@lo:503: 00000100:00100000:0.0:1790945762.438666:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945762.438692:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000001f8755f4 going to sleep for 11 seconds 00000100:00100000:3.0:1790945762.438697:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638484864 00000100:00100000:3.0:1790945762.438701:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638484864 00000100:00100000:3.0:1790945762.438728:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790945762.438734:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000001921e7c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:7450:x1877942638484864:12345-0@lo:503: 00000100:00100000:3.0:1790945762.439010:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000001921e7c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:7450:x1877942638484864:12345-0@lo:503: Request processed in 276us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945762.439018:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790945762.439326:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cf55a588 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:7450:1877942638484864:0@lo:503: 00000040:00080000:0.0:1790945762.439770:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790945762.439851:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cf55a588 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:7450:1877942638484992:0@lo:502: 00000100:00100000:0.0:1790945762.439897:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945762.439937:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000001f8755f4 going to sleep for 11 seconds 00000100:00100000:1.0:1790945762.439998:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638484992 00000100:00100000:1.0:1790945762.440004:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638484992 00000100:00100000:1.0:1790945762.440046:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790945762.440053:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000095872a4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:7450:x1877942638484992:12345-0@lo:502: 00000100:00100000:1.0:1790945762.440303:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000095872a4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:7450:x1877942638484992:12345-0@lo:502: Request processed in 250us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945762.440311:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790945762.443899:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cf55a588 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:7450:1877942638484992:0@lo:502: 00000040:00080000:0.0:1790945762.444417:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1790945762.444454:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1790945762.444470:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1790945762.444485:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1790945762.444500:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1790945762.444514:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1790945762.444561:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1790945762.444580:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1790945762.444596:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1790945762.444691:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1790945762.444709:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1790945762.444723:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1790945762.444736:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1790945762.445452:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1790945762.445475:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1790945762.445489:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1790945762.445518:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1790945762.445546:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1790945762.445559:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1790945762.445572:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1790945762.445587:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1790945762.451326:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1790945762.452322:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1790945762.452347:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1790945762.452361:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1790945762.452375:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1790945762.452389:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1790945762.452401:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:1.0:1790945762.452449:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e199b721 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:7450:1877942638485120:0@lo:502: 00000100:00100000:1.0:1790945762.452562:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945762.452611:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000033a0e2c going to sleep for 11 seconds 00000100:00100000:3.0:1790945762.452684:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638485120 00000100:00100000:3.0:1790945762.452694:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638485120 00000100:00100000:3.0:1790945762.452752:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790945762.452762:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000fc1d1bad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:7450:x1877942638485120:12345-0@lo:502: 00000100:00100000:3.0:1790945762.452885:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000fc1d1bad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:7450:x1877942638485120:12345-0@lo:502: Request processed in 124us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945762.452892:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790945762.452993:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e199b721 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:7450:1877942638485120:0@lo:502: 00000040:00080000:1.0:1790945762.453039:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1790945762.453047:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1790945762.453726:0:7468:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1790945762.453865:0:7468:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (0000000014a3bb01) 00000020:00000080:0.0:1790945762.453889:0:7468:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1790945762.453985:0:7468:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000dd2f6be8 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1790945762.453989:0:7468:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000dd2f6be8 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1790945762.453991:0:7468:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000dd2f6be8 3 00010000:00080000:0.0:1790945762.454019:0:7468:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ecf4a8f1@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.120@tcp at head 00010000:00010000:1.0:1790945762.458990:0:7468:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:1.0:1790945762.459281:0:7468:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1790945762.459338:0:7468:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790945762.459353:0:7468:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xd9f4181e0d27cdf6 00000100:00080000:1.0:1790945762.459362:0:7468:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790945762.459377:0:7468:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000ecf4a8f1 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1790945762.459411:0:7468:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e199b721 x1877942638485248/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790945762.459438:0:7468:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1790945762.459481:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e199b721 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1877942638485248:0@lo:38: 00000100:00100000:2.0:1790945762.459571:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945762.459696:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638485248 00000100:00100000:1.0:1790945762.459704:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638485248 00000100:00100000:1.0:1790945762.459758:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790945762.459763:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000fe177c27 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1877942638485248:12345-0@lo:38: 00010000:00080000:1.0:1790945762.459785:0:6522:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:1.0:1790945762.459811:0:6522:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xd9f4181e0d27cdfd 00000004:00100000:1.0:1790945762.459826:0:6522:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790945762.459855:0:6522:0:(import.c:65:import_set_state_nolock()) 00000000f0180536 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790945762.459918:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000fe177c27 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1877942638485248:12345-0@lo:38: Request processed in 153us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945762.459925:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1790945762.459956:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e199b721 x1877942638485248/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790945772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945762.459971:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790945762.459978:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1790945762.459984:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1790945762.459988:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790945762.459990:0:3646:0:(import.c:65:import_set_state_nolock()) 00000000ecf4a8f1 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790945762.459995:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e199b721 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1877942638485248:0@lo:38: 00000040:00080000:1.0:1790945762.460000:0:7468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:3.0:1790945762.460037:0:7469:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:1.0:1790945762.460041:0:7450:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1790945762.460066:0:7450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790945762.460080:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: 00000000f2ad6a52/0xd9f4181e0d27cde1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cde8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945762.460088:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: 00000000f2ad6a52/0xd9f4181e0d27cde1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cde8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790945762.460137:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790945762.460140:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1790945762.460142:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790945762.460143:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790945762.460144:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790945762.460149:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790945762.460150:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790945762.460151:0:7450:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790945762.460152:0:7450:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790945762.460154:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790945762.460155:0:7450:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790945762.460158:0:7450:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:1.0:1790945762.460160:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790945762.460161:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1790945762.460162:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790945762.460163:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790945762.460164:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790945762.460207:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790945762.460209:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790945762.460210:0:7450:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790945762.460211:0:7450:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790945762.460212:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790945762.460212:0:7450:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790945762.460226:0:7450:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1790945762.460235:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ba185d14 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:7450:1877942638485376:0@lo:253: 00000100:00100000:1.0:1790945762.460271:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945762.460310:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e0177f6c going to sleep for 11 seconds 00000100:00100000:2.0:1790945762.460317:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638485376 00000100:00100000:2.0:1790945762.460327:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638485376 00000100:00100000:2.0:1790945762.460364:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790945762.460371:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000002db6acd6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:7450:x1877942638485376:12345-0@lo:253: 20000000:01000000:2.0:1790945762.460392:0:6514:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1790945762.460403:0:6514:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1790945762.464822:0:6500:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1790945762.475304:0:6514:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790945762.475329:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1790945762.475411:0:6537:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1790945762.475416:0:6537:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1790945762.475509:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000080914808/0xd9f4181e0d27ce04 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945762.475537:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e7d09c74/0xd9f4181e0d27cd24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27cd1d expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945762.475545:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000262913e3/0xd9f4181e0d27cdcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27cdc5 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945762.475552:0:6537:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000080914808/0xd9f4181e0d27ce04 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945762.475609:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000262913e3/0xd9f4181e0d27cdcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27cdc5 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945762.475623:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: 00000000262913e3/0xd9f4181e0d27cdcc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27cdc5 expref: 15 pid: 6516 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945762.475636:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000edaf8955 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1877942638485504:0@lo:104: 00000100:00100000:1.0:1790945762.475839:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790945762.475899:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e7d09c74/0xd9f4181e0d27cd24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27cd1d expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945762.475906:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: 00000000e7d09c74/0xd9f4181e0d27cd24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27cd1d expref: 15 pid: 6515 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945762.475913:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000060f45df4 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1877942638485632:0@lo:104: 00000100:00100000:1.0:1790945762.475936:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945762.475950:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set 000000003f7858d3 going to sleep for 11 seconds 00000100:00100000:3.0:1790945762.476012:0:6505:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638485504 00000100:00100000:3.0:1790945762.476021:0:6505:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638485504 00000100:00100000:3.0:1790945762.476056:0:6505:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638485632 00000100:00100000:3.0:1790945762.476059:0:6505:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638485632 00000100:00100000:3.0:1790945762.476074:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790945762.476082:0:6505:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000583015cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+4:6537:x1877942638485504:12345-0@lo:104: 00010000:00010000:3.0:1790945762.476093:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: 00000000d6311fca/0xd9f4181e0d27cdc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27cdcc expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945762.476157:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790945762.476189:0:6505:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000583015cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+4:6537:x1877942638485504:12345-0@lo:104: Request processed in 82us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945762.476196:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790945762.476214:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790945762.476220:0:6505:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000a2676d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+3:6537:x1877942638485632:12345-0@lo:104: 00010000:00010000:3.0:1790945762.476227:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: 00000000bc664630/0xd9f4181e0d27cd1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27cd24 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945762.476268:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000edaf8955 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1877942638485504:0@lo:104: 00010000:00010000:3.0:1790945762.476272:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790945762.476276:0:6505:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000a2676d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+3:6537:x1877942638485632:12345-0@lo:104: Request processed in 57us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945762.476278:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000060f45df4 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1877942638485632:0@lo:104: 00000100:00100000:3.0:1790945762.476282:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1790945762.476294:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000080914808/0xd9f4181e0d27ce04 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945762.476299:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790945762.476303:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: 00000000d6311fca/0xd9f4181e0d27cdc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27cdcc expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945762.476311:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d6311fca already unused, calling callback (00000000744480de) 10000000:00010000:3.0:1790945762.476314:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: 00000000d6311fca/0xd9f4181e0d27cdc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27cdcc expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945762.476321:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: 00000000d6311fca/0xd9f4181e0d27cdc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27cdcc expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790945762.476328:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: 00000000d6311fca/0xd9f4181e0d27cdc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27cdcc expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790945762.476333:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790945762.476362:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: 00000000d6311fca/0xd9f4181e0d27cdc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cdcc expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945762.476369:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790945762.476386:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: 00000000d6311fca/0xd9f4181e0d27cdc5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cdcc expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945762.476392:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: 00000000d6311fca/0xd9f4181e0d27cdc5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cdcc expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945762.476414:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790945762.476417:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: 00000000bc664630/0xd9f4181e0d27cd1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27cd24 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945762.476422:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bc664630 already unused, calling callback (00000000744480de) 10000000:00010000:3.0:1790945762.476424:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: 00000000bc664630/0xd9f4181e0d27cd1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27cd24 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945762.476430:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: 00000000bc664630/0xd9f4181e0d27cd1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27cd24 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790945762.476435:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: 00000000bc664630/0xd9f4181e0d27cd1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27cd24 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790945762.476439:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790945762.476458:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: 00000000bc664630/0xd9f4181e0d27cd1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cd24 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945762.476464:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790945762.476468:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: 00000000bc664630/0xd9f4181e0d27cd1d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cd24 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945762.476474:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: 00000000bc664630/0xd9f4181e0d27cd1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cd24 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945762.476486:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945762.476488:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945762.476489:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945762.476495:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945762.476540:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001b6df94c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638485760:0@lo:103: 00000100:00100000:3.0:1790945762.476567:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945762.476725:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790945762.476733:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000623b9fe9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638485888:0@lo:103: 00000100:00100000:0.0:1790945762.476751:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638485760 00000100:00100000:0.0:1790945762.476756:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638485760 00000100:00100000:3.0:1790945762.476758:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790945762.476773:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000262913e3/0xd9f4181e0d27cdcc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27cdc5 expref: 16 pid: 6516 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945762.476791:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638485888 00000100:00100000:0.0:1790945762.476794:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638485888 00010000:00010000:0.0:1790945762.476803:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e7d09c74/0xd9f4181e0d27cd24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27cd1d expref: 17 pid: 6515 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945762.476916:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000002db6acd6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:7450:x1877942638485376:12345-0@lo:253: Request processed in 16546us (16644us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945762.476925:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790945762.478598:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ba185d14 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:7450:1877942638485376:0@lo:253: 10000000:01000000:2.0:1790945762.478853:0:7450:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1790945762.478857:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790945762.478858:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1790945762.478859:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790945762.478861:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790945762.478862:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790945762.478863:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790945762.478865:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790945762.478866:0:7450:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790945762.478868:0:7450:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790945762.478869:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790945762.478870:0:7450:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790945762.478883:0:7450:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1790945762.482290:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790945762.482314:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000cda625a6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:3647:x1877942638485760:12345-0@lo:103: 00010000:00010000:3.0:1790945762.482335:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945762.482344:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000262913e3/0xd9f4181e0d27cdcc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27cdc5 expref: 16 pid: 6516 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945762.482359:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000262913e3/0xd9f4181e0d27cdcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27cdc5 expref: 16 pid: 6516 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945762.482377:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000262913e3/0xd9f4181e0d27cdcc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27cdc5 expref: 16 pid: 6516 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945762.482393:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945762.482447:0:6508:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1790945762.482457:0:6508:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1790945762.482467:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000cda625a6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:3647:x1877942638485760:12345-0@lo:103: Request processed in 166us (5900us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945762.482474:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790945762.482492:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790945762.484010:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001b6df94c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638485760:0@lo:103: 00000100:00100000:3.0:1790945762.484578:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000a292037e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+14:3647:x1877942638485888:12345-0@lo:103: 00010000:00010000:3.0:1790945762.484596:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945762.484604:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e7d09c74/0xd9f4181e0d27cd24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27cd1d expref: 14 pid: 6515 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945762.484618:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e7d09c74/0xd9f4181e0d27cd24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27cd1d expref: 14 pid: 6515 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945762.484640:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e7d09c74/0xd9f4181e0d27cd24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27cd1d expref: 14 pid: 6515 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945762.484654:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000080914808/0xd9f4181e0d27ce04 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945762.484662:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000080914808/0xd9f4181e0d27ce04 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790945762.484678:0:6506:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009262225s 00010000:00010000:3.0:1790945762.484681:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000080914808/0xd9f4181e0d27ce04 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945762.484687:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000080914808/0xd9f4181e0d27ce04 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945762.484693:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000080914808/0xd9f4181e0d27ce04 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945762.484698:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000080914808/0xd9f4181e0d27ce04 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945762.484704:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000080914808 already unused, calling callback (00000000b60b8e97) 00010000:00010000:3.0:1790945762.484721:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000080914808/0xd9f4181e0d27ce04 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945762.484728:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000080914808/0xd9f4181e0d27ce04 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945762.484754:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000080914808/0xd9f4181e0d27ce04 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945762.484776:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945762.484835:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000a292037e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+13:3647:x1877942638485888:12345-0@lo:103: Request processed in 2338us (8076us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945762.484843:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1790945762.485626:0:6537:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000080914808/0xd9f4181e0d27ce04 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945762.485638:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000080914808/0xd9f4181e0d27ce04 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945762.485644:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000080914808/0xd9f4181e0d27ce04 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945762.485904:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000623b9fe9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638485888:0@lo:103: 00080000:10000000:2.0:1790945762.488056:0:7450:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:2.0:1790945762.488981:0:7450:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1790945762.489291:0:7450:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1790945762.489648:0:7450:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1790945762.490610:0:7450:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1790945762.490986:0:7450:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1790945762.491627:0:7450:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1790945762.491853:0:7450:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1790945762.492045:0:7450:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:2.0:1790945762.492375:0:7450:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1790945762.492561:0:7450:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:2.0:1790945762.492965:0:7450:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:2.0:1790945762.495589:0:7450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1790945762.496410:0:7474:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1790945762.496416:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1790945762.497050:0:7475:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:3.0:1790945762.497115:0:7475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cda625a6 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7475:1877942638486016:0@lo:700: 00000100:00100000:3.0:1790945762.497272:0:7475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945762.497328:0:7475:0:(client.c:2716:ptlrpc_set_wait()) set 0000000057aa80d6 going to sleep for 11 seconds 00000040:01000000:1.0:1790945762.497399:0:7450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1790945762.497660:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638486016 00000100:00100000:2.0:1790945762.497670:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638486016 00000100:00100000:0.0:1790945762.498068:0:7476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cf55a588 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1877942638486144:0@lo:1000: 00000100:00100000:0.0:1790945762.498122:0:7476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945762.498161:0:7476:0:(client.c:2716:ptlrpc_set_wait()) set 000000000c6d50d5 going to sleep for 11 seconds 00000100:00100000:2.0:1790945762.498240:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790945762.498250:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000078ce6c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7475:x1877942638486016:12345-0@lo:700: 00000100:00100000:3.0:1790945762.498278:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638486144 00000100:00100000:3.0:1790945762.498283:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638486144 00000100:00100000:3.0:1790945762.498308:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790945762.498313:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000072a5e50d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7476:x1877942638486144:12345-0@lo:1000: 00000100:00100000:3.0:1790945762.498385:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000072a5e50d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7476:x1877942638486144:12345-0@lo:1000: Request processed in 71us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945762.498394:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790945762.498432:0:7476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cf55a588 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1877942638486144:0@lo:1000: 00000040:01000000:3.0:1790945762.498461:0:7476:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:3.0:1790945762.498483:0:7476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002661385a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1877942638486272:0@lo:700: 00000100:00100000:3.0:1790945762.499278:0:7476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945762.499301:0:7476:0:(client.c:2716:ptlrpc_set_wait()) set 000000001a995921 going to sleep for 11 seconds 00000100:00100000:0.0:1790945762.499387:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638486272 00000100:00100000:0.0:1790945762.499393:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638486272 00000100:00100000:0.0:1790945762.499429:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790945762.499435:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005541bc34 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7476:x1877942638486272:12345-0@lo:700: 00000100:00100000:0.0:1790945762.499494:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005541bc34 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7476:x1877942638486272:12345-0@lo:700: Request processed in 59us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945762.499679:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790945762.499802:0:7476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002661385a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1877942638486272:0@lo:700: 00000100:00100000:3.0:1790945762.499856:0:7476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002661385a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7476:1877942638486400:0@lo:900: 00000100:00100000:3.0:1790945762.499886:0:7476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945762.499949:0:7476:0:(client.c:2716:ptlrpc_set_wait()) set 000000001a995921 going to sleep for 11 seconds 00000040:01000000:1.0:1790945762.500065:0:7450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1790945762.500253:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1790945762.500684:0:7450:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1790945762.500692:0:7450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1790945762.500826:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790945762.501828:0:7450:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1790945762.502381:0:7450:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 40000000:02000000:2.0:1790945762.504412:0:6528:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000040:01000000:1.0:1790945762.505717:0:7450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1790945762.505993:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1790945762.506251:0:7450:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000100:00100000:0.0:1790945762.507009:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638486400 00000100:00100000:0.0:1790945762.507021:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638486400 00000100:00100000:0.0:1790945762.507076:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790945762.507085:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000fdfb705b pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7476:x1877942638486400:12345-0@lo:900: 00000100:00100000:0.0:1790945762.507208:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000fdfb705b pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7476:x1877942638486400:12345-0@lo:900: Request processed in 125us (7322us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945762.507216:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1790945762.507401:0:7476:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000002661385a x1877942638486400/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790945778 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945762.507423:0:7476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002661385a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7476:1877942638486400:0@lo:900: 00000100:00100000:3.0:1790945762.507680:0:7476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002661385a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1877942638486528:0@lo:1000: 00000100:00100000:3.0:1790945762.507721:0:7476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945762.507762:0:7476:0:(client.c:2716:ptlrpc_set_wait()) set 000000003ecd2709 going to sleep for 11 seconds 00000100:00100000:0.0:1790945762.507829:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638486528 00000100:00100000:0.0:1790945762.507834:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638486528 00000100:00100000:0.0:1790945762.507907:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790945762.507915:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000627071b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7476:x1877942638486528:12345-0@lo:1000: 00000100:00100000:0.0:1790945762.507994:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000627071b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7476:x1877942638486528:12345-0@lo:1000: Request processed in 81us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945762.508000:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00100000:10000000:1.0:1790945762.508616:0:7450:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1790945762.508789:0:7450:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1790945762.508920:0:7450:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1790945762.509056:0:7450:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1790945762.509232:0:7450:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1790945762.509466:0:7450:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1790945762.509614:0:7450:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1790945762.509745:0:7450:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1790945762.509906:0:7450:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1790945762.510280:0:7450:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1790945762.510441:0:7450:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1790945762.510909:0:7450:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1790945762.511063:0:7450:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1790945762.511296:0:7450:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1790945762.511436:0:7450:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00000100:00100000:3.0:1790945762.511759:0:7476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002661385a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1877942638486528:0@lo:1000: 00000004:00080000:3.0:1790945762.511835:0:7476:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000001a995921 with version 0 00000020:00100000:3.0:1790945762.511860:0:7476:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1790945762.511865:0:7476:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000002661385a x1877942638486784/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790945762.511886:0:7476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002661385a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1877942638486784:0@lo:1000: 00000100:00100000:3.0:1790945762.511949:0:7476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945762.511988:0:7476:0:(client.c:2716:ptlrpc_set_wait()) set 000000003ecd2709 going to sleep for 11 seconds 00000100:00100000:3.0:1790945762.512019:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638486784 00000100:00100000:3.0:1790945762.512026:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638486784 00000100:00100000:3.0:1790945762.512063:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790945762.512069:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005e64c847 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1877942638486784:12345-0@lo:1000: 00100000:10000000:1.0:1790945762.512414:0:7450:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1790945762.513043:0:7450:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1790945762.513753:0:7450:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1790945762.513913:0:7450:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1790945762.514071:0:7450:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1790945762.514326:0:7450:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1790945762.514464:0:7450:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1790945762.514907:0:7450:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1790945762.515071:0:7450:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1790945762.515340:0:7450:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1790945762.515476:0:7450:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00000100:00100000:2.0:1790945762.521084:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000078ce6c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7475:x1877942638486016:12345-0@lo:700: Request processed in 22828us (23805us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945762.521109:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790945762.521219:0:7475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000cda625a6 x1877942638486016/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790945778 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945762.521237:0:7475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cda625a6 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7475:1877942638486016:0@lo:700: 40000000:02000000:2.0:1790945762.521252:0:7475:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:1.0:1790945762.521963:0:7450:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1790945762.522157:0:7450:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1790945762.522355:0:7450:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00000001:00080000:0.0:1790945762.523147:0:6500:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:3.0:1790945762.523382:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005e64c847 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1877942638486784:12345-0@lo:1000: Request processed in 11310us (11431us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1790945762.523395:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:0.0:1790945762.523489:0:7476:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1790945762.523493:0:7476:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1790945762.523507:0:7476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002661385a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1877942638486784:0@lo:1000: 00000100:00100000:0.0:1790945762.523686:0:7476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af36aee2 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1877942638486912:0@lo:1000: 00000100:00100000:0.0:1790945762.523731:0:7476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945762.523789:0:7476:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b24f2374 going to sleep for 11 seconds 00000100:00100000:3.0:1790945762.524281:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638486912 00000100:00100000:3.0:1790945762.524290:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638486912 00000100:00100000:3.0:1790945762.524345:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790945762.524354:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f83bd194 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7476:x1877942638486912:12345-0@lo:1000: 00000100:00100000:3.0:1790945762.524434:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f83bd194 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7476:x1877942638486912:12345-0@lo:1000: Request processed in 81us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945762.524452:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790945762.524484:0:7476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af36aee2 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1877942638486912:0@lo:1000: 00000040:00080000:3.0:1790945762.524505:0:7476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1790945762.524548:0:7476:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000b649271c with version 1 00000004:00080000:1.0:1790945762.526215:0:7464:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000d569e9bb version 1 rpc_version 1 00000020:00100000:1.0:1790945762.526253:0:7464:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1790945762.526262:0:7464:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000036ab77cb x1877942638487168/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790945762.526282:0:7464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000036ab77cb pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7464:1877942638487168:0@lo:1000: 00000100:00100000:1.0:1790945762.526339:0:7464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945762.526381:0:7464:0:(client.c:2716:ptlrpc_set_wait()) set 000000004f8d881e going to sleep for 11 seconds 00000100:00100000:1.0:1790945762.526401:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638487168 00000100:00100000:1.0:1790945762.526407:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638487168 00000100:00100000:1.0:1790945762.526443:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790945762.526450:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000ba185d14 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7464:x1877942638487168:12345-0@lo:1000: 00100000:10000000:0.0:1790945762.527658:0:7450:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1790945762.527937:0:7450:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1790945762.528127:0:7450:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1790945762.529899:0:7450:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1790945762.531567:0:7476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1790945762.534762:0:7476:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000001:00080000:3.0:1790945762.538961:0:6500:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:3.0:1790945762.539089:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000ba185d14 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7464:x1877942638487168:12345-0@lo:1000: Request processed in 12635us (12746us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1790945762.539104:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:1.0:1790945762.539990:0:7464:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1790945762.539997:0:7464:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1790945762.540015:0:7464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000036ab77cb pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7464:1877942638487168:0@lo:1000: 00000001:00080000:0.0:1790945762.540487:0:7450:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1790945762.540534:0:7450:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb827c1c8b988 00100000:10000000:0.0:1790945762.540542:0:7450:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1790945762.541402:0:7450:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1790945762.541436:0:7450:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.120@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1790945762.541459:0:7450:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1790945762.541476:0:7450:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1790945762.545488:0:7450:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790945762.545734:0:7450:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:1.0:1790945762.584056:0:7475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790945762.593876:0:7475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1790945762.593970:0:7475:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1790945762.593977:0:7475:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:3.0:1790945762.786792:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790945763.231282:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790945763.231292:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d40bacd0800 from 4 10000000:01000000:0.0:1790945763.231305:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790945763.231352:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: 00000000bc664630/0xd9f4181e0d27ce0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945763.231365:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: 00000000bc664630/0xd9f4181e0d27ce0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945763.231375:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: 00000000bc664630/0xd9f4181e0d27ce0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945763.231400:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007fe56b57 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638487296:0@lo:101: 00000100:00100000:0.0:1790945763.231471:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945763.231572:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 000000004bd0c4d4 going to sleep for 11 seconds 00000100:00100000:1.0:1790945763.231646:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638487296 00000100:00100000:1.0:1790945763.231656:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638487296 00000100:00100000:1.0:1790945763.231723:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790945763.231732:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000093586c16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+13:6519:x1877942638487296:12345-0@lo:101: 00010000:00010000:1.0:1790945763.231747:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945763.231769:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005ffcaf1c/0xd9f4181e0d27ce12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27ce0b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945763.231793:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005ffcaf1c/0xd9f4181e0d27ce12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27ce0b expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945763.231803:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005ffcaf1c/0xd9f4181e0d27ce12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ce0b expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945763.231812:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005ffcaf1c, rc 0) 00000100:00100000:1.0:1790945763.231862:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000093586c16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+14:6519:x1877942638487296:12345-0@lo:101: Request processed in 131us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945763.231869:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790945763.232066:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007fe56b57 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638487296:0@lo:101: 00010000:00010000:0.0:1790945763.232080:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: 00000000bc664630/0xd9f4181e0d27ce0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ce12 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945763.232088:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: 00000000bc664630/0xd9f4181e0d27ce0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27ce12 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945763.232142:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007fe56b57 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638487424:0@lo:256: 00000100:00100000:0.0:1790945763.232204:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945763.232224:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 000000004bd0c4d4 going to sleep for 11 seconds 00000100:00100000:1.0:1790945763.232303:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638487424 00000100:00100000:1.0:1790945763.232308:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638487424 00000100:00100000:1.0:1790945763.232331:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790945763.232337:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000011c25a2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+14:6519:x1877942638487424:12345-0@lo:256: 20000000:01000000:1.0:1790945763.232351:0:6514:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790945763.232368:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790945763.232371:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1790945763.232443:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000011c25a2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+14:6519:x1877942638487424:12345-0@lo:256: Request processed in 107us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945763.232451:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790945763.232593:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007fe56b57 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638487424:0@lo:256: 10000000:01000000:0.0:1790945763.232632:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790945763.232638:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: 00000000bc664630/0xd9f4181e0d27ce0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ce12 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945763.232644:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: 00000000bc664630/0xd9f4181e0d27ce0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ce12 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945763.232657:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1790945763.232659:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d4087223000 from 21 10000000:01000000:0.0:1790945763.232661:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790945763.232677:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: 00000000b5d01de2/0xd9f4181e0d27ce19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945763.232683:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: 00000000b5d01de2/0xd9f4181e0d27ce19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945763.232689:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: 00000000b5d01de2/0xd9f4181e0d27ce19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945763.232700:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007fe56b57 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638487552:0@lo:101: 00000100:00100000:0.0:1790945763.232725:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945763.232755:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 000000004bd0c4d4 going to sleep for 11 seconds 00000100:00100000:1.0:1790945763.232975:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638487552 00000100:00100000:1.0:1790945763.232981:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638487552 00000100:00100000:1.0:1790945763.233012:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790945763.233019:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c8fa6e37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+14:6519:x1877942638487552:12345-0@lo:101: 00010000:00010000:1.0:1790945763.233028:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945763.233039:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000029c6f988/0xd9f4181e0d27ce20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27ce19 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945763.233062:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000029c6f988/0xd9f4181e0d27ce20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27ce19 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945763.233071:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000029c6f988/0xd9f4181e0d27ce20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ce19 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945763.233077:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000029c6f988, rc 0) 00000100:00100000:1.0:1790945763.233120:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c8fa6e37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:6519:x1877942638487552:12345-0@lo:101: Request processed in 102us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945763.233126:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790945763.233263:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007fe56b57 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638487552:0@lo:101: 00010000:00010000:3.0:1790945763.233275:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: 00000000b5d01de2/0xd9f4181e0d27ce19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ce20 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945763.233282:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: 00000000b5d01de2/0xd9f4181e0d27ce19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27ce20 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945763.233342:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000219f6639 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638487680:0@lo:501: 00000100:00100000:3.0:1790945763.233371:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945763.233390:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 00000000440e86cf going to sleep for 11 seconds 00000100:00100000:0.0:1790945763.233447:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638487680 00000100:00100000:0.0:1790945763.233452:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638487680 00000100:00100000:0.0:1790945763.233476:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790945763.233494:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000007d0fd774 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:6519:x1877942638487680:12345-0@lo:501: 00000100:00100000:0.0:1790945763.233631:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000007d0fd774 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:6519:x1877942638487680:12345-0@lo:501: Request processed in 137us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945763.233638:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790945763.233765:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000219f6639 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638487680:0@lo:501: 00000100:00100000:3.0:1790945763.233796:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000219f6639 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638487808:0@lo:503: 00000100:00100000:3.0:1790945763.233847:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945763.233868:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 00000000440e86cf going to sleep for 11 seconds 00000100:00100000:0.0:1790945763.233957:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638487808 00000100:00100000:0.0:1790945763.233961:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638487808 00000100:00100000:0.0:1790945763.233994:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790945763.234000:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000004fb0d424 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:6519:x1877942638487808:12345-0@lo:503: 00000100:00100000:0.0:1790945763.234078:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000004fb0d424 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:6519:x1877942638487808:12345-0@lo:503: Request processed in 79us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945763.234091:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790945763.234396:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000219f6639 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638487808:0@lo:503: 00000100:00100000:1.0:1790945763.235010:0:7504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000036ab77cb pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:7504:1877942638487936:0@lo:502: 00000100:00100000:1.0:1790945763.235062:0:7504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945763.239640:0:7504:0:(client.c:2716:ptlrpc_set_wait()) set 000000005477ad14 going to sleep for 11 seconds 00000100:00100000:0.0:1790945763.243340:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638487936 00000100:00100000:0.0:1790945763.243358:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638487936 00000100:00100000:0.0:1790945763.243421:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790945763.243430:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000e991d7d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:7504:x1877942638487936:12345-0@lo:502: 00000100:00100000:0.0:1790945763.243638:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000e991d7d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:7504:x1877942638487936:12345-0@lo:502: Request processed in 209us (8576us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945763.243646:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790945763.243920:0:7504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000036ab77cb pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:7504:1877942638487936:0@lo:502: 00000100:00100000:3.0:1790945763.243990:0:7504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000219f6639 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:7504:1877942638488064:0@lo:502: 00000100:00100000:3.0:1790945763.244035:0:7504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945763.244075:0:7504:0:(client.c:2716:ptlrpc_set_wait()) set 00000000440e86cf going to sleep for 11 seconds 00000100:00100000:1.0:1790945763.244138:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638488064 00000100:00100000:1.0:1790945763.244142:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638488064 00000100:00100000:1.0:1790945763.244191:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790945763.244198:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000014bd75d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:7504:x1877942638488064:12345-0@lo:502: 00000100:00100000:1.0:1790945763.244268:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000014bd75d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:7504:x1877942638488064:12345-0@lo:502: Request processed in 72us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945763.244275:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790945763.244357:0:7504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000219f6639 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:7504:1877942638488064:0@lo:502: 00000040:00080000:3.0:1790945763.244377:0:7504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1790945763.244658:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1790945763.244682:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790945763.244692:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: 00000000b5d01de2/0xd9f4181e0d27ce19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ce20 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945763.244703:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: 00000000b5d01de2/0xd9f4181e0d27ce19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ce20 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945763.244734:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790945763.244737:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d4087223000 from 4 10000000:01000000:1.0:1790945763.244740:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790945763.244765:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: 0000000080914808/0xd9f4181e0d27ce27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945763.244772:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: 0000000080914808/0xd9f4181e0d27ce27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945763.244779:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: 0000000080914808/0xd9f4181e0d27ce27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945763.244791:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000060f45df4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638488192:0@lo:101: 00000100:00100000:1.0:1790945763.244821:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945763.244847:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 000000005477ad14 going to sleep for 11 seconds 00000100:00100000:3.0:1790945763.244967:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638488192 00000100:00100000:3.0:1790945763.244972:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638488192 00000100:00100000:3.0:1790945763.245008:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790945763.245014:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c6bc503e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:6519:x1877942638488192:12345-0@lo:101: 00010000:00010000:3.0:1790945763.245023:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945763.245034:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fb94e99e/0xd9f4181e0d27ce2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27ce27 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945763.245054:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fb94e99e/0xd9f4181e0d27ce2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27ce27 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945763.245063:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fb94e99e/0xd9f4181e0d27ce2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ce27 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945763.245071:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fb94e99e, rc 0) 00000100:00100000:3.0:1790945763.245101:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c6bc503e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:6519:x1877942638488192:12345-0@lo:101: Request processed in 87us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945763.245107:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790945763.245211:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000060f45df4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638488192:0@lo:101: 00010000:00010000:1.0:1790945763.245223:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: 0000000080914808/0xd9f4181e0d27ce27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ce2e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945763.245231:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: 0000000080914808/0xd9f4181e0d27ce27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27ce2e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945763.245273:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000060f45df4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638488320:0@lo:256: 00000100:00100000:1.0:1790945763.245303:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945763.245323:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 000000005477ad14 going to sleep for 11 seconds 00000100:00100000:3.0:1790945763.245391:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638488320 00000100:00100000:3.0:1790945763.245396:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638488320 00000100:00100000:3.0:1790945763.245425:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790945763.245437:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f9f34459 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:6519:x1877942638488320:12345-0@lo:256: 20000000:01000000:3.0:1790945763.245451:0:6515:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790945763.245467:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790945763.245470:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1790945763.245721:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f9f34459 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:6519:x1877942638488320:12345-0@lo:256: Request processed in 285us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945763.245729:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790945763.245814:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000060f45df4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638488320:0@lo:256: 10000000:01000000:1.0:1790945763.245854:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790945763.245863:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: 0000000080914808/0xd9f4181e0d27ce27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ce2e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945763.245870:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: 0000000080914808/0xd9f4181e0d27ce27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ce2e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945763.245876:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1790945763.245878:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1790945763.245880:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1790945763.245895:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: 0000000092d1948c/0xd9f4181e0d27ce35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945763.245901:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: 0000000092d1948c/0xd9f4181e0d27ce35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945763.245908:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: 0000000092d1948c/0xd9f4181e0d27ce35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945763.245917:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000060f45df4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638488448:0@lo:101: 00000100:00100000:1.0:1790945763.245942:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945763.245957:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 000000005477ad14 going to sleep for 11 seconds 00000100:00100000:3.0:1790945763.245999:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638488448 00000100:00100000:3.0:1790945763.246004:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638488448 00000100:00100000:3.0:1790945763.246034:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790945763.246040:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000007ec88e08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:6519:x1877942638488448:12345-0@lo:101: 00010000:00010000:3.0:1790945763.246048:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945763.246057:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005f272f75/0xd9f4181e0d27ce3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27ce35 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945763.246070:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005f272f75/0xd9f4181e0d27ce3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27ce35 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945763.246079:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005f272f75/0xd9f4181e0d27ce3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ce35 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945763.246086:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005f272f75, rc 0) 00000100:00100000:3.0:1790945763.246112:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000007ec88e08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:6519:x1877942638488448:12345-0@lo:101: Request processed in 73us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945763.246118:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790945763.246526:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000060f45df4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638488448:0@lo:101: 00010000:00010000:1.0:1790945763.246538:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: 0000000092d1948c/0xd9f4181e0d27ce35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ce3c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945763.246545:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: 0000000092d1948c/0xd9f4181e0d27ce35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27ce3c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945763.246595:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000060f45df4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638488576:0@lo:501: 00000100:00100000:1.0:1790945763.246633:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945763.246659:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 000000005477ad14 going to sleep for 11 seconds 00000100:00100000:3.0:1790945763.247546:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638488576 00000100:00100000:3.0:1790945763.247555:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638488576 00000100:00100000:3.0:1790945763.247591:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790945763.247598:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000003a63e487 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:6519:x1877942638488576:12345-0@lo:501: 00000100:00100000:3.0:1790945763.247753:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000003a63e487 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:6519:x1877942638488576:12345-0@lo:501: Request processed in 155us (1120us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945763.247761:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790945763.248265:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000060f45df4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638488576:0@lo:501: 00000100:00100000:1.0:1790945763.248310:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000060f45df4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638488704:0@lo:503: 00000100:00100000:1.0:1790945763.248358:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945763.248393:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 000000005477ad14 going to sleep for 11 seconds 00000100:00100000:3.0:1790945763.248585:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638488704 00000100:00100000:3.0:1790945763.248591:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638488704 00000100:00100000:3.0:1790945763.249414:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790945763.249426:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000065008c2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:6519:x1877942638488704:12345-0@lo:503: 00000100:00100000:3.0:1790945763.249579:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000065008c2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:6519:x1877942638488704:12345-0@lo:503: Request processed in 156us (1221us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945763.249587:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790945763.249667:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000060f45df4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638488704:0@lo:503: 00000100:00100000:0.0:1790945763.254869:0:7505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073ef3605 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:7505:1877942638488832:0@lo:502: 00000100:00100000:0.0:1790945763.254952:0:7505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945763.254996:0:7505:0:(client.c:2716:ptlrpc_set_wait()) set 00000000da5e5338 going to sleep for 11 seconds 00000100:00100000:1.0:1790945763.255082:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638488832 00000100:00100000:1.0:1790945763.255090:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638488832 00000100:00100000:1.0:1790945763.255132:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790945763.255140:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000a9bc2e6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:7505:x1877942638488832:12345-0@lo:502: 00000100:00100000:1.0:1790945763.255290:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000a9bc2e6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:7505:x1877942638488832:12345-0@lo:502: Request processed in 150us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945763.255297:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790945763.255390:0:7505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073ef3605 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:7505:1877942638488832:0@lo:502: 00000020:01000000:0.0:1790945763.255562:0:7505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790945763.255573:0:7505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945763.255575:0:7505:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1790945763.255580:0:7505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790945763.255583:0:7505:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.120@tcp to nid 0x20000c0a8cc78 (192.168.204.120@tcp) 00000020:00000080:0.0:1790945763.255606:0:7505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790945763.255630:0:7505:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000baea42a1) 00000020:00000080:0.0:1790945763.255651:0:7505:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:0.0:1790945763.255657:0:7505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790945763.255731:0:7505:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1790945763.255736:0:7505:0:(osd_handler.c:8931:osd_obd_connect()) connect #5 00000020:00000080:0.0:1790945763.255742:0:7505:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd9f4181e0d27ce4a 00010000:00080000:0.0:1790945763.255782:0:7505:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000076ead6aa@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.120@tcp at head 00010000:00010000:1.0:1790945763.262687:0:7505:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:2.0:1790945763.265802:0:7505:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790945763.265820:0:7505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1790945763.265865:0:7505:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1790945763.265890:0:7505:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd9f4181e0d27ce51 00000100:00080000:2.0:1790945763.265901:0:7505:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790945763.265914:0:7505:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 0000000076ead6aa using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1790945763.265954:0:7505:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005f3867d6 x1877942638488960/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790945763.266028:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005f3867d6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638488960:0@lo:38: 00000100:00100000:0.0:1790945763.266107:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790945763.266194:0:7505:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:2.0:1790945763.266255:0:7505:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:1.0:1790945763.267654:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000edaf8955 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638489216:0@lo:400: 00000100:00100000:1.0:1790945763.267705:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945763.267736:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790945763.267740:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000060f45df4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877942638489088:0@lo:400: 00000100:00100000:1.0:1790945763.267784:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945763.267806:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e199b721 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1877942638489344:0@lo:400: 00000100:00100000:1.0:1790945763.267830:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945763.267871:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638489088 00000100:00100000:1.0:1790945763.267879:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638489088 00000100:00100000:1.0:1790945763.267922:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638489344 00000100:00100000:1.0:1790945763.267925:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638489344 00000100:00100000:1.0:1790945763.267950:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790945763.267957:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000058fa5805 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877942638489088:12345-0@lo:400: 00000100:00100000:1.0:1790945763.268006:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000058fa5805 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877942638489088:12345-0@lo:400: Request processed in 50us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945763.268013:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790945763.268028:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790945763.268040:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000583535a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1877942638489344:12345-0@lo:400: 00000100:00100000:1.0:1790945763.268074:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000583535a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1877942638489344:12345-0@lo:400: Request processed in 41us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945763.268079:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1790945763.268112:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000060f45df4 x1877942638489088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945763.268126:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000060f45df4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877942638489088:0@lo:400: 00010000:00080000:1.0:1790945763.268147:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000e199b721 x1877942638489344/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945763.268155:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e199b721 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1877942638489344:0@lo:400: 00000100:00100000:3.0:1790945763.268547:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638488960 00000100:00100000:3.0:1790945763.268553:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638488960 00000100:00100000:3.0:1790945763.268567:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638489216 00000100:00100000:3.0:1790945763.268569:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638489216 00000100:00100000:3.0:1790945763.268586:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790945763.268590:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000073ef3605 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1877942638488960:12345-0@lo:38: 00010000:00080000:3.0:1790945763.268612:0:6526:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:3.0:1790945763.268648:0:6526:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd9f4181e0d27ce58 00000004:00100000:3.0:1790945763.268661:0:6526:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1790945763.268666:0:6526:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1790945763.274935:0:7508:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@0000000081cd284f x1877942638489472/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945763.274952:0:7508:0:(client.c:2716:ptlrpc_set_wait()) set 00000000541fb938 going to sleep for 0 seconds 00000020:01000000:2.0:1790945763.275305:0:7505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790945763.275312:0:7505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945763.275314:0:7505:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1790945763.275317:0:7505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790945763.275321:0:7505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945763.275322:0:7505:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790945763.275325:0:7505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790945763.275326:0:7505:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1790945763.275350:0:7505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000289c8a97 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:7505:1877942638489600:0@lo:502: 00000100:00100000:2.0:1790945763.275615:0:7505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945763.275706:0:7505:0:(client.c:2716:ptlrpc_set_wait()) set 00000000afd457c3 going to sleep for 11 seconds 00000100:00080000:3.0:1790945763.283313:0:6526:0:(import.c:65:import_set_state_nolock()) 000000007bd9119d : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790945763.283424:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000073ef3605 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1877942638488960:12345-0@lo:38: Request processed in 14830us (17316us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945763.283436:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790945763.283465:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790945763.283475:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000059e2613f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638489216:12345-0@lo:400: 00000100:00100000:2.0:1790945763.283648:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790945763.283658:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1790945763.283665:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1790945763.283671:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1790945763.283673:0:3646:0:(import.c:65:import_set_state_nolock()) 0000000076ead6aa lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1790945763.283686:0:3646:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000541fb938): req@0000000081cd284f x1877942638489472/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945763.283702:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005f3867d6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638488960:0@lo:38: 00000100:00100000:3.0:1790945763.284283:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000059e2613f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638489216:12345-0@lo:400: Request processed in 812us (16577us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945763.284295:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790945763.284319:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005f3867d6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638489728:0@lo:41: 00000100:00100000:3.0:1790945763.284353:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945763.284410:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000edaf8955 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638489216:0@lo:400: 00000100:00100000:2.0:1790945763.284493:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638489728 00000100:00100000:2.0:1790945763.284500:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638489728 00000100:00100000:2.0:1790945763.284549:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790945763.284555:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000219f6639 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1877942638489728:12345-0@lo:41: 00000004:00000024:2.0:1790945763.284578:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1790945763.284615:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000219f6639 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1877942638489728:12345-0@lo:41: Request processed in 61us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945763.284621:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790945763.284750:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005f3867d6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638489728:0@lo:41: 00000100:00100000:2.0:1790945763.285339:0:7508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945763.285368:0:7508:0:(client.c:2716:ptlrpc_set_wait()) set 00000000541fb938 going to sleep for 11 seconds 00000100:00100000:3.0:1790945763.285414:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638489472 00000100:00100000:3.0:1790945763.285420:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638489472 00000100:00100000:3.0:1790945763.285455:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790945763.285462:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000180d8517 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7508:x1877942638489472:12345-0@lo:1000: 00000100:00100000:3.0:1790945763.285551:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000180d8517 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7508:x1877942638489472:12345-0@lo:1000: Request processed in 90us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945763.285559:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790945763.285589:0:7508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000081cd284f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7508:1877942638489472:0@lo:1000: 00000040:01000000:3.0:1790945763.285621:0:7508:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1790945763.285657:0:7508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cda625a6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7508:1877942638489856:0@lo:1000: 00000100:00100000:3.0:1790945763.285689:0:7508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945763.285707:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638489856 00000100:00100000:3.0:1790945763.285711:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638489856 00000100:00100000:3.0:1790945763.285727:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790945763.285732:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000002661385a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7508:x1877942638489856:12345-0@lo:1000: 00000100:00100000:3.0:1790945763.285822:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000002661385a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7508:x1877942638489856:12345-0@lo:1000: Request processed in 90us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945763.285828:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790945763.285845:0:7508:0:(client.c:2716:ptlrpc_set_wait()) set 0000000099c81c97 going to sleep for 11 seconds 00000100:00100000:3.0:1790945763.285857:0:7508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cda625a6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7508:1877942638489856:0@lo:1000: 00000100:00100000:3.0:1790945763.285905:0:7508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cda625a6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7508:1877942638489984:0@lo:700: 00000100:00100000:3.0:1790945763.285929:0:7508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945763.285956:0:6531:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638489984 00000100:00100000:3.0:1790945763.285960:0:6531:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638489984 00000100:00100000:3.0:1790945763.285990:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790945763.285996:0:6531:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000623b9fe9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7508:x1877942638489984:12345-0@lo:700: 00000100:00100000:3.0:1790945763.286031:0:6531:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000623b9fe9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7508:x1877942638489984:12345-0@lo:700: Request processed in 35us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945763.286037:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790945763.286053:0:7508:0:(client.c:2716:ptlrpc_set_wait()) set 000000008cd6cf36 going to sleep for 11 seconds 00000100:00100000:3.0:1790945763.286064:0:7508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cda625a6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7508:1877942638489984:0@lo:700: 00000100:00100000:3.0:1790945763.286277:0:7508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cda625a6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7508:1877942638490112:0@lo:1000: 00000100:00100000:3.0:1790945763.286303:0:7508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945763.286322:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638490112 00000100:00100000:3.0:1790945763.286325:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638490112 00000100:00100000:3.0:1790945763.286342:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790945763.286347:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000001b6df94c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7508:x1877942638490112:12345-0@lo:1000: 00000100:00100000:3.0:1790945763.286388:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000001b6df94c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7508:x1877942638490112:12345-0@lo:1000: Request processed in 42us (85us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945763.286395:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790945763.286409:0:7508:0:(client.c:2716:ptlrpc_set_wait()) set 0000000012fe9cd9 going to sleep for 11 seconds 00000100:00100000:3.0:1790945763.286421:0:7508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cda625a6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7508:1877942638490112:0@lo:1000: 00000004:00080000:3.0:1790945763.286456:0:7508:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000008cd6cf36 with version 0 00000020:00100000:3.0:1790945763.286469:0:7508:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1790945763.286476:0:7508:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000cda625a6 x1877942638490368/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790945763.286499:0:7508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cda625a6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7508:1877942638490368:0@lo:1000: 00000100:00100000:3.0:1790945763.286535:0:7508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945763.286555:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638490368 00000100:00100000:3.0:1790945763.286558:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638490368 00000100:00100000:3.0:1790945763.286574:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790945763.286578:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000053ea417b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7508:x1877942638490368:12345-0@lo:1000: 00000100:00100000:3.0:1790945763.286871:0:7508:0:(client.c:2716:ptlrpc_set_wait()) set 00000000245f7e9e going to sleep for 11 seconds 00000100:00100000:0.0:1790945763.292297:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638489600 00000100:00100000:0.0:1790945763.292314:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638489600 00000100:00100000:0.0:1790945763.292409:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790945763.292418:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000e607ebda pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:7505:x1877942638489600:12345-0@lo:502: 00000100:00100000:0.0:1790945763.292636:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000e607ebda pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:7505:x1877942638489600:12345-0@lo:502: Request processed in 220us (17022us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945763.292644:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790945763.292713:0:7505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000289c8a97 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:7505:1877942638489600:0@lo:502: 00000020:01000000:0.0:1790945763.292748:0:7505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790945763.292756:0:7505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945763.292758:0:7505:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:0.0:1790945763.292762:0:7505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1790945763.292840:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1790945763.292861:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1790945763.292870:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: 0000000092d1948c/0xd9f4181e0d27ce35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ce3c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945763.292882:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: 0000000092d1948c/0xd9f4181e0d27ce35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ce3c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945763.292892:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1790945763.292894:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9d40af68cd40 from 1 10000000:01000000:0.0:1790945763.292897:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790945763.292926:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: 0000000023ee331e/0xd9f4181e0d27ce5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945763.292934:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: 0000000023ee331e/0xd9f4181e0d27ce5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945763.292949:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: 0000000023ee331e/0xd9f4181e0d27ce5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945763.292967:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fb38b273 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638490496:0@lo:101: 00000100:00100000:0.0:1790945763.293005:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945763.293035:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 00000000541fb938 going to sleep for 11 seconds 00000100:00100000:0.0:1790945763.293048:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638490496 00000100:00100000:0.0:1790945763.293052:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638490496 00000100:00100000:0.0:1790945763.293072:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790945763.293077:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000004f1637f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:6519:x1877942638490496:12345-0@lo:101: 00010000:00010000:0.0:1790945763.293085:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945763.293095:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000541844e0/0xd9f4181e0d27ce66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27ce5f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945763.293113:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000541844e0/0xd9f4181e0d27ce66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27ce5f expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945763.293121:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000541844e0/0xd9f4181e0d27ce66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ce5f expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945763.293130:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000541844e0, rc 0) 00000100:00100000:0.0:1790945763.293187:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000004f1637f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:6519:x1877942638490496:12345-0@lo:101: Request processed in 110us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945763.293193:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790945763.293230:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fb38b273 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638490496:0@lo:101: 00010000:00010000:0.0:1790945763.293240:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: 0000000023ee331e/0xd9f4181e0d27ce5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ce66 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945763.293255:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: 0000000023ee331e/0xd9f4181e0d27ce5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27ce66 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945763.293295:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fb38b273 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638490624:0@lo:501: 00000100:00100000:0.0:1790945763.293316:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945763.293325:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 00000000541fb938 going to sleep for 11 seconds 00000100:00100000:0.0:1790945763.293335:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638490624 00000100:00100000:0.0:1790945763.293338:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638490624 00000100:00100000:0.0:1790945763.293352:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790945763.293357:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000ae295333 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:6519:x1877942638490624:12345-0@lo:501: 00000100:00100000:0.0:1790945763.293409:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000ae295333 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:6519:x1877942638490624:12345-0@lo:501: Request processed in 52us (93us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790945763.293415:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790945763.293436:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fb38b273 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638490624:0@lo:501: 10000000:01000000:0.0:1790945763.293453:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1790945763.293457:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: 0000000023ee331e/0xd9f4181e0d27ce5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ce66 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945763.293462:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: 0000000023ee331e/0xd9f4181e0d27ce5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ce66 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790945763.298854:0:7452:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:3.0:1790945763.298869:0:7452:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1790945763.306724:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000053ea417b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7508:x1877942638490368:12345-0@lo:1000: Request processed in 20136us (20179us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1790945763.306741:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000004:00080000:0.0:1790945763.308616:0:7508:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1790945763.308627:0:7508:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1790945763.308647:0:7508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cda625a6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7508:1877942638490368:0@lo:1000: 00000100:00100000:0.0:1790945763.308751:0:7508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fb38b273 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7508:1877942638490752:0@lo:1000: 00000100:00100000:0.0:1790945763.308813:0:7508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945763.309623:0:7508:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bbd14938 going to sleep for 11 seconds 00000100:00100000:2.0:1790945763.311224:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638490752 00000100:00100000:2.0:1790945763.311236:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638490752 00000100:00100000:2.0:1790945763.311289:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790945763.311297:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000032b660b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7508:x1877942638490752:12345-0@lo:1000: 00000100:00100000:2.0:1790945763.311423:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000032b660b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7508:x1877942638490752:12345-0@lo:1000: Request processed in 127us (2610us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945763.311430:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790945763.311572:0:7508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fb38b273 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7508:1877942638490752:0@lo:1000: 00000040:00080000:0.0:1790945763.311604:0:7508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1790945763.311642:0:7508:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000541fb938 with version 1 00000040:00080000:0.0:1790945763.313816:0:7508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1790945763.313903:0:7508:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1790945763.313908:0:7508:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00080000:2.0:1790945763.314242:0:7506:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000007c84acd7 version 1 rpc_version 1 00000020:00100000:2.0:1790945763.314282:0:7506:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1790945763.314291:0:7506:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000029dce5f9 x1877942638491008/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790945763.314314:0:7506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000029dce5f9 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7506:1877942638491008:0@lo:1000: 00000100:00100000:2.0:1790945763.314385:0:7506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945763.314439:0:7506:0:(client.c:2716:ptlrpc_set_wait()) set 000000000d632667 going to sleep for 11 seconds 00000100:00100000:3.0:1790945763.314617:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638491008 00000100:00100000:3.0:1790945763.314625:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638491008 00000100:00100000:3.0:1790945763.314665:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790945763.314673:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000289c8a97 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7506:x1877942638491008:12345-0@lo:1000: 00000001:00080000:2.0:1790945763.322341:0:7452:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:1.0:1790945763.326037:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000289c8a97 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7506:x1877942638491008:12345-0@lo:1000: Request processed in 11356us (11644us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1790945763.326055:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:2.0:1790945763.329392:0:7506:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1790945763.329403:0:7506:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1790945763.329425:0:7506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000029dce5f9 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7506:1877942638491008:0@lo:1000: 00010000:00010000:2.0:1790945763.809416:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945764.834986:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945765.855602:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945766.884477:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790945767.625511:0:7726:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1790945767.777282:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790945767.778952:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007d9a73a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638491136:0@lo:41: 00000100:00100000:0.0:1790945767.779060:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945767.782874:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638491136 00000100:00100000:2.0:1790945767.782893:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638491136 00000100:00100000:2.0:1790945767.782963:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790945767.782973:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000fb38b273 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638491136:12345-0@lo:41: 00000004:00000024:2.0:1790945767.783015:0:6526:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1790945767.783193:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000fb38b273 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638491136:12345-0@lo:41: Request processed in 221us (4133us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945767.783202:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790945767.783263:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007d9a73a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638491136:0@lo:41: 00010000:00010000:1.0:1790945767.907658:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945768.289982:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000029dce5f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638491264:0@lo:41: 00000100:00100000:2.0:1790945768.290072:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945768.290160:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638491264 00000100:00100000:2.0:1790945768.290184:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638491264 00000100:00100000:2.0:1790945768.290232:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790945768.290241:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005f3867d6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638491264:12345-0@lo:41: 00000004:00000024:2.0:1790945768.290279:0:6526:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1790945768.290391:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005f3867d6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638491264:12345-0@lo:41: Request processed in 150us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945768.290399:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790945768.290453:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000029dce5f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638491264:0@lo:41: 00000100:00100000:2.0:1790945768.292306:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a1bc39a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638491392:0@lo:400: 00000100:00100000:2.0:1790945768.292359:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945768.292439:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790945768.292444:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000068df1a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638491520:0@lo:400: 00000100:00100000:2.0:1790945768.292468:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945768.292497:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638491520 00000100:00100000:2.0:1790945768.292503:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638491520 00000100:00100000:2.0:1790945768.292538:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790945768.292544:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000029dce5f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638491520:12345-0@lo:400: 00000100:00100000:2.0:1790945768.292581:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000029dce5f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638491520:12345-0@lo:400: Request processed in 37us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945768.292602:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790945768.292624:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000029ba5d9c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638491648:0@lo:400: 00000100:00100000:2.0:1790945768.292646:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945768.292662:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790945768.292666:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004cc4a06f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638491776:0@lo:400: 00000100:00100000:2.0:1790945768.292709:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945768.292729:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638491776 00000100:00100000:2.0:1790945768.292732:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638491776 00000100:00100000:2.0:1790945768.292749:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790945768.292753:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000356744b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638491776:12345-0@lo:400: 00000100:00100000:2.0:1790945768.292779:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000356744b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638491776:12345-0@lo:400: Request processed in 26us (70us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945768.292784:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1790945768.292818:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000004cc4a06f x1877942638491776/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945768.292830:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004cc4a06f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638491776:0@lo:400: 00010000:00080000:2.0:1790945768.292850:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000068df1a3 x1877942638491520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945768.292858:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000068df1a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638491520:0@lo:400: 00000100:00100000:2.0:1790945768.292871:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638491648 00000100:00100000:2.0:1790945768.292873:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638491648 00000100:00100000:2.0:1790945768.292891:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790945768.292896:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000070ab42b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638491648:12345-0@lo:400: 00000100:00100000:2.0:1790945768.292924:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000070ab42b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638491648:12345-0@lo:400: Request processed in 28us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945768.292937:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790945768.292959:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000029ba5d9c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638491648:0@lo:400: 00000100:00100000:0.0:1790945768.293207:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638491392 00000100:00100000:0.0:1790945768.293211:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638491392 00000100:00100000:0.0:1790945768.293240:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790945768.293245:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000621e6267 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:3647:x1877942638491392:12345-0@lo:400: 00000100:00100000:0.0:1790945768.293275:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000621e6267 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:3647:x1877942638491392:12345-0@lo:400: Request processed in 31us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945768.293280:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790945768.293366:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a1bc39a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638491392:0@lo:400: 00000020:00000004:2.0:1790945768.586979:0:7778:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790945768.587219:0:7778:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790945768.931184:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945769.952800:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945770.975688:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1790945771.588664:0:7880:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790945771.588859:0:7880:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790945771.999676:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790945772.660901:0:7928:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffcd91c840 20000000:00000080:3.0:1790945772.660919:0:7928:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d40bc2a7000 uarg=0000000000000000 20000000:01000000:3.0:1790945772.660962:0:7928:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1790945772.660969:0:7928:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1790945772.660974:0:7928:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1790945772.661045:0:7928:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1790945772.661056:0:7928:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1790945772.666137:0:7928:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790945772.669148:0:7928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1790945772.669231:0:7928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1790945772.669250:0:7928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1790945772.669267:0:7928:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790945772.669288:0:7928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000dea7a166/0xd9f4181e0d27ce6d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945772.669307:0:7928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000087760eb3/0xd9f4181e0d27ccec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27cce5 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945772.669314:0:7928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007a364e35/0xd9f4181e0d27cdda lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27cdd3 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945772.669321:0:7928:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000dea7a166/0xd9f4181e0d27ce6d lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945772.669371:0:7928:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007a364e35/0xd9f4181e0d27cdda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27cdd3 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945772.669395:0:7928:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: 000000007a364e35/0xd9f4181e0d27cdda lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27cdd3 expref: 17 pid: 6515 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945772.669409:0:7928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000da35019a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7928:1877942638491904:0@lo:104: 00000100:00100000:2.0:1790945772.669820:0:7928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790945772.669887:0:7928:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000087760eb3/0xd9f4181e0d27ccec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27cce5 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945772.669895:0:7928:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: 0000000087760eb3/0xd9f4181e0d27ccec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27cce5 expref: 17 pid: 6514 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945772.669904:0:7928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000014cff365 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7928:1877942638492032:0@lo:104: 00000100:00100000:2.0:1790945772.669924:0:7928:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ee41fa0d going to sleep for 11 seconds 00000100:00100000:3.0:1790945772.670001:0:6504:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1790945772.670021:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945772.670046:0:6504:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638491904 00000100:00100000:3.0:1790945772.670054:0:6504:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638491904 00000100:00100000:3.0:1790945772.670088:0:6504:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638492032 00000100:00100000:3.0:1790945772.670091:0:6504:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638492032 00000100:00100000:3.0:1790945772.670107:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790945772.670122:0:6504:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000028866158 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+4:7928:x1877942638491904:12345-0@lo:104: 00010000:00010000:3.0:1790945772.670135:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: 000000007b91929b/0xd9f4181e0d27cdd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27cdda expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945772.670340:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790945772.670346:0:6504:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000028866158 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+4:7928:x1877942638491904:12345-0@lo:104: Request processed in 226us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945772.670354:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790945772.670624:0:7928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000da35019a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7928:1877942638491904:0@lo:104: 00000100:00100000:3.0:1790945772.670677:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790945772.670684:0:6504:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000e5de1b1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+3:7928:x1877942638492032:12345-0@lo:104: 00010000:00010000:3.0:1790945772.670692:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: 00000000040757f7/0xd9f4181e0d27cce5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27ccec expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945772.670739:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790945772.670743:0:6504:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000e5de1b1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+3:7928:x1877942638492032:12345-0@lo:104: Request processed in 61us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945772.670749:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1790945772.670767:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790945772.670772:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: 000000007b91929b/0xd9f4181e0d27cdd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27cdda expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945772.670779:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007b91929b already unused, calling callback (00000000744480de) 10000000:00010000:3.0:1790945772.670783:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: 000000007b91929b/0xd9f4181e0d27cdd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27cdda expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945772.670791:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: 000000007b91929b/0xd9f4181e0d27cdd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27cdda expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790945772.670798:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: 000000007b91929b/0xd9f4181e0d27cdd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27cdda expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790945772.670809:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790945772.670839:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: 000000007b91929b/0xd9f4181e0d27cdd3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cdda expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945772.670845:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790945772.670861:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: 000000007b91929b/0xd9f4181e0d27cdd3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cdda expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945772.670867:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: 000000007b91929b/0xd9f4181e0d27cdd3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cdda expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945772.670879:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790945772.670881:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: 00000000040757f7/0xd9f4181e0d27cce5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27ccec expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945772.670886:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000040757f7 already unused, calling callback (00000000744480de) 10000000:00010000:3.0:1790945772.670889:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: 00000000040757f7/0xd9f4181e0d27cce5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27ccec expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945772.670894:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: 00000000040757f7/0xd9f4181e0d27cce5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27ccec expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790945772.670899:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: 00000000040757f7/0xd9f4181e0d27cce5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27ccec expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790945772.670903:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790945772.670914:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: 00000000040757f7/0xd9f4181e0d27cce5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ccec expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945772.670920:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790945772.670931:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: 00000000040757f7/0xd9f4181e0d27cce5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ccec expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945772.670936:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: 00000000040757f7/0xd9f4181e0d27cce5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ccec expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945772.670949:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945772.670950:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945772.670952:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945772.670958:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945772.670981:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000224cb39a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638492160:0@lo:103: 00000100:00100000:3.0:1790945772.671013:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945772.671041:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790945772.671047:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002def6ccb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638492288:0@lo:103: 00000100:00100000:3.0:1790945772.671068:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945772.671095:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638492160 00000100:00100000:3.0:1790945772.671099:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638492160 00010000:00010000:3.0:1790945772.671118:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007a364e35/0xd9f4181e0d27cdda lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27cdd3 expref: 18 pid: 6515 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945772.671135:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638492288 00000100:00100000:3.0:1790945772.671138:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638492288 00010000:00010000:3.0:1790945772.671146:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000087760eb3/0xd9f4181e0d27ccec lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27cce5 expref: 19 pid: 6514 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945772.671191:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790945772.671198:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000007d9a73a0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+19:3647:x1877942638492160:12345-0@lo:103: 00010000:00010000:3.0:1790945772.671208:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945772.671211:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007a364e35/0xd9f4181e0d27cdda lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27cdd3 expref: 19 pid: 6515 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945772.671230:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007a364e35/0xd9f4181e0d27cdda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27cdd3 expref: 19 pid: 6515 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945772.671242:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007a364e35/0xd9f4181e0d27cdda lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27cdd3 expref: 19 pid: 6515 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945772.671253:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945772.671280:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000007d9a73a0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:3647:x1877942638492160:12345-0@lo:103: Request processed in 84us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945772.671287:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790945772.671300:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790945772.671305:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000cda625a6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:3647:x1877942638492288:12345-0@lo:103: 00010000:00010000:3.0:1790945772.671313:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945772.671316:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000087760eb3/0xd9f4181e0d27ccec lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27cce5 expref: 17 pid: 6514 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945772.671333:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000087760eb3/0xd9f4181e0d27ccec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27cce5 expref: 17 pid: 6514 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945772.671343:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000dea7a166/0xd9f4181e0d27ce6d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945772.671350:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dea7a166/0xd9f4181e0d27ce6d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945772.671361:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000dea7a166/0xd9f4181e0d27ce6d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945772.671366:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000dea7a166/0xd9f4181e0d27ce6d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945772.671500:0:7928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000087760eb3/0xd9f4181e0d27ccec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27cce5 expref: 17 pid: 6514 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945772.671510:0:7928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000014cff365 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7928:1877942638492032:0@lo:104: 00010000:00010000:3.0:1790945772.671742:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000dea7a166/0xd9f4181e0d27ce6d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945772.671749:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000dea7a166/0xd9f4181e0d27ce6d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945772.671775:0:7928:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000dea7a166/0xd9f4181e0d27ce6d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945772.671784:0:7928:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: 00000000dea7a166/0xd9f4181e0d27ce6d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945772.671789:0:7928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000dea7a166/0xd9f4181e0d27ce6d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945772.674891:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000dea7a166 already unused, calling callback (00000000b60b8e97) 00010000:00010000:3.0:1790945772.674904:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000dea7a166/0xd9f4181e0d27ce6d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945772.674919:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000dea7a166/0xd9f4181e0d27ce6d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945772.674935:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000dea7a166/0xd9f4181e0d27ce6d lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945772.674944:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000dea7a166/0xd9f4181e0d27ce6d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945772.675036:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945772.675114:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000cda625a6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:3647:x1877942638492288:12345-0@lo:103: Request processed in 3804us (4040us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945772.675126:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790945772.675219:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002def6ccb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638492288:0@lo:103: 00000100:00100000:3.0:1790945772.675230:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000224cb39a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638492160:0@lo:103: 00000100:00100000:2.0:1790945772.896790:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000367e5d91 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638492416:0@lo:41: 00000100:00100000:2.0:1790945772.896865:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945772.896942:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638492416 00000100:00100000:2.0:1790945772.896951:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638492416 00000100:00100000:2.0:1790945772.896999:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790945772.897007:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000049b0ce21 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638492416:12345-0@lo:41: 00000004:00000024:2.0:1790945772.897045:0:6526:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1790945772.897093:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000049b0ce21 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638492416:12345-0@lo:41: Request processed in 87us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945772.897100:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790945772.897286:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000367e5d91 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638492416:0@lo:41: 00010000:00010000:3.0:1790945773.023408:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945773.407726:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000060f45df4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638492672:0@lo:400: 00000100:00100000:0.0:1790945773.407726:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000050e9c4f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638492928:0@lo:400: 00000100:00100000:3.0:1790945773.407797:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e199b721 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638492544:0@lo:400: 00000100:00100000:1.0:1790945773.409200:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945773.409266:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000367e5d91 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638493184:0@lo:41: 00000100:00100000:1.0:1790945773.409300:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945773.409341:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790945773.409347:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eb6f774b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638492800:0@lo:400: 00000100:00100000:1.0:1790945773.409369:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945773.409593:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638492672 00000100:00100000:2.0:1790945773.409601:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638492672 00000100:00100000:2.0:1790945773.409645:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790945773.409653:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005dba1930 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638492672:12345-0@lo:400: 00000100:00100000:2.0:1790945773.409707:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005dba1930 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638492672:12345-0@lo:400: Request processed in 55us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945773.409714:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790945773.409803:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638493184 00000100:00100000:1.0:1790945773.409808:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638493184 00000100:00100000:1.0:1790945773.409830:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638492800 00000100:00100000:1.0:1790945773.409833:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638492800 00000100:00100000:1.0:1790945773.409928:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790945773.409935:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000834133db pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638493184:12345-0@lo:41: 00000004:00000024:1.0:1790945773.409968:0:6526:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1790945773.410002:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000834133db pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638493184:12345-0@lo:41: Request processed in 68us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945773.410009:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790945773.410023:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790945773.410028:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000e24bc74c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638492800:12345-0@lo:400: 00000100:00100000:1.0:1790945773.410055:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000e24bc74c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638492800:12345-0@lo:400: Request processed in 27us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945773.410072:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790945773.410156:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eb6f774b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638492800:0@lo:400: 00000100:00100000:1.0:1790945773.410192:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000367e5d91 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638493184:0@lo:41: 00010000:00080000:1.0:1790945773.410205:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000060f45df4 x1877942638492672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945773.410214:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000060f45df4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638492672:0@lo:400: 00000100:00100000:0.0:1790945773.410219:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945773.410257:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638492928 00000100:00100000:0.0:1790945773.410262:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638492928 00000100:00100000:0.0:1790945773.410297:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790945773.410303:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000034aa9057 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638492928:12345-0@lo:400: 00000100:00100000:0.0:1790945773.410371:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000034aa9057 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638492928:12345-0@lo:400: Request processed in 69us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945773.410387:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1790945773.410498:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000050e9c4f0 x1877942638492928/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945773.410518:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000050e9c4f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638492928:0@lo:400: 00000100:00100000:3.0:1790945773.417723:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945773.417809:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d67899ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638493056:0@lo:400: 00000100:00100000:0.0:1790945773.417859:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638492544 00000100:00100000:0.0:1790945773.417868:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638492544 00000100:00100000:0.0:1790945773.417927:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790945773.417936:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005bbc84bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:3650:x1877942638492544:12345-0@lo:400: 00000100:00100000:0.0:1790945773.418000:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005bbc84bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:3650:x1877942638492544:12345-0@lo:400: Request processed in 66us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945773.418007:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790945773.419270:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945773.420267:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e199b721 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638492544:0@lo:400: 00000100:00100000:1.0:1790945773.425775:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638493056 00000100:00100000:1.0:1790945773.425791:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638493056 00000100:00100000:1.0:1790945773.425861:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790945773.425869:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000224cb39a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638493056:12345-0@lo:400: 00000100:00100000:1.0:1790945773.425975:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000224cb39a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638493056:12345-0@lo:400: Request processed in 107us (6709us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945773.425983:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790945773.426125:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d67899ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638493056:0@lo:400: 00010000:00010000:3.0:1790945774.048476:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945775.074286:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945776.097977:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945777.119802:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945778.016807:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002def6ccb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638493312:0@lo:41: 00000100:00100000:0.0:1790945778.016895:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945778.016982:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638493312 00000100:00100000:0.0:1790945778.016990:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638493312 00000100:00100000:0.0:1790945778.017037:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790945778.017044:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000a1bc39a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638493312:12345-0@lo:41: 00000004:00000024:0.0:1790945778.017080:0:6526:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1790945778.017133:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000a1bc39a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638493312:12345-0@lo:41: Request processed in 89us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945778.017141:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790945778.017211:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002def6ccb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638493312:0@lo:41: 00010000:00010000:3.0:1790945778.148370:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945778.527947:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000646bed3b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638493696:0@lo:400: 00000100:00100000:2.0:1790945778.528032:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945778.528082:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790945778.528087:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001671231d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638493824:0@lo:400: 00000100:00100000:2.0:1790945778.528129:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945778.528207:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638493696 00000100:00100000:2.0:1790945778.528223:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638493696 00000100:00100000:2.0:1790945778.528271:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790945778.528281:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000da35019a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638493696:12345-0@lo:400: 00000100:00100000:2.0:1790945778.528336:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000da35019a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638493696:12345-0@lo:400: Request processed in 58us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945778.528343:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790945778.528364:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638493824 00000100:00100000:2.0:1790945778.528367:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638493824 00000100:00100000:2.0:1790945778.528392:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790945778.528397:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000996a0471 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638493824:12345-0@lo:400: 00000100:00100000:2.0:1790945778.528426:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000996a0471 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638493824:12345-0@lo:400: Request processed in 29us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945778.528432:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790945778.528470:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001671231d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638493824:0@lo:400: 00010000:00080000:2.0:1790945778.528482:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000646bed3b x1877942638493696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945778.528490:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000646bed3b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638493696:0@lo:400: 00000100:00100000:1.0:1790945778.528698:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d6ed8592 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638493440:0@lo:41: 00000100:00100000:1.0:1790945778.528730:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945778.528761:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000367e5d91 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638493952:0@lo:400: 00000100:00100000:1.0:1790945778.528785:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945778.528809:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790945778.528815:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d645e3e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638493568:0@lo:400: 00000100:00100000:1.0:1790945778.528856:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945778.528877:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000014cff365 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638494080:0@lo:400: 00000100:00100000:1.0:1790945778.528897:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945778.528922:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638493952 00000100:00100000:1.0:1790945778.528926:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638493952 00000100:00100000:1.0:1790945778.528953:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790945778.528959:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000060f45df4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638493952:12345-0@lo:400: 00000100:00100000:1.0:1790945778.528995:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000060f45df4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638493952:12345-0@lo:400: Request processed in 37us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945778.529001:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790945778.529018:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638493440 00000100:00100000:1.0:1790945778.529021:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638493440 00000100:00100000:1.0:1790945778.529035:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638494080 00000100:00100000:1.0:1790945778.529038:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638494080 00000100:00100000:1.0:1790945778.529049:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790945778.529053:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000050e9c4f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1877942638493440:12345-0@lo:41: 00000004:00000024:1.0:1790945778.529080:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1790945778.529109:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000050e9c4f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1877942638493440:12345-0@lo:41: Request processed in 55us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945778.529114:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790945778.529124:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790945778.529139:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000eb6f774b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638494080:12345-0@lo:400: 00000100:00100000:1.0:1790945778.529319:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000eb6f774b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638494080:12345-0@lo:400: Request processed in 180us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945778.529326:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790945778.529358:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000014cff365 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638494080:0@lo:400: 00000100:00100000:1.0:1790945778.529372:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d6ed8592 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638493440:0@lo:41: 00010000:00080000:1.0:1790945778.529380:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000367e5d91 x1877942638493952/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945778.529388:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000367e5d91 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638493952:0@lo:400: 00000100:00100000:2.0:1790945778.529779:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638493568 00000100:00100000:2.0:1790945778.529786:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638493568 00000100:00100000:2.0:1790945778.529825:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790945778.529843:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000078edfb31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:3649:x1877942638493568:12345-0@lo:400: 00000100:00100000:2.0:1790945778.530005:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000078edfb31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:3649:x1877942638493568:12345-0@lo:400: Request processed in 163us (1161us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945778.530012:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790945778.530081:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d645e3e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638493568:0@lo:400: 00010000:00010000:2.0:1790945779.169915:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945780.193295:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945781.216762:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790945781.600561:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790945781.600569:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d40bacd0800 from 1 10000000:01000000:0.0:1790945781.600573:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790945781.600615:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: 0000000090773e7e/0xd9f4181e0d27ce74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945781.600627:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: 0000000090773e7e/0xd9f4181e0d27ce74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945781.600649:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: 0000000090773e7e/0xd9f4181e0d27ce74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945781.600670:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000029ba5d9c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638494208:0@lo:101: 00000100:00100000:0.0:1790945781.600742:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945781.600785:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 0000000095e737b3 going to sleep for 11 seconds 00000100:00100000:1.0:1790945781.601507:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638494208 00000100:00100000:1.0:1790945781.601517:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638494208 00000100:00100000:1.0:1790945781.601581:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790945781.601589:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000006978886f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:6519:x1877942638494208:12345-0@lo:101: 00010000:00010000:1.0:1790945781.601603:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945781.601617:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000899aafd8/0xd9f4181e0d27ce7b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27ce74 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945781.601639:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000899aafd8/0xd9f4181e0d27ce7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27ce74 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945781.601649:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000899aafd8/0xd9f4181e0d27ce7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ce74 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945781.601657:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000899aafd8, rc 0) 00000100:00100000:1.0:1790945781.601712:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000006978886f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:6519:x1877942638494208:12345-0@lo:101: Request processed in 125us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945781.601719:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790945781.601991:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000029ba5d9c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638494208:0@lo:101: 00010000:00010000:0.0:1790945781.602008:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: 0000000090773e7e/0xd9f4181e0d27ce74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ce7b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945781.602016:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: 0000000090773e7e/0xd9f4181e0d27ce74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27ce7b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945781.602077:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000029ba5d9c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638494336:0@lo:501: 00000100:00100000:0.0:1790945781.602104:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945781.602677:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 0000000095e737b3 going to sleep for 11 seconds 00000100:00100000:1.0:1790945781.602909:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638494336 00000100:00100000:1.0:1790945781.602916:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638494336 00000100:00100000:1.0:1790945781.602955:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790945781.602962:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000003122bbe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:6519:x1877942638494336:12345-0@lo:501: 00000100:00100000:1.0:1790945781.603097:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000003122bbe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:6519:x1877942638494336:12345-0@lo:501: Request processed in 136us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945781.603105:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790945781.603181:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000029ba5d9c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638494336:0@lo:501: 00000100:00100000:1.0:1790945781.603218:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c737838f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638494464:0@lo:503: 00000100:00100000:1.0:1790945781.603277:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945781.603296:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 000000004ccc128a going to sleep for 11 seconds 00000100:00100000:1.0:1790945781.603306:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638494464 00000100:00100000:1.0:1790945781.603309:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638494464 00000100:00100000:1.0:1790945781.603328:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790945781.603332:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000003f55aaa8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:6519:x1877942638494464:12345-0@lo:503: 00000100:00100000:1.0:1790945781.603403:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000003f55aaa8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:6519:x1877942638494464:12345-0@lo:503: Request processed in 70us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945781.603409:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790945781.603448:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c737838f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638494464:0@lo:503: 00000100:00100000:1.0:1790945781.603706:0:8377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c737838f pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:8377:1877942638494592:0@lo:502: 00000100:00100000:1.0:1790945781.603739:0:8377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945781.603756:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638494592 00000100:00100000:1.0:1790945781.603760:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638494592 00000100:00100000:1.0:1790945781.603974:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790945781.603983:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000001a25aed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:8377:x1877942638494592:12345-0@lo:502: 00000100:00100000:1.0:1790945781.604051:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000001a25aed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:8377:x1877942638494592:12345-0@lo:502: Request processed in 70us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945781.604057:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790945781.604086:0:8377:0:(client.c:2716:ptlrpc_set_wait()) set 00000000775b6080 going to sleep for 11 seconds 00000100:00100000:1.0:1790945781.604097:0:8377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c737838f pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:8377:1877942638494592:0@lo:502: 00000020:01000000:1.0:1790945781.604973:0:8377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790945781.604986:0:8377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790945781.604989:0:8377:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790945781.604996:0:8377:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d40bacd0800 00000020:00000080:1.0:1790945781.604999:0:8377:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790945781.605052:0:8377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacedc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:8377:1877942638494720:0@lo:502: 00000100:00100000:1.0:1790945781.605098:0:8377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945781.606896:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638494720 00000100:00100000:1.0:1790945781.606910:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638494720 00000100:00100000:1.0:1790945781.606963:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790945781.606971:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087034050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:8377:x1877942638494720:12345-0@lo:502: 00000100:00100000:1.0:1790945781.607981:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087034050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:8377:x1877942638494720:12345-0@lo:502: Request processed in 147us (2020us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945781.607993:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790945781.608058:0:8377:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40af660180 going to sleep for 11 seconds 00000100:00100000:1.0:1790945781.608083:0:8377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacedc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:8377:1877942638494720:0@lo:502: 00000020:01000000:1.0:1790945781.608114:0:8377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790945781.608134:0:8377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790945781.608136:0:8377:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1790945781.608141:0:8377:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1790945781.608241:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1790945781.608268:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790945781.608277:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d000/0xd9f4181e0d27ce74 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ce7b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945781.608289:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d000/0xd9f4181e0d27ce74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ce7b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945781.608299:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790945781.608301:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d4087223000 from 1 10000000:01000000:1.0:1790945781.608304:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790945781.608330:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6a00/0xd9f4181e0d27ce82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945781.608337:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6a00/0xd9f4181e0d27ce82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945781.608346:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6a00/0xd9f4181e0d27ce82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945781.608361:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638494848:0@lo:101: 00000100:00100000:1.0:1790945781.608396:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945781.608415:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40af660180 going to sleep for 11 seconds 00000100:00100000:1.0:1790945781.608427:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638494848 00000100:00100000:1.0:1790945781.608432:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638494848 00000100:00100000:1.0:1790945781.608454:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790945781.608461:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087034450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:6519:x1877942638494848:12345-0@lo:101: 00010000:00010000:1.0:1790945781.610322:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945781.610350:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40c21d7000/0xd9f4181e0d27ce89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27ce82 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945781.610382:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40c21d7000/0xd9f4181e0d27ce89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27ce82 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945781.610408:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40c21d7000/0xd9f4181e0d27ce89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ce82 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945781.610417:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40c21d7000, rc 0) 00000100:00100000:1.0:1790945781.612924:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087034450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:6519:x1877942638494848:12345-0@lo:101: Request processed in 4453us (4517us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945781.612936:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790945781.613031:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638494848:0@lo:101: 00010000:00010000:1.0:1790945781.613056:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6a00/0xd9f4181e0d27ce82 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ce89 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945781.613069:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6a00/0xd9f4181e0d27ce82 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27ce89 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945781.615022:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638494976:0@lo:501: 00000100:00100000:1.0:1790945781.615096:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945781.615362:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638494976 00000100:00100000:3.0:1790945781.615370:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638494976 00000100:00100000:3.0:1790945781.615437:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790945781.615446:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087035850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:6519:x1877942638494976:12345-0@lo:501: 00000100:00100000:1.0:1790945781.618907:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40af660180 going to sleep for 11 seconds 00000100:00100000:3.0:1790945781.635927:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087035850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:6519:x1877942638494976:12345-0@lo:501: Request processed in 20472us (20821us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945781.635941:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790945781.635990:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638494976:0@lo:501: 00000100:00100000:1.0:1790945781.636060:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638495104:0@lo:503: 00000100:00100000:1.0:1790945781.636121:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945781.636208:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40af660180 going to sleep for 11 seconds 00000100:00100000:3.0:1790945781.636576:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638495104 00000100:00100000:3.0:1790945781.636583:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638495104 00000100:00100000:3.0:1790945781.636632:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790945781.636641:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:6519:x1877942638495104:12345-0@lo:503: 00000100:00100000:3.0:1790945781.636762:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:6519:x1877942638495104:12345-0@lo:503: Request processed in 122us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945781.636769:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790945781.636830:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638495104:0@lo:503: 00000100:00100000:3.0:1790945781.639565:0:8380:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d408aa8ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:8380:1877942638495232:0@lo:502: 00000100:00100000:3.0:1790945781.639646:0:8380:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945781.639700:0:8380:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4d07180 going to sleep for 11 seconds 00000100:00100000:1.0:1790945781.639719:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638495232 00000100:00100000:1.0:1790945781.639727:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638495232 00000100:00100000:1.0:1790945781.639784:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790945781.639800:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:8380:x1877942638495232:12345-0@lo:502: 00000100:00100000:1.0:1790945781.639904:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:8380:x1877942638495232:12345-0@lo:502: Request processed in 105us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945781.639911:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790945781.640102:0:8380:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d408aa8ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:8380:1877942638495232:0@lo:502: 00000020:01000000:3.0:1790945781.640134:0:8380:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790945781.640142:0:8380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945781.640144:0:8380:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790945781.640163:0:8380:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d4087223000 00000020:00000080:3.0:1790945781.640166:0:8380:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790945781.640204:0:8380:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d408aa8ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:8380:1877942638495360:0@lo:502: 00000100:00100000:3.0:1790945781.640239:0:8380:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945781.640266:0:8380:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4d07180 going to sleep for 11 seconds 00000100:00100000:1.0:1790945781.640375:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638495360 00000100:00100000:1.0:1790945781.640380:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638495360 00000100:00100000:1.0:1790945781.640411:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790945781.640418:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087033050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:8380:x1877942638495360:12345-0@lo:502: 00000100:00100000:1.0:1790945781.640485:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087033050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:8380:x1877942638495360:12345-0@lo:502: Request processed in 67us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945781.640491:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790945781.640567:0:8380:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d408aa8ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:8380:1877942638495360:0@lo:502: 00000020:01000000:3.0:1790945781.640585:0:8380:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790945781.640590:0:8380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945781.640592:0:8380:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1790945781.640595:0:8380:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1790945781.640870:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1790945781.640890:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790945781.640900:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6a00/0xd9f4181e0d27ce82 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ce89 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945781.640911:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6a00/0xd9f4181e0d27ce82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ce89 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945782.242155:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790945782.523111:0:8428:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790945782.523116:0:8428:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1790945782.523117:0:8428:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1790945782.523276:0:8428:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9d40bc9be000 00000020:01000004:0.0:1790945782.523294:0:8428:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1790945782.523306:0:8428:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1790945782.523321:0:8428:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9d40bc9e4d40) 00000020:00000080:0.0:1790945782.523339:0:8428:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1790945782.582309:0:8428:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1790945782.582375:0:8428:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1790945782.627471:0:8428:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1790945782.627712:0:8428:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1790945782.627725:0:8428:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790945782.627737:0:8428:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd9f4181e0d27ce97 00000020:01000004:2.0:1790945782.627743:0:8428:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1790945782.628005:0:8428:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.120@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790945782.628023:0:8428:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790945782.628032:0:8428:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1790945782.628038:0:8428:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1790945782.628052:0:8428:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9d40b4a419c0) 00000020:00000080:2.0:1790945782.628064:0:8428:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1790945782.635725:0:8428:0:(service.c:173:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790945782.636646:0:8428:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1790945782.636652:0:8428:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1790945782.654205:0:8428:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1790945782.654223:0:8428:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1790945782.654671:0:8428:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1790945782.654677:0:8428:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1790945782.662572:0:8428:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790945782.662838:0:8428:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1790945782.662845:0:8428:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1790945782.663947:0:8428:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1790945782.663956:0:8428:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1790945782.715641:0:8428:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790945782.716198:0:8428:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1790945782.716209:0:8428:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1790945782.720812:0:8428:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790945782.720828:0:8428:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1790945782.729364:0:8428:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1790945782.729384:0:8428:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1790945782.731627:0:8428:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790945782.731821:0:8428:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1790945782.731827:0:8428:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1790945782.734473:0:8428:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1790945782.734488:0:8428:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1790945782.812111:0:8428:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790945782.812348:0:8428:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1790945782.812354:0:8428:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1790945782.827257:0:8428:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1790945782.834047:0:8428:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1790945782.834986:0:8428:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1790945782.835031:0:8428:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1790945782.835050:0:8428:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.120@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1790945782.896652:0:8428:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.120@tcp ctxt 0 is initialized 00000020:01000004:0.0:1790945782.896706:0:8428:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.120@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1790945782.896710:0:8428:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1790945782.896712:0:8428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790945782.896717:0:8428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790945782.896719:0:8428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790945782.896720:0:8428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790945782.896721:0:8428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790945782.896723:0:8428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790945782.896724:0:8428:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790945782.896725:0:8428:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790945782.896727:0:8428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790945782.896728:0:8428:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790945782.896732:0:8428:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1790945782.896734:0:8428:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790945782.896736:0:8428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790945782.896737:0:8428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790945782.896738:0:8428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790945782.896738:0:8428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790945782.896739:0:8428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790945782.896740:0:8428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790945782.896741:0:8428:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790945782.896742:0:8428:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790945782.896743:0:8428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790945782.896744:0:8428:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790945782.896852:0:8428:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1790945782.896875:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40accd1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:8428:1877942638495488:0@lo:253: 00000100:00100000:0.0:1790945782.896974:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945782.897082:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bcbcde40 going to sleep for 11 seconds 00000100:00100000:3.0:1790945782.898062:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638495488 00000100:00100000:3.0:1790945782.898076:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638495488 00000100:00100000:3.0:1790945782.898197:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790945782.898207:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:8428:x1877942638495488:12345-0@lo:253: 20000000:01000000:3.0:1790945782.898272:0:6515:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1790945782.898277:0:6515:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1790945782.898283:0:6515:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1790945782.898285:0:6515:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1790945782.898818:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790945782.898969:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1790945782.898986:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1790945782.899005:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1790945782.899010:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1790945782.899336:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1790945782.899362:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1790945782.899684:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1790945782.899703:0:6515:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.120@tcp 20000000:01000000:3.0:1790945782.899705:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.120@tcp (null) (null) (null) 00000040:00080000:3.0:1790945782.899722:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1790945782.899729:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1790945782.899745:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1790945782.899752:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.120@tcp (null) (null) 00000040:00080000:3.0:1790945782.899838:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1790945782.899847:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1790945782.899862:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1790945782.899876:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1790945782.899943:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:3.0:1790945782.899953:0:6515:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.120@tcp 20000000:01000000:3.0:1790945782.899956:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.120@tcp (null) (null) (null) 00000040:00080000:3.0:1790945782.899967:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:3.0:1790945782.899985:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1790945782.900001:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:3.0:1790945782.900007:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.204.120@tcp (null) (null) 00000040:00080000:3.0:1790945782.900037:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:3.0:1790945782.900045:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1790945782.900060:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:3.0:1790945782.900074:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:3.0:1790945782.900940:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:3.0:1790945782.900960:0:6515:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.120@tcp 20000000:01000000:3.0:1790945782.900962:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.120@tcp (null) (null) (null) 00000040:00080000:3.0:1790945782.900979:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:3.0:1790945782.900986:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1790945782.901001:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:3.0:1790945782.901007:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.120@tcp (null) (null) 00000040:00080000:3.0:1790945782.901150:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:3.0:1790945782.901159:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1790945782.901734:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:3.0:1790945782.901890:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:3.0:1790945782.901914:0:6515:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1790945782.901917:0:6515:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1790945782.901921:0:6515:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1790945782.901967:0:6515:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1790945782.901970:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1790945782.903780:0:8447:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:1.0:1790945782.903833:0:8447:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:1.0:1790945782.903851:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1790945782.904138:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1790945782.904161:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1790945782.904209:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1790945782.904220:0:6515:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1790945782.904223:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1790945782.904616:0:8448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:1.0:1790945782.904637:0:8448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:1.0:1790945782.904651:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1790945782.904889:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:3.0:1790945782.904910:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:3.0:1790945782.904924:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:3.0:1790945782.904934:0:6515:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1790945782.904942:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1790945782.905385:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1790945782.905523:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1790945782.905540:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1790945782.905553:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1790945782.905634:0:6515:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1790945782.905637:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1790945782.905923:0:8450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:1.0:1790945782.905946:0:8450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:1.0:1790945782.905959:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:3.0:1790945782.906085:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:3.0:1790945782.906103:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:3.0:1790945782.906116:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 10000000:01000000:3.0:1790945782.908143:0:6515:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1790945782.908243:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d40baef1e00/0xd9f4181e0d27cea5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945782.908261:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d4086a4d600/0xd9f4181e0d27cd71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27cd6a expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945782.908269:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40baef1000/0xd9f4181e0d27cde8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27cde1 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945782.908276:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27ce20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ce19 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945782.908283:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40baef0800/0xd9f4181e0d27ce3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ce35 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945782.908289:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d4086a4ce00/0xd9f4181e0d27ce66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ce5f expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945782.908297:0:6515:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d40baef1e00/0xd9f4181e0d27cea5 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945782.908342:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d4086a4ce00/0xd9f4181e0d27ce66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27ce5f expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945782.908377:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d4086a4ce00/0xd9f4181e0d27ce66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27ce5f expref: 18 pid: 6515 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945782.908392:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d408aa8ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1877942638495616:0@lo:104: 00000100:00100000:3.0:1790945782.908482:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790945782.908547:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40baef0800/0xd9f4181e0d27ce3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27ce35 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945782.908556:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40baef0800/0xd9f4181e0d27ce3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27ce35 expref: 18 pid: 6514 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945782.908565:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd2d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1877942638495744:0@lo:104: 00000100:00100000:3.0:1790945782.908587:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790945782.908675:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27ce20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27ce19 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945782.908683:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27ce20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27ce19 expref: 18 pid: 6515 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945782.908692:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd3100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1877942638495872:0@lo:104: 00000100:00100000:3.0:1790945782.908718:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790945782.926996:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40baef1000/0xd9f4181e0d27cde8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27cde1 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945782.927030:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40baef1000/0xd9f4181e0d27cde8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27cde1 expref: 18 pid: 6516 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945782.927050:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd2680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1877942638496000:0@lo:104: 00000100:00100000:3.0:1790945782.927162:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945782.927530:0:6504:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638495616 00000100:00100000:1.0:1790945782.927541:0:6504:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638495616 00000100:00100000:1.0:1790945782.927603:0:6504:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638495744 00000100:00100000:1.0:1790945782.927606:0:6504:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638495744 00000100:00100000:1.0:1790945782.927617:0:6504:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638495872 00000100:00100000:1.0:1790945782.927620:0:6504:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638495872 00000100:00100000:1.0:1790945782.927637:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790945782.927646:0:6504:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+5:6515:x1877942638495616:12345-0@lo:104: 00010000:00010000:1.0:1790945782.927664:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d4086a4c200/0xd9f4181e0d27ce5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27ce66 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945782.927751:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790945782.927757:0:6504:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+5:6515:x1877942638495616:12345-0@lo:104: Request processed in 113us (19277us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945782.927888:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790945782.927910:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790945782.927916:0:6504:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+4:6515:x1877942638495744:12345-0@lo:104: 00010000:00010000:1.0:1790945782.927924:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27ce35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27ce3c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945782.927967:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790945782.927973:0:6504:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+4:6515:x1877942638495744:12345-0@lo:104: Request processed in 57us (19385us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945782.927979:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790945782.927994:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790945782.928000:0:6504:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+3:6515:x1877942638495872:12345-0@lo:104: 00010000:00010000:1.0:1790945782.928015:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d4086a4ca00/0xd9f4181e0d27ce19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27ce20 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945782.928058:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1790945782.928063:0:6504:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+3:6515:x1877942638495872:12345-0@lo:104: Request processed in 64us (19345us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945782.928068:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1790945782.928345:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790945782.928353:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d4086a4c200/0xd9f4181e0d27ce5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27ce66 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945782.928372:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4086a4c200 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:2.0:1790945782.928377:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d4086a4c200/0xd9f4181e0d27ce5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27ce66 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945782.928386:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d4086a4c200/0xd9f4181e0d27ce5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27ce66 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790945782.928393:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d4086a4c200/0xd9f4181e0d27ce5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27ce66 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945782.928399:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790945782.928445:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d4086a4c200/0xd9f4181e0d27ce5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ce66 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945782.928452:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790945782.928470:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d4086a4c200/0xd9f4181e0d27ce5f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ce66 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945782.928477:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d4086a4c200/0xd9f4181e0d27ce5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ce66 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945782.928489:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790945782.928493:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27ce35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27ce3c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945782.928499:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d6200 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:2.0:1790945782.928502:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27ce35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27ce3c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945782.928518:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27ce35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27ce3c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790945782.928524:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27ce35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27ce3c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945782.928529:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790945782.928544:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27ce35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ce3c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945782.928549:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790945782.928555:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27ce35 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ce3c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945782.928561:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27ce35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ce3c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945782.928570:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790945782.928573:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d4086a4ca00/0xd9f4181e0d27ce19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27ce20 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945782.928578:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4086a4ca00 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:2.0:1790945782.928581:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d4086a4ca00/0xd9f4181e0d27ce19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27ce20 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945782.928586:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d4086a4ca00/0xd9f4181e0d27ce19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27ce20 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790945782.928591:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d4086a4ca00/0xd9f4181e0d27ce19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27ce20 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945782.928604:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790945782.928619:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d4086a4ca00/0xd9f4181e0d27ce19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ce20 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945782.928624:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790945782.928639:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d4086a4ca00/0xd9f4181e0d27ce19 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ce20 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945782.928646:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d4086a4ca00/0xd9f4181e0d27ce19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ce20 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945782.928654:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945782.928655:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945782.928657:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945782.928676:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638496128:0@lo:103: 00000100:00100000:2.0:1790945782.928902:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945782.928946:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790945782.928953:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638496256:0@lo:103: 00000100:00100000:2.0:1790945782.928973:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945782.929000:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638496384:0@lo:103: 00000100:00100000:2.0:1790945782.929018:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945782.929075:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638496128 00000100:00100000:1.0:1790945782.929082:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638496128 00010000:00010000:1.0:1790945782.929105:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d4086a4ce00/0xd9f4181e0d27ce66 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27ce5f expref: 19 pid: 6515 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945782.929140:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638496256 00000100:00100000:1.0:1790945782.929144:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638496256 00010000:00010000:1.0:1790945782.929154:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40baef0800/0xd9f4181e0d27ce3c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27ce35 expref: 20 pid: 6514 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945782.929163:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638496384 00000100:00100000:1.0:1790945782.929185:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638496384 00010000:00010000:1.0:1790945782.929194:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27ce20 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27ce19 expref: 21 pid: 6515 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945782.929206:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790945782.929211:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:3647:x1877942638496128:12345-0@lo:103: 00010000:00010000:1.0:1790945782.929221:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945782.929225:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d4086a4ce00/0xd9f4181e0d27ce66 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27ce5f expref: 21 pid: 6515 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945782.929234:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d4086a4ce00/0xd9f4181e0d27ce66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27ce5f expref: 21 pid: 6515 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945782.929260:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945782.929290:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:3647:x1877942638496128:12345-0@lo:103: Request processed in 79us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945782.929297:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790945782.929312:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790945782.929318:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+20:3647:x1877942638496256:12345-0@lo:103: 00010000:00010000:1.0:1790945782.929325:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945782.929330:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40baef0800/0xd9f4181e0d27ce3c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27ce35 expref: 20 pid: 6514 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945782.929337:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40baef0800/0xd9f4181e0d27ce3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27ce35 expref: 20 pid: 6514 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945782.929346:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945782.929367:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+20:3647:x1877942638496256:12345-0@lo:103: Request processed in 50us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945782.929373:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790945782.929385:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790945782.929390:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+19:3649:x1877942638496384:12345-0@lo:103: 00010000:00010000:1.0:1790945782.929397:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945782.929401:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27ce20 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27ce19 expref: 19 pid: 6515 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945782.929409:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27ce20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27ce19 expref: 19 pid: 6515 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945782.929418:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945782.929449:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+19:3649:x1877942638496384:12345-0@lo:103: Request processed in 58us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945782.929454:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790945782.929533:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638496384:0@lo:103: 00000100:00100000:2.0:1790945782.929554:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638496256:0@lo:103: 00000100:00100000:2.0:1790945782.929561:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638496128:0@lo:103: 00010000:00010000:0.0:1790945782.930231:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945782.930468:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d4086a4d600/0xd9f4181e0d27cd71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27cd6a expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945782.930483:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d4086a4d600/0xd9f4181e0d27cd71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27cd6a expref: 18 pid: 6515 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945782.930493:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1877942638496512:0@lo:104: 00000100:00100000:3.0:1790945782.930528:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945782.930657:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40baeab6c0 going to sleep for 11 seconds 00010000:00010000:3.0:1790945782.930678:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d4086a4ce00/0xd9f4181e0d27ce66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27ce5f expref: 18 pid: 6515 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945782.930701:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d408aa8ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1877942638495616:0@lo:104: 00010000:00010000:3.0:1790945782.930714:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40baef0800/0xd9f4181e0d27ce3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27ce35 expref: 17 pid: 6514 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945782.930722:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd2d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1877942638495744:0@lo:104: 00010000:00010000:3.0:1790945782.930732:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27ce20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27ce19 expref: 16 pid: 6515 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945782.930739:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd3100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1877942638495872:0@lo:104: 00000100:00100000:0.0:1790945782.930929:0:6505:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638496000 00000100:00100000:0.0:1790945782.930935:0:6505:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638496000 00000100:00100000:0.0:1790945782.930968:0:6505:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638496512 00000100:00100000:0.0:1790945782.930970:0:6505:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638496512 00000100:00100000:0.0:1790945782.930983:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790945782.930992:0:6505:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+4:6515:x1877942638496000:12345-0@lo:104: 00010000:00010000:0.0:1790945782.931005:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d40813ff200/0xd9f4181e0d27cde1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27cde8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945782.931197:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790945782.931216:0:6505:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+4:6515:x1877942638496000:12345-0@lo:104: Request processed in 225us (4055us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945782.931223:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790945782.931239:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790945782.931245:0:6505:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+3:6515:x1877942638496512:12345-0@lo:104: 00010000:00010000:0.0:1790945782.931265:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7600/0xd9f4181e0d27cd6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27cd71 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945782.931300:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790945782.931305:0:6505:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+3:6515:x1877942638496512:12345-0@lo:104: Request processed in 61us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945782.931311:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1790945782.931326:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790945782.931331:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40813ff200/0xd9f4181e0d27cde1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27cde8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945782.931338:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40813ff200 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:0.0:1790945782.931343:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40813ff200/0xd9f4181e0d27cde1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27cde8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945782.931352:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40813ff200/0xd9f4181e0d27cde1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27cde8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790945782.931360:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40813ff200/0xd9f4181e0d27cde1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27cde8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945782.931380:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790945782.931411:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40813ff200/0xd9f4181e0d27cde1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cde8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945782.931429:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790945782.931445:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40813ff200/0xd9f4181e0d27cde1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cde8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945782.931452:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40813ff200/0xd9f4181e0d27cde1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cde8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945782.931465:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790945782.931468:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7600/0xd9f4181e0d27cd6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27cd71 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945782.931474:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d7600 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:0.0:1790945782.931478:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7600/0xd9f4181e0d27cd6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27cd71 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945782.931485:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7600/0xd9f4181e0d27cd6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27cd71 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790945782.931490:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7600/0xd9f4181e0d27cd6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27cd71 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945782.931496:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790945782.931508:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7600/0xd9f4181e0d27cd6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cd71 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945782.931513:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790945782.931522:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7600/0xd9f4181e0d27cd6a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cd71 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945782.931529:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7600/0xd9f4181e0d27cd6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cd71 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945782.931548:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945782.931550:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945782.931552:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945782.931775:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40accd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638496640:0@lo:103: 00000100:00100000:0.0:1790945782.931807:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945782.931846:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638496640 00000100:00100000:0.0:1790945782.931850:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638496640 00010000:00010000:0.0:1790945782.931867:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40baef1000/0xd9f4181e0d27cde8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27cde1 expref: 16 pid: 6516 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945782.931886:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790945782.931892:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40accd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:3650:x1877942638496640:12345-0@lo:103: 00010000:00010000:0.0:1790945782.931902:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945782.931906:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40baef1000/0xd9f4181e0d27cde8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27cde1 expref: 16 pid: 6516 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945782.931914:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40baef1000/0xd9f4181e0d27cde8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27cde1 expref: 16 pid: 6516 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945782.931929:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945782.931956:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40accd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:3650:x1877942638496640:12345-0@lo:103: Request processed in 65us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945782.931962:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790945782.931990:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40accd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638496640:0@lo:103: 00000100:00100000:2.0:1790945782.932089:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790945782.932100:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40accd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8841fcfb-fb47-4307-92c2-97500c1c82bd:3648:1877942638496768:0@lo:103: 00000100:00100000:2.0:1790945782.932147:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790945782.932198:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40baef1000/0xd9f4181e0d27cde8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27cde1 expref: 15 pid: 6516 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945782.932209:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945782.932211:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd2680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1877942638496000:0@lo:104: 00000100:00100000:3.0:1790945782.932219:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1877942638496512:0@lo:104: 00010000:00010000:3.0:1790945782.932245:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d40baef1e00/0xd9f4181e0d27cea5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945782.932520:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638496768 00000100:00100000:0.0:1790945782.932525:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638496768 00010000:00010000:0.0:1790945782.932546:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d4086a4d600/0xd9f4181e0d27cd71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27cd6a expref: 15 pid: 6515 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945782.932758:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790945782.932838:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4096cbc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:3648:x1877942638496768:12345-0@lo:103: 00010000:00010000:0.0:1790945782.932848:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945782.932853:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d4086a4d600/0xd9f4181e0d27cd71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27cd6a expref: 15 pid: 6515 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945782.932863:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d4086a4d600/0xd9f4181e0d27cd71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27cd6a expref: 15 pid: 6515 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945782.932874:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d4086a4d600/0xd9f4181e0d27cd71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27cd6a expref: 15 pid: 6515 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945782.932886:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d40baef1e00/0xd9f4181e0d27cea5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945782.932892:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40baef1e00/0xd9f4181e0d27cea5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945782.932906:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d40baef1e00/0xd9f4181e0d27cea5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945782.932912:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d40baef1e00/0xd9f4181e0d27cea5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945782.932919:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d40baef1e00/0xd9f4181e0d27cea5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945782.932926:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d40baef1e00/0xd9f4181e0d27cea5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945782.932942:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef1e00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:0.0:1790945782.932945:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d40baef1e00/0xd9f4181e0d27cea5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945782.932953:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d40baef1e00/0xd9f4181e0d27cea5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945782.938334:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d40baef1e00/0xd9f4181e0d27cea5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945782.938363:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945782.938469:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4096cbc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+14:3648:x1877942638496768:12345-0@lo:103: Request processed in 5631us (6317us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945782.938482:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1790945782.938615:0:6515:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d40baef1e00/0xd9f4181e0d27cea5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945782.938625:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d40baef1e00/0xd9f4181e0d27cea5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945782.938633:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40baef1e00/0xd9f4181e0d27cea5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790945782.938650:0:6515:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1790945782.938700:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40accd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8841fcfb-fb47-4307-92c2-97500c1c82bd:3648:1877942638496768:0@lo:103: 00000100:00100000:2.0:1790945782.941520:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+13:8428:x1877942638495488:12345-0@lo:253: Request processed in 43303us (44534us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945782.941539:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790945782.941839:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40accd1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:8428:1877942638495488:0@lo:253: 10000000:01000000:0.0:1790945782.941859:0:8428:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1790945782.941862:0:8428:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790945782.941864:0:8428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790945782.941865:0:8428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790945782.941867:0:8428:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1790945782.941868:0:8428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790945782.941869:0:8428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790945782.941871:0:8428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790945782.941872:0:8428:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1790945782.941874:0:8428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790945782.941875:0:8428:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790945782.941901:0:8428:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d40bc9be000 from lustre-OST0000 10000000:01000000:0.0:1790945782.941938:0:8428:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1790945782.941941:0:8428:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1790945782.941949:0:8428:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d40af68cd40 local copy 10000000:01000000:0.0:1790945782.941953:0:8428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790945782.942001:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d200/0xd9f4181e0d27ceac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945782.942012:0:8428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d200/0xd9f4181e0d27ceac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945782.942143:0:8428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d200/0xd9f4181e0d27ceac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945782.942351:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40accd1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:8428:1877942638496896:0@lo:101: 00000100:00100000:0.0:1790945782.942402:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945782.942539:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bcbcdb40 going to sleep for 11 seconds 00000100:00100000:1.0:1790945782.943609:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638496896 00000100:00100000:1.0:1790945782.943623:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638496896 00000100:00100000:0.0:1790945782.943759:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790945782.943940:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+13:8428:x1877942638496896:12345-0@lo:101: 00010000:00010000:0.0:1790945782.943956:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945782.943974:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d4086a4dc00/0xd9f4181e0d27ceb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27ceac expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945782.944000:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d4086a4dc00/0xd9f4181e0d27ceb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27ceac expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945782.944011:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d4086a4dc00/0xd9f4181e0d27ceb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ceac expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945782.944020:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4086a4dc00, rc 0) 00000100:00100000:0.0:1790945782.944091:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+14:8428:x1877942638496896:12345-0@lo:101: Request processed in 154us (1688us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945782.944161:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40accd1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:8428:1877942638496896:0@lo:101: 00010000:00010000:2.0:1790945782.944216:0:8428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d200/0xd9f4181e0d27ceac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd9f4181e0d27ceb3 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945782.944226:0:8428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d200/0xd9f4181e0d27ceac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd9f4181e0d27ceb3 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945782.944377:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:8428:1877942638497024:0@lo:501: 00000100:00100000:2.0:1790945782.944415:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945782.944448:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bcac89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945782.944521:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638497024 00000100:00100000:3.0:1790945782.944527:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638497024 00000100:00100000:0.0:1790945782.944858:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1790945782.944950:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1790945782.944958:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+14:8428:x1877942638497024:12345-0@lo:501: 00000100:00100000:3.0:1790945782.945149:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+14:8428:x1877942638497024:12345-0@lo:501: Request processed in 191us (732us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790945782.945157:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790945782.946033:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:8428:1877942638497024:0@lo:501: 10000000:01000000:2.0:1790945782.946057:0:8428:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1790945782.946102:0:8428:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1790945782.946108:0:8428:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d200/0xd9f4181e0d27ceac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd9f4181e0d27ceb3 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945782.946118:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d200/0xd9f4181e0d27ceac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd9f4181e0d27ceb3 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945782.946138:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d200/0xd9f4181e0d27ceac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd9f4181e0d27ceb3 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945782.946164:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790945782.946317:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790945782.946324:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d200/0xd9f4181e0d27ceac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xd9f4181e0d27ceb3 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945782.946338:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4086a4d200 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:0.0:1790945782.946342:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d200/0xd9f4181e0d27ceac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xd9f4181e0d27ceb3 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945782.946350:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d200/0xd9f4181e0d27ceac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xd9f4181e0d27ceb3 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790945782.946357:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d200/0xd9f4181e0d27ceac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xd9f4181e0d27ceb3 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945782.946363:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790945782.946390:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d200/0xd9f4181e0d27ceac lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xd9f4181e0d27ceb3 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945782.946396:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790945782.946430:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d200/0xd9f4181e0d27ceac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xd9f4181e0d27ceb3 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945782.946438:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945782.946440:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945782.946441:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945782.946490:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790945782.946507:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40accd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638497152:0@lo:103: 00000100:00100000:3.0:1790945782.946551:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945782.946672:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638497152 00000100:00100000:0.0:1790945782.946678:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638497152 00000100:00100000:0.0:1790945782.946740:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790945782.946749:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+14:3647:x1877942638497152:12345-0@lo:103: 00010000:00010000:0.0:1790945782.946926:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945782.946943:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d4086a4dc00/0xd9f4181e0d27ceb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd9f4181e0d27ceac expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945782.946976:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945782.947021:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+13:3647:x1877942638497152:12345-0@lo:103: Request processed in 273us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945782.947028:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790945782.947101:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40accd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638497152:0@lo:103: 00010000:00010000:2.0:1790945782.947205:0:8428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d200/0xd9f4181e0d27ceac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xd9f4181e0d27ceb3 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945782.947242:0:8428:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d40bc9be000 10000000:01000000:2.0:1790945782.947247:0:8428:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790945782.947252:0:8428:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1790945782.947254:0:8428:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790945782.947259:0:8428:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1790945782.947262:0:8428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1790945782.947283:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40813fe400/0xd9f4181e0d27ceba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945782.947290:0:8428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40813fe400/0xd9f4181e0d27ceba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945782.947299:0:8428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40813fe400/0xd9f4181e0d27ceba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945782.947312:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:8428:1877942638497280:0@lo:101: 00000100:00100000:2.0:1790945782.947353:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945782.947366:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bcac8300 going to sleep for 11 seconds 00000100:00100000:0.0:1790945782.951095:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638497280 00000100:00100000:0.0:1790945782.951113:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638497280 00000100:00100000:0.0:1790945782.951209:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1790945782.951220:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087031050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+13:8428:x1877942638497280:12345-0@lo:101: 00010000:00010000:0.0:1790945782.951237:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945782.951280:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d4086a4d600/0xd9f4181e0d27cec1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27ceba expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945782.951307:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d4086a4d600/0xd9f4181e0d27cec1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27ceba expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945782.951319:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d4086a4d600/0xd9f4181e0d27cec1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ceba expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945782.951327:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4086a4d600, rc 0) 00000100:00100000:0.0:1790945782.951408:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087031050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+14:8428:x1877942638497280:12345-0@lo:101: Request processed in 189us (4056us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945782.951416:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790945782.951606:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:8428:1877942638497280:0@lo:101: 00010000:00010000:1.0:1790945782.951627:0:8428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40813fe400/0xd9f4181e0d27ceba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cec1 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945782.951636:0:8428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40813fe400/0xd9f4181e0d27ceba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27cec1 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945782.951758:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacedc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:8428:1877942638497408:0@lo:501: 00000100:00100000:1.0:1790945782.951805:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945782.951844:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4084cae6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945782.951958:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638497408 00000100:00100000:3.0:1790945782.951963:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638497408 00000100:00100000:3.0:1790945782.951997:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790945782.952004:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+14:8428:x1877942638497408:12345-0@lo:501: 00000100:00100000:3.0:1790945782.952103:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+14:8428:x1877942638497408:12345-0@lo:501: Request processed in 100us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945782.952110:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1790945782.952393:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacedc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:8428:1877942638497408:0@lo:501: 00000100:00100000:1.0:1790945782.952424:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacedc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:8428:1877942638497536:0@lo:503: 00000100:00100000:1.0:1790945782.952473:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945782.952500:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4084cae6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945782.952553:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638497536 00000100:00100000:3.0:1790945782.952558:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638497536 00000100:00100000:3.0:1790945782.952587:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790945782.952594:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087032450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+14:8428:x1877942638497536:12345-0@lo:503: 00000100:00100000:3.0:1790945782.952694:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087032450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+14:8428:x1877942638497536:12345-0@lo:503: Request processed in 84us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945782.952702:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1790945782.953404:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacedc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:8428:1877942638497536:0@lo:503: 00000040:00080000:1.0:1790945782.953702:0:8428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790945782.953956:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacedc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:8428:1877942638497664:0@lo:502: 00000100:00100000:1.0:1790945782.954008:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945782.954092:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4084cae6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790945782.957883:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638497664 00000100:00100000:0.0:1790945782.957898:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638497664 00000100:00100000:0.0:1790945782.958027:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1790945782.958039:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+14:8428:x1877942638497664:12345-0@lo:502: 00000100:00100000:0.0:1790945782.958265:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+14:8428:x1877942638497664:12345-0@lo:502: Request processed in 227us (4255us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945782.958280:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1790945782.958393:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacedc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:8428:1877942638497664:0@lo:502: 00000040:00080000:1.0:1790945782.958672:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1790945782.958711:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1790945782.958727:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1790945782.958740:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1790945782.958752:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1790945782.959901:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1790945782.959960:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacedc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:8428:1877942638497792:0@lo:502: 00000100:00100000:1.0:1790945782.960048:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945782.966836:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4084cae6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945782.966934:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638497792 00000100:00100000:3.0:1790945782.966944:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638497792 00000100:00100000:3.0:1790945782.966999:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1790945782.967009:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+14:8428:x1877942638497792:12345-0@lo:502: 00000100:00100000:3.0:1790945782.967303:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+14:8428:x1877942638497792:12345-0@lo:502: Request processed in 295us (7255us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945782.967312:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1790945782.967493:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacedc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:8428:1877942638497792:0@lo:502: 00000040:00080000:1.0:1790945782.967584:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1790945782.967598:0:8428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1790945782.969543:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790945782.969555:0:8451:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1790945782.969562:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790945782.969565:0:8451:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1790945782.969571:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790945782.969588:0:8451:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9d40a763b380) 00000020:00000080:1.0:1790945782.969614:0:8451:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:1.0:1790945782.969621:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790945782.969712:0:8451:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d40bc9be000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1790945782.969719:0:8451:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790945782.969726:0:8451:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd9f4181e0d27cecf 00010000:00010000:2.0:1790945782.976650:0:8451:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:2.0:1790945782.977110:0:8451:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1790945782.980638:0:8451:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1790945782.981028:0:8451:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1790945782.988155:0:8451:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1790945782.988412:0:8451:0:(osd_compat.c:1354:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1790945783.000788:0:8451:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1790945783.011117:0:8451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1790945783.011140:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790945783.011147:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945783.011149:0:8451:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1790945783.011152:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790945783.011156:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945783.011157:0:8451:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790945783.011161:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790945783.011163:0:8451:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1790945783.011230:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790945783.011234:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945783.011235:0:8451:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:0.0:1790945783.011238:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1790945783.014510:0:8428:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1790945783.014566:0:8428:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1790945783.014592:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40813fe400/0xd9f4181e0d27ceba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cec1 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945783.014609:0:8428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40813fe400/0xd9f4181e0d27ceba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cec1 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945783.014617:0:8428:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d40bc9be000 from 1 10000000:01000000:1.0:1790945783.014632:0:8428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790945783.014678:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6000/0xd9f4181e0d27ced6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945783.014687:0:8428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6000/0xd9f4181e0d27ced6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945783.014698:0:8428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6000/0xd9f4181e0d27ced6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945783.014725:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacedc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:8428:1877942638497920:0@lo:101: 00000100:00100000:1.0:1790945783.014822:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945783.014882:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4084cae780 going to sleep for 11 seconds 00000100:00100000:0.0:1790945783.015431:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638497920 00000100:00100000:0.0:1790945783.015440:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638497920 00000100:00100000:0.0:1790945783.015728:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790945783.015740:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+14:8428:x1877942638497920:12345-0@lo:101: 00010000:00010000:0.0:1790945783.015753:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945783.015777:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d4086a4dc00/0xd9f4181e0d27cedd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27ced6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945783.015802:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d4086a4dc00/0xd9f4181e0d27cedd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27ced6 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945783.015812:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d4086a4dc00/0xd9f4181e0d27cedd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ced6 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945783.015835:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4086a4dc00, rc 0) 00000100:00100000:0.0:1790945783.015898:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:8428:x1877942638497920:12345-0@lo:101: Request processed in 161us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945783.015906:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1790945783.015976:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacedc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:8428:1877942638497920:0@lo:101: 00010000:00010000:2.0:1790945783.015993:0:8428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6000/0xd9f4181e0d27ced6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cedd expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945783.016002:0:8428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6000/0xd9f4181e0d27ced6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27cedd expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945783.019313:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:8428:1877942638498048:0@lo:501: 00000100:00100000:2.0:1790945783.019385:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945783.022386:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bcac8300 going to sleep for 11 seconds 00000100:00100000:3.0:1790945783.022519:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638498048 00000100:00100000:3.0:1790945783.022528:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638498048 00000100:00100000:3.0:1790945783.022574:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1790945783.022584:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087031850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:8428:x1877942638498048:12345-0@lo:501: 00000100:00100000:3.0:1790945783.022753:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087031850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:8428:x1877942638498048:12345-0@lo:501: Request processed in 170us (3367us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945783.022923:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790945783.022945:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:8428:1877942638498048:0@lo:501: 00000100:00100000:2.0:1790945783.022988:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:8428:1877942638498176:0@lo:503: 00000100:00100000:2.0:1790945783.023154:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945783.023204:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bcac8300 going to sleep for 11 seconds 00000100:00100000:0.0:1790945783.023259:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638498176 00000100:00100000:0.0:1790945783.023264:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638498176 00000100:00100000:0.0:1790945783.023291:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1790945783.023298:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:8428:x1877942638498176:12345-0@lo:503: 00000100:00100000:0.0:1790945783.023386:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:8428:x1877942638498176:12345-0@lo:503: Request processed in 88us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945783.023394:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790945783.023466:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:8428:1877942638498176:0@lo:503: 00000040:00080000:3.0:1790945783.023852:0:8428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790945783.023923:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:8428:1877942638498304:0@lo:502: 00000100:00100000:3.0:1790945783.023961:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945783.023995:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4d05d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790945783.024086:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638498304 00000100:00100000:0.0:1790945783.024091:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638498304 00000100:00100000:0.0:1790945783.024197:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790945783.024208:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:8428:x1877942638498304:12345-0@lo:502: 00000100:00100000:0.0:1790945783.024290:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:8428:x1877942638498304:12345-0@lo:502: Request processed in 83us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945783.024297:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1790945783.024355:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:8428:1877942638498304:0@lo:502: 00000040:00080000:3.0:1790945783.024547:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1790945783.024572:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1790945783.024591:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:8428:1877942638498432:0@lo:502: 00000100:00100000:3.0:1790945783.024728:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945783.024854:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4d05d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790945783.024894:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638498432 00000100:00100000:0.0:1790945783.024899:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638498432 00000100:00100000:0.0:1790945783.024932:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790945783.024939:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087033c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:8428:x1877942638498432:12345-0@lo:502: 00000100:00100000:0.0:1790945783.025118:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087033c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:8428:x1877942638498432:12345-0@lo:502: Request processed in 178us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945783.025136:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1790945783.025206:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:8428:1877942638498432:0@lo:502: 00000040:00080000:3.0:1790945783.025248:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1790945783.025257:0:8428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1790945783.025876:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790945783.025886:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945783.025888:0:8455:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790945783.025895:0:8455:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d40bc9be000 00000020:00000080:3.0:1790945783.025898:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790945783.025909:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790945783.025912:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945783.025913:0:8455:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1790945783.025916:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1790945783.026001:0:8428:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1790945783.026147:0:8428:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790945783.026209:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6000/0xd9f4181e0d27ced6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cedd expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945783.026221:0:8428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6000/0xd9f4181e0d27ced6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cedd expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945783.026281:0:8428:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790945783.026285:0:8428:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d40bc9be000 10000000:01000000:2.0:1790945783.026288:0:8428:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d40bc9be000 10000000:01000000:2.0:1790945783.026292:0:8428:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790945783.026298:0:8428:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d40bc9be000 from 1 10000000:01000000:2.0:1790945783.026301:0:8428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790945783.026334:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40813ffa00/0xd9f4181e0d27cee4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945783.026341:0:8428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40813ffa00/0xd9f4181e0d27cee4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945783.026351:0:8428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40813ffa00/0xd9f4181e0d27cee4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945783.026367:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:8428:1877942638498560:0@lo:101: 00000100:00100000:2.0:1790945783.026417:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945783.026450:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bcac89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790945783.026571:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638498560 00000100:00100000:0.0:1790945783.026585:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638498560 00000100:00100000:0.0:1790945783.026626:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790945783.026644:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af617450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:8428:x1877942638498560:12345-0@lo:101: 00010000:00010000:0.0:1790945783.026656:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945783.026668:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d4086a4da00/0xd9f4181e0d27ceeb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27cee4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945783.026843:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d4086a4da00/0xd9f4181e0d27ceeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27cee4 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945783.026856:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d4086a4da00/0xd9f4181e0d27ceeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27cee4 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945783.026864:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4086a4da00, rc 0) 00000100:00100000:0.0:1790945783.026910:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af617450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:8428:x1877942638498560:12345-0@lo:101: Request processed in 276us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945783.026917:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1790945783.027261:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:8428:1877942638498560:0@lo:101: 00010000:00010000:2.0:1790945783.027277:0:8428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40813ffa00/0xd9f4181e0d27cee4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ceeb expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945783.027286:0:8428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40813ffa00/0xd9f4181e0d27cee4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27ceeb expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945783.027367:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:8428:1877942638498688:0@lo:501: 00000100:00100000:2.0:1790945783.027415:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945783.027448:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bcac89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790945783.027585:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638498688 00000100:00100000:0.0:1790945783.027590:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638498688 00000100:00100000:0.0:1790945783.027626:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790945783.027642:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af614050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:8428:x1877942638498688:12345-0@lo:501: 00000100:00100000:0.0:1790945783.027855:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af614050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:8428:x1877942638498688:12345-0@lo:501: Request processed in 222us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945783.027863:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790945783.027966:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:8428:1877942638498688:0@lo:501: 00000100:00100000:3.0:1790945783.027995:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:8428:1877942638498816:0@lo:503: 00000100:00100000:3.0:1790945783.028034:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945783.028058:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4d05b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790945783.028088:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638498816 00000100:00100000:1.0:1790945783.028094:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638498816 00000100:00100000:1.0:1790945783.028144:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1790945783.028152:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af614450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:8428:x1877942638498816:12345-0@lo:503: 00000100:00100000:1.0:1790945783.028259:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af614450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:8428:x1877942638498816:12345-0@lo:503: Request processed in 108us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945783.028266:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1790945783.028333:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:8428:1877942638498816:0@lo:503: 00000040:00080000:0.0:1790945783.028604:0:8428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790945783.028675:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40accd0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:8428:1877942638498944:0@lo:502: 00000100:00100000:0.0:1790945783.028721:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945783.028762:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bcbcd600 going to sleep for 11 seconds 00000100:00100000:3.0:1790945783.028823:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638498944 00000100:00100000:3.0:1790945783.028827:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638498944 00000100:00100000:3.0:1790945783.028863:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1790945783.028870:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af615850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:8428:x1877942638498944:12345-0@lo:502: 00000100:00100000:3.0:1790945783.028953:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af615850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:8428:x1877942638498944:12345-0@lo:502: Request processed in 83us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945783.028960:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1790945783.029949:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40accd0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:8428:1877942638498944:0@lo:502: 00000040:00080000:0.0:1790945783.030164:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1790945783.030250:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1790945783.030264:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1790945783.030277:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1790945783.030295:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1790945783.030340:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1790945783.030358:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1790945783.030369:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1790945783.030381:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1790945783.030393:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1790945783.030406:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1790945783.030421:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1790945783.030435:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1790945783.030463:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1790945783.030478:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1790945783.030489:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1790945783.030500:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1790945783.030513:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1790945783.030526:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1790945783.030540:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1790945783.030553:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1790945783.030567:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1790945783.030579:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1790945783.030592:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1790945783.030604:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1790945783.030616:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1790945783.030630:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1790945783.030818:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1790945783.030837:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1790945783.030864:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1790945783.030887:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1790945783.030900:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1790945783.030915:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1790945783.030929:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1790945783.030943:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1790945783.030957:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1790945783.030970:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:0.0:1790945783.031001:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40accd0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:8428:1877942638499072:0@lo:502: 00000100:00100000:0.0:1790945783.031058:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945783.031152:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bcbcd600 going to sleep for 11 seconds 00000100:00100000:3.0:1790945783.031243:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638499072 00000100:00100000:3.0:1790945783.031251:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638499072 00000100:00100000:3.0:1790945783.031289:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1790945783.031297:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af616c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:8428:x1877942638499072:12345-0@lo:502: 00000100:00100000:3.0:1790945783.031443:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af616c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:8428:x1877942638499072:12345-0@lo:502: Request processed in 146us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945783.031451:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790945783.031516:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40accd0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:8428:1877942638499072:0@lo:502: 00000040:00080000:0.0:1790945783.031560:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1790945783.031568:0:8428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1790945783.034547:0:8456:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1790945783.034566:0:8456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9d40b4a44d40) 00000020:00000080:2.0:1790945783.034593:0:8456:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1790945783.034902:0:8456:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d40bc9be000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1790945783.034908:0:8456:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d40bc9be000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1790945783.034910:0:8456:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d40bc9be000 3 00010000:00080000:2.0:1790945783.034945:0:8456:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d3f8224a800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.120@tcp at head 00010000:00010000:2.0:1790945783.038142:0:8456:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:2.0:1790945783.038482:0:8456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1790945783.038532:0:8456:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790945783.038545:0:8456:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xd9f4181e0d27cef9 00000100:00080000:2.0:1790945783.038556:0:8456:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790945783.038570:0:8456:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9d3f8224a800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1790945783.038608:0:8456:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d40bcbc1500 x1877942638499200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790945783.038731:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1877942638499200:0@lo:38: 00000100:00100000:0.0:1790945783.038812:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945783.038908:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638499200 00000100:00100000:3.0:1790945783.038923:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638499200 00000100:00100000:3.0:1790945783.038959:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790945783.038966:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40accd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1877942638499200:12345-0@lo:38: 00010000:00080000:3.0:1790945783.038987:0:6522:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:3.0:1790945783.039028:0:6522:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xd9f4181e0d27cf00 00000004:00100000:3.0:1790945783.039044:0:6522:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790945783.039075:0:6522:0:(import.c:65:import_set_state_nolock()) ffff9d3f81b13000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1790945783.039319:0:8456:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1790945783.039406:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638499712:0@lo:400: 00000100:00100000:1.0:1790945783.039444:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945783.039471:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790945783.039477:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1877942638499584:0@lo:400: 00000100:00100000:1.0:1790945783.039496:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945783.039523:0:6521:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1790945783.039530:0:6521:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1790945783.039546:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638499712 00000100:00100000:2.0:1790945783.039548:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877942638499328:0@lo:400: 00000100:00100000:1.0:1790945783.039550:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638499712 00000100:00100000:2.0:1790945783.039576:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945783.039585:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790945783.039590:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790945783.039595:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638499456:0@lo:400: 00000100:00100000:1.0:1790945783.039606:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40baceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638499712:12345-0@lo:400: 00000100:00100000:2.0:1790945783.039614:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945783.039645:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40baceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638499712:12345-0@lo:400: Request processed in 39us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945783.039651:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790945783.039663:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638499456 00000100:00100000:1.0:1790945783.039666:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638499456 00000100:00100000:1.0:1790945783.039681:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790945783.039686:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638499456:12345-0@lo:400: 00000100:00100000:1.0:1790945783.039725:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638499456:12345-0@lo:400: Request processed in 39us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945783.039730:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790945783.039748:0:6523:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1790945783.039755:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638499584 00000100:00100000:1.0:1790945783.039757:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638499584 00000100:00100000:2.0:1790945783.039972:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638499456:0@lo:400: 00000100:00100000:3.0:1790945783.040246:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40accd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1877942638499200:12345-0@lo:38: Request processed in 1278us (1433us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945783.040253:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790945783.040268:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638499328 00000100:00100000:3.0:1790945783.040272:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638499328 00000100:00100000:3.0:1790945783.040294:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790945783.040299:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877942638499328:12345-0@lo:400: 00000100:00100000:3.0:1790945783.040388:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877942638499328:12345-0@lo:400: Request processed in 88us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945783.040395:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1790945783.040441:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d40bcbc2300 x1877942638499328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945783.040452:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877942638499328:0@lo:400: 00000100:00100000:1.0:1790945783.040476:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790945783.040484:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bacec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1877942638499584:12345-0@lo:400: 00010000:00080000:0.0:1790945783.040514:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d40bcbc1500 x1877942638499200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790945793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945783.040516:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bacec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1877942638499584:12345-0@lo:400: Request processed in 34us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945783.040523:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790945783.040524:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790945783.040531:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1790945783.040539:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1790945783.040544:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790945783.040547:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d3f8224a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00010000:00080000:1.0:1790945783.040552:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d40bcbc0380 x1877942638499584/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945783.040553:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1877942638499200:0@lo:38: 00000100:00100000:1.0:1790945783.040560:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1877942638499584:0@lo:400: 00000100:00100000:1.0:1790945783.040570:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638499712:0@lo:400: 00000020:01000004:2.0:1790945783.040925:0:8456:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1790945783.040944:0:8456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9d40b4a40000) 00000020:00000080:2.0:1790945783.040962:0:8456:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:2.0:1790945783.041034:0:8456:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d40bc9be000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1790945783.041038:0:8456:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d40bc9be000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1790945783.041040:0:8456:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d40bc9be000 3 00010000:00080000:2.0:1790945783.041081:0:8456:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d3f8224c000@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.120@tcp at head 00010000:00010000:2.0:1790945783.043204:0:8456:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:3.0:1790945783.045402:0:8456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1790945783.045446:0:8456:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790945783.045458:0:8456:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xd9f4181e0d27cf0e 00000100:00080000:3.0:1790945783.045469:0:8456:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790945783.045484:0:8456:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9d3f8224c000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1790945783.045524:0:8456:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f81bd3100 x1877942638499840/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790945783.045552:0:8456:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1790945783.045766:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1877942638499840:0@lo:38: 00000100:00100000:0.0:1790945783.045839:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1790945783.046484:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1790945783.046623:0:8428:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1790945783.046653:0:8428:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790945783.046696:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40813ffa00/0xd9f4181e0d27cee4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ceeb expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945783.046707:0:8428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40813ffa00/0xd9f4181e0d27cee4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ceeb expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1790945783.046777:0:8428:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790945783.046779:0:8428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790945783.046781:0:8428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790945783.046782:0:8428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790945783.046783:0:8428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790945783.046785:0:8428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790945783.046787:0:8428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790945783.046788:0:8428:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790945783.046789:0:8428:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790945783.046791:0:8428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790945783.046792:0:8428:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790945783.046800:0:8428:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1790945783.046802:0:8428:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790945783.046804:0:8428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790945783.046805:0:8428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790945783.046806:0:8428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790945783.046807:0:8428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790945783.046808:0:8428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790945783.046809:0:8428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790945783.046810:0:8428:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790945783.046811:0:8428:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790945783.046812:0:8428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790945783.046813:0:8428:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790945783.046836:0:8428:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1790945783.046849:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:8428:1877942638499968:0@lo:253: 00000100:00100000:3.0:1790945783.046897:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945783.046933:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4d05180 going to sleep for 11 seconds 00000100:00100000:0.0:1790945783.047311:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638499968 00000100:00100000:0.0:1790945783.047320:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638499968 00000100:00100000:0.0:1790945783.047371:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790945783.047381:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af614c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:8428:x1877942638499968:12345-0@lo:253: 20000000:01000000:0.0:1790945783.047422:0:6516:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1790945783.047437:0:6516:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1790945783.047467:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638499840 00000100:00100000:1.0:1790945783.047472:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638499840 00000100:00100000:1.0:1790945783.047496:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790945783.047509:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40accd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1877942638499840:12345-0@lo:38: 00010000:00080000:1.0:1790945783.047530:0:6523:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:1.0:1790945783.047560:0:6523:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xd9f4181e0d27cf15 00000004:00100000:1.0:1790945783.047575:0:6523:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790945783.047605:0:6523:0:(import.c:65:import_set_state_nolock()) ffff9d3f81bb5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790945783.049072:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40accd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1877942638499840:12345-0@lo:38: Request processed in 1553us (3223us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945783.049086:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1790945783.049302:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3f81bd3100 x1877942638499840/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790945793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945783.049314:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790945783.049324:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1790945783.049333:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1790945783.049338:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1790945783.049340:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d3f8224c000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790945783.049347:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1877942638499840:0@lo:38: 20000000:01000000:0.0:1790945783.053189:0:6516:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790945783.053378:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1790945783.053493:0:6537:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790945783.053499:0:6537:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790945783.053522:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d40813ffe00/0xd9f4181e0d27cf1c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945783.053542:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40c21d7800/0xd9f4181e0d27ce12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ce0b expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945783.053550:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40baef0400/0xd9f4181e0d27ce2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ce27 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945783.053559:0:6537:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d40813ffe00/0xd9f4181e0d27cf1c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945783.053606:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40baef0400/0xd9f4181e0d27ce2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27ce27 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945783.053621:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40baef0400/0xd9f4181e0d27ce2e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27ce27 expref: 16 pid: 6515 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945783.053633:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1877942638500096:0@lo:104: 00000100:00100000:2.0:1790945783.053673:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945783.053698:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af614c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:8428:x1877942638499968:12345-0@lo:253: Request processed in 6318us (6800us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945783.053709:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00010000:2.0:1790945783.053716:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40c21d7800/0xd9f4181e0d27ce12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27ce0b expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945783.053731:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40c21d7800/0xd9f4181e0d27ce12 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27ce0b expref: 15 pid: 6516 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945783.053740:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc2680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1877942638500224:0@lo:104: 00000100:00100000:2.0:1790945783.053760:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f824d83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790945783.053784:0:6505:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790945783.053798:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945783.053816:0:6505:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638500096 00000100:00100000:2.0:1790945783.053823:0:6505:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638500096 00000100:00100000:2.0:1790945783.053850:0:6505:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638500224 00000100:00100000:2.0:1790945783.053852:0:6505:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638500224 00000100:00100000:2.0:1790945783.053863:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790945783.053869:0:6505:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4b9e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+4:6537:x1877942638500096:12345-0@lo:104: 00010000:00010000:2.0:1790945783.053881:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7c00/0xd9f4181e0d27ce27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27ce2e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945783.053916:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790945783.053920:0:6505:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4b9e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+4:6537:x1877942638500096:12345-0@lo:104: Request processed in 52us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945783.053926:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790945783.053954:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790945783.053959:0:6505:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+3:6537:x1877942638500224:12345-0@lo:104: 00010000:00010000:2.0:1790945783.053966:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d4086a4c800/0xd9f4181e0d27ce0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27ce12 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945783.053993:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790945783.053998:0:6505:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+3:6537:x1877942638500224:12345-0@lo:104: Request processed in 39us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945783.054008:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1790945783.054027:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790945783.054032:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7c00/0xd9f4181e0d27ce27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27ce2e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945783.054040:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d7c00 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:2.0:1790945783.054044:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7c00/0xd9f4181e0d27ce27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27ce2e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945783.054161:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:8428:1877942638499968:0@lo:253: 10000000:01000000:1.0:1790945783.054194:0:8428:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1790945783.054198:0:8428:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790945783.054199:0:8428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790945783.054201:0:8428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790945783.054202:0:8428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790945783.054203:0:8428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790945783.054204:0:8428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790945783.054206:0:8428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790945783.054208:0:8428:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790945783.054209:0:8428:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790945783.054210:0:8428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790945783.054212:0:8428:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790945783.054223:0:8428:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1790945783.055184:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7c00/0xd9f4181e0d27ce27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27ce2e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790945783.055193:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7c00/0xd9f4181e0d27ce27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27ce2e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945783.055200:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790945783.055234:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7c00/0xd9f4181e0d27ce27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ce2e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945783.055241:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790945783.055259:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7c00/0xd9f4181e0d27ce27 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ce2e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945783.055265:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7c00/0xd9f4181e0d27ce27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ce2e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945783.055276:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790945783.055279:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d4086a4c800/0xd9f4181e0d27ce0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27ce12 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945783.055295:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4086a4c800 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:2.0:1790945783.055298:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d4086a4c800/0xd9f4181e0d27ce0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27ce12 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945783.055304:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d4086a4c800/0xd9f4181e0d27ce0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27ce12 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790945783.055310:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d4086a4c800/0xd9f4181e0d27ce0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27ce12 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945783.055315:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790945783.055327:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d4086a4c800/0xd9f4181e0d27ce0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ce12 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945783.055332:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790945783.055337:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d4086a4c800/0xd9f4181e0d27ce0b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ce12 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945783.055356:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d4086a4c800/0xd9f4181e0d27ce0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ce12 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945783.055371:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945783.055373:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945783.055375:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945783.055383:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945783.055470:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638500352:0@lo:103: 00000100:00100000:2.0:1790945783.055517:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945783.055557:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790945783.055563:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638500480:0@lo:103: 00000100:00100000:2.0:1790945783.055591:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945783.055624:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638500352 00000100:00100000:2.0:1790945783.055630:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638500352 00010000:00010000:2.0:1790945783.055652:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40baef0400/0xd9f4181e0d27ce2e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27ce27 expref: 16 pid: 6515 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945783.055676:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638500480 00000100:00100000:2.0:1790945783.055679:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638500480 00010000:00010000:2.0:1790945783.055692:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40c21d7800/0xd9f4181e0d27ce12 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27ce0b expref: 17 pid: 6516 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945783.055712:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790945783.055718:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:3649:x1877942638500352:12345-0@lo:103: 00010000:00010000:2.0:1790945783.055730:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945783.055735:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40baef0400/0xd9f4181e0d27ce2e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27ce27 expref: 17 pid: 6515 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945783.055746:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40baef0400/0xd9f4181e0d27ce2e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27ce27 expref: 17 pid: 6515 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945783.057225:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945783.057301:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:3649:x1877942638500352:12345-0@lo:103: Request processed in 1580us (1782us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945783.057312:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790945783.057344:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790945783.057353:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:3649:x1877942638500480:12345-0@lo:103: 00010000:00010000:2.0:1790945783.057367:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945783.057374:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40c21d7800/0xd9f4181e0d27ce12 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27ce0b expref: 16 pid: 6516 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945783.057400:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40c21d7800/0xd9f4181e0d27ce12 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27ce0b expref: 16 pid: 6516 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945783.057416:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d40813ffe00/0xd9f4181e0d27cf1c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945783.057424:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40813ffe00/0xd9f4181e0d27cf1c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790945783.057440:0:6508:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009262225s 00010000:00010000:2.0:1790945783.057445:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d40813ffe00/0xd9f4181e0d27cf1c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945783.057452:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d40813ffe00/0xd9f4181e0d27cf1c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945783.057459:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d40813ffe00/0xd9f4181e0d27cf1c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945783.057466:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d40813ffe00/0xd9f4181e0d27cf1c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945783.057472:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40813ffe00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790945783.057476:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d40813ffe00/0xd9f4181e0d27cf1c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945783.057484:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d40813ffe00/0xd9f4181e0d27cf1c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945783.057492:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d40813ffe00/0xd9f4181e0d27cf1c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945783.057513:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945783.057538:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:3649:x1877942638500480:12345-0@lo:103: Request processed in 188us (1946us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945783.057544:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790945783.057623:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638500480:0@lo:103: 00000100:00100000:2.0:1790945783.057631:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638500352:0@lo:103: 00010000:00010000:2.0:1790945783.057665:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40baef0400/0xd9f4181e0d27ce2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27ce27 expref: 15 pid: 6515 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945783.057677:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1877942638500096:0@lo:104: 00010000:00010000:2.0:1790945783.057687:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40c21d7800/0xd9f4181e0d27ce12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27ce0b expref: 14 pid: 6516 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945783.057695:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc2680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1877942638500224:0@lo:104: 00010000:00010000:2.0:1790945783.057707:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d40813ffe00/0xd9f4181e0d27cf1c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945783.057716:0:6537:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d40813ffe00/0xd9f4181e0d27cf1c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945783.057722:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d40813ffe00/0xd9f4181e0d27cf1c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945783.057728:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40813ffe00/0xd9f4181e0d27cf1c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1790945783.064691:0:8428:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1790945783.064883:0:8428:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1790945783.065115:0:8428:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1790945783.065325:0:8428:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1790945783.065528:0:8428:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1790945783.065732:0:8428:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1790945783.072555:0:8428:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1790945783.084581:0:8428:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1790945783.084592:0:8428:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1790945783.084631:0:8428:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1790945783.084832:0:8428:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.120@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1790945783.084858:0:8428:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1790945783.084881:0:8428:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1790945783.085642:0:8428:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790945783.085847:0:8428:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:1.0:1790945783.143802:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638500608:0@lo:41: 00000100:00100000:1.0:1790945783.143878:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945783.148928:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638500608 00000100:00100000:1.0:1790945783.148943:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638500608 00000100:00100000:1.0:1790945783.149001:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790945783.149010:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40baceed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638500608:12345-0@lo:41: 00000004:00000024:1.0:1790945783.149064:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:1.0:1790945783.149184:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40baceed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638500608:12345-0@lo:41: Request processed in 175us (5306us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945783.149192:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790945783.149577:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638500608:0@lo:41: 00010000:00010000:1.0:1790945783.263379:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945783.653285:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638500736:0@lo:41: 00000100:00100000:3.0:1790945783.653374:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945783.662137:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638500736 00000100:00100000:2.0:1790945783.662568:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638500736 00000100:00100000:2.0:1790945783.662680:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790945783.662691:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638500736:12345-0@lo:41: 00000004:00000024:2.0:1790945783.662729:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1790945783.662819:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638500736:12345-0@lo:41: Request processed in 130us (9445us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945783.662826:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790945783.662953:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638500736:0@lo:41: 00000020:00000004:0.0:1790945784.069515:0:8513:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790945784.069808:0:8513:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790945784.292003:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945785.315722:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945786.336505:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945787.360060:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945788.255696:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40accd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877942638500992:0@lo:400: 00000100:00100000:0.0:1790945788.255769:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945788.255831:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40accd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1877942638501504:0@lo:400: 00000100:00100000:0.0:1790945788.255876:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945788.255903:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1790945788.255909:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40accd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638500864:0@lo:400: 00000100:00100000:0.0:1790945788.255937:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945788.255958:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40accd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638501376:0@lo:400: 00000100:00100000:3.0:1790945788.256144:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638500864 00000100:00100000:3.0:1790945788.256152:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638500864 00000100:00100000:3.0:1790945788.256229:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1790945788.256239:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af617c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+14:3650:x1877942638500864:12345-0@lo:400: 00000100:00100000:3.0:1790945788.256288:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af617c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+14:3650:x1877942638500864:12345-0@lo:400: Request processed in 51us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945788.256295:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1790945788.256475:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945788.256547:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40accd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638500864:0@lo:400: 00000100:00100000:0.0:1790945788.256573:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40accd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638501120:0@lo:400: 00000100:00100000:0.0:1790945788.256597:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945788.259460:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638500992 00000100:00100000:3.0:1790945788.259474:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638500992 00000100:00100000:3.0:1790945788.259527:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638501504 00000100:00100000:3.0:1790945788.259531:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638501504 00000100:00100000:3.0:1790945788.259563:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790945788.259571:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40accd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877942638500992:12345-0@lo:400: 00000100:00100000:3.0:1790945788.259667:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40accd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877942638500992:12345-0@lo:400: Request processed in 97us (3898us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945788.259674:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790945788.259693:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790945788.259700:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877942638501504:12345-0@lo:400: 00000100:00100000:3.0:1790945788.259727:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877942638501504:12345-0@lo:400: Request processed in 29us (3851us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945788.259733:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790945788.259760:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40accd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1877942638501248:0@lo:400: 00000100:00100000:3.0:1790945788.259797:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945788.259822:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638501760:0@lo:41: 00000100:00080000:3.0:1790945788.259850:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790945788.259870:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638501248 00000100:00100000:3.0:1790945788.259874:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638501248 00000100:00100000:3.0:1790945788.259896:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790945788.259902:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1877942638501248:12345-0@lo:400: 00000100:00100000:3.0:1790945788.259935:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1877942638501248:12345-0@lo:400: Request processed in 33us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945788.259940:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790945788.260579:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638501376 00000100:00100000:1.0:1790945788.260585:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638501376 00000100:00100000:0.0:1790945788.260605:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1790945788.267309:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d40accd2300 x1877942638501248/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945788.267330:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40accd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1877942638501248:0@lo:400: 00010000:00080000:0.0:1790945788.267383:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d40accd3800 x1877942638500992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945788.267394:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40accd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877942638500992:0@lo:400: 00010000:00080000:0.0:1790945788.267407:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d40accd1500 x1877942638501504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945788.267416:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40accd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1877942638501504:0@lo:400: 00000100:00100000:0.0:1790945788.267441:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40accd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1877942638501632:0@lo:400: 00000100:00100000:0.0:1790945788.267497:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945788.268132:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638501120 00000100:00100000:3.0:1790945788.268141:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638501120 00000100:00100000:3.0:1790945788.268202:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638501760 00000100:00100000:3.0:1790945788.268206:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638501760 00000100:00100000:3.0:1790945788.268224:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790945788.268232:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638501376:12345-0@lo:400: 00000100:00100000:3.0:1790945788.268293:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638501376:12345-0@lo:400: Request processed in 61us (11817us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945788.268300:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790945788.268319:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790945788.268324:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1877942638501120:12345-0@lo:400: 00000100:00100000:3.0:1790945788.268355:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1877942638501120:12345-0@lo:400: Request processed in 31us (11758us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945788.268360:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790945788.268371:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790945788.268377:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638501760:12345-0@lo:41: 00000004:00000024:3.0:1790945788.268399:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:3.0:1790945788.268434:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638501760:12345-0@lo:41: Request processed in 57us (7828us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945788.268440:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790945788.268470:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638501632 00000100:00100000:3.0:1790945788.268474:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638501632 00000100:00100000:3.0:1790945788.268510:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790945788.268516:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1877942638501632:12345-0@lo:400: 00000100:00100000:3.0:1790945788.268548:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1877942638501632:12345-0@lo:400: Request processed in 32us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945788.268553:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1790945788.268569:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790945788.268664:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638501760:0@lo:41: 00000100:00100000:0.0:1790945788.268696:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40accd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638501376:0@lo:400: 00000100:00100000:0.0:1790945788.268717:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40accd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638501120:0@lo:400: 00010000:00080000:0.0:1790945788.268727:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d40accd1c00 x1877942638501632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945788.268736:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40accd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1877942638501632:0@lo:400: 00010000:00010000:1.0:1790945788.383331:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945788.768069:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790945788.768097:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638501888:0@lo:41: 00000100:00100000:2.0:1790945788.768197:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945788.768555:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638501888 00000100:00100000:1.0:1790945788.768564:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638501888 00000100:00100000:1.0:1790945788.768658:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790945788.768670:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638501888:12345-0@lo:41: 00000004:00000024:1.0:1790945788.768707:0:6526:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1790945788.768768:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638501888:12345-0@lo:41: Request processed in 100us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945788.768775:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790945788.769046:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638501888:0@lo:41: 00000001:02000400:1.0:1790945788.979068:0:8803:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1790945789.407974:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1790945789.938028:0:8855:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790945789.938255:0:8855:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790945790.431373:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790945791.327299:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1790945791.327308:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d40bacd0800 from 30 10000000:01000000:2.0:1790945791.327314:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790945791.327360:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27cf23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945791.327373:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27cf23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945791.327384:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27cf23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945791.327409:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638502016:0@lo:101: 00000100:00100000:2.0:1790945791.327498:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945791.327569:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40af69a300 going to sleep for 11 seconds 00000100:00100000:0.0:1790945791.327797:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638502016 00000100:00100000:0.0:1790945791.327809:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638502016 00000100:00100000:0.0:1790945791.327863:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1790945791.327873:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af615450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+14:6519:x1877942638502016:12345-0@lo:101: 00010000:00010000:0.0:1790945791.327888:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945791.327903:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d4086a4c000/0xd9f4181e0d27cf2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27cf23 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945791.327929:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d4086a4c000/0xd9f4181e0d27cf2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27cf23 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945791.327941:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d4086a4c000/0xd9f4181e0d27cf2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27cf23 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945791.327952:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4086a4c000, rc 0) 00000100:00100000:0.0:1790945791.328017:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af615450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:6519:x1877942638502016:12345-0@lo:101: Request processed in 145us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945791.328024:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790945791.330899:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638502016:0@lo:101: 00010000:00010000:2.0:1790945791.330930:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27cf23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cf2a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945791.330943:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27cf23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27cf2a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945791.331048:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638502144:0@lo:501: 00000100:00100000:2.0:1790945791.331107:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945791.331155:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40af69a300 going to sleep for 11 seconds 00000100:00100000:1.0:1790945791.331255:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638502144 00000100:00100000:1.0:1790945791.331264:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638502144 00000100:00100000:1.0:1790945791.331315:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1790945791.331324:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af615c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:6519:x1877942638502144:12345-0@lo:501: 00000100:00100000:1.0:1790945791.331466:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af615c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:6519:x1877942638502144:12345-0@lo:501: Request processed in 143us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945791.331474:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790945791.332919:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638502144:0@lo:501: 00000100:00100000:2.0:1790945791.332983:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638502272:0@lo:503: 00000100:00100000:2.0:1790945791.333046:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945791.333088:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40af69a300 going to sleep for 11 seconds 00000100:00100000:3.0:1790945791.333153:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638502272 00000100:00100000:3.0:1790945791.333160:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638502272 00000100:00100000:3.0:1790945791.333234:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1790945791.333242:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af617050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:6519:x1877942638502272:12345-0@lo:503: 00000100:00100000:3.0:1790945791.333343:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af617050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:6519:x1877942638502272:12345-0@lo:503: Request processed in 100us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945791.333350:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790945791.333452:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638502272:0@lo:503: 00000100:00100000:3.0:1790945791.336112:0:8908:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:8908:1877942638502400:0@lo:502: 00000100:00100000:3.0:1790945791.336224:0:8908:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945791.336330:0:8908:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40871a9000 going to sleep for 11 seconds 00000100:00100000:0.0:1790945791.336978:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638502400 00000100:00100000:0.0:1790945791.336987:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638502400 00000100:00100000:0.0:1790945791.337087:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1790945791.337096:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af614850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:8908:x1877942638502400:12345-0@lo:502: 00000100:00100000:0.0:1790945791.337279:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af614850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:8908:x1877942638502400:12345-0@lo:502: Request processed in 183us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945791.337286:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1790945791.337415:0:8908:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:8908:1877942638502400:0@lo:502: 00000100:00100000:1.0:1790945791.337485:0:8908:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:8908:1877942638502528:0@lo:502: 00000100:00100000:1.0:1790945791.337536:0:8908:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945791.339239:0:8908:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bcac8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790945791.340191:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638502528 00000100:00100000:3.0:1790945791.340203:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638502528 00000100:00100000:3.0:1790945791.340255:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1790945791.340265:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af616050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:8908:x1877942638502528:12345-0@lo:502: 00000100:00100000:3.0:1790945791.342065:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af616050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:8908:x1877942638502528:12345-0@lo:502: Request processed in 1795us (4523us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945791.342079:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1790945791.345129:0:8908:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:8908:1877942638502528:0@lo:502: 00000040:00080000:1.0:1790945791.345197:0:8908:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1790945791.345569:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1790945791.345593:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790945791.345659:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27cf23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cf2a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945791.345685:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27cf23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cf2a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790945791.345695:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790945791.345697:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d40bacd0800 from 5 10000000:01000000:3.0:1790945791.345700:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790945791.345735:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27cf31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945791.345743:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27cf31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945791.345751:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27cf31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945791.345769:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638502656:0@lo:101: 00000100:00100000:3.0:1790945791.348710:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945791.348772:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40871a9000 going to sleep for 11 seconds 00000100:00100000:1.0:1790945791.349005:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638502656 00000100:00100000:1.0:1790945791.349015:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638502656 00000100:00100000:1.0:1790945791.349061:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790945791.349070:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af616850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:6519:x1877942638502656:12345-0@lo:101: 00010000:00010000:1.0:1790945791.349089:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945791.349109:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40c21d7c00/0xd9f4181e0d27cf38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27cf31 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945791.349136:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40c21d7c00/0xd9f4181e0d27cf38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27cf31 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945791.349148:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40c21d7c00/0xd9f4181e0d27cf38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27cf31 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945791.349204:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40c21d7c00, rc 0) 00000100:00100000:1.0:1790945791.349254:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af616850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:6519:x1877942638502656:12345-0@lo:101: Request processed in 184us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945791.349260:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1790945791.355116:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638502656:0@lo:101: 00010000:00010000:3.0:1790945791.355151:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27cf31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cf38 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945791.355165:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27cf31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27cf38 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945791.355266:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638502784:0@lo:256: 00000100:00100000:3.0:1790945791.355328:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945791.355382:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40871a9000 going to sleep for 11 seconds 00000100:00100000:0.0:1790945791.355527:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638502784 00000100:00100000:0.0:1790945791.355536:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638502784 00000100:00100000:0.0:1790945791.355576:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1790945791.355585:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af615050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:6519:x1877942638502784:12345-0@lo:256: 20000000:01000000:0.0:1790945791.355621:0:6514:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790945791.355637:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790945791.355640:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1790945791.355733:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af615050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:6519:x1877942638502784:12345-0@lo:256: Request processed in 148us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945791.355741:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1790945791.356023:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638502784:0@lo:256: 10000000:01000000:3.0:1790945791.356070:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790945791.356077:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27cf31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cf38 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945791.356087:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27cf31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cf38 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790945791.356095:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1790945791.356097:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:3.0:1790945791.356099:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1790945791.356123:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27cf3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945791.356132:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27cf3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945791.356142:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27cf3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945791.356153:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638502912:0@lo:101: 00000100:00100000:3.0:1790945791.356210:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945791.356229:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40871a9000 going to sleep for 11 seconds 00000100:00100000:1.0:1790945791.357226:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638502912 00000100:00100000:1.0:1790945791.357236:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638502912 00000100:00100000:1.0:1790945791.357276:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790945791.357284:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af617850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:6519:x1877942638502912:12345-0@lo:101: 00010000:00010000:1.0:1790945791.357297:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945791.357311:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40c21d7600/0xd9f4181e0d27cf46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27cf3f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945791.357348:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40c21d7600/0xd9f4181e0d27cf46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27cf3f expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945791.357359:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40c21d7600/0xd9f4181e0d27cf46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27cf3f expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945791.357376:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40c21d7600, rc 0) 00000100:00100000:1.0:1790945791.357439:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af617850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:6519:x1877942638502912:12345-0@lo:101: Request processed in 155us (1228us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945791.357447:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1790945791.359261:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638502912:0@lo:101: 00010000:00010000:3.0:1790945791.359289:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27cf3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cf46 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945791.359301:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27cf3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27cf46 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945791.359427:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638503040:0@lo:501: 00000100:00100000:3.0:1790945791.359474:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945791.359516:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40871a9000 going to sleep for 11 seconds 00000100:00100000:1.0:1790945791.359694:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638503040 00000100:00100000:1.0:1790945791.359700:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638503040 00000100:00100000:1.0:1790945791.359744:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790945791.359753:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af616450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:6519:x1877942638503040:12345-0@lo:501: 00000100:00100000:1.0:1790945791.359922:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af616450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:6519:x1877942638503040:12345-0@lo:501: Request processed in 170us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945791.359937:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1790945791.364538:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638503040:0@lo:501: 00000100:00100000:2.0:1790945791.364610:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638503168:0@lo:503: 00000100:00100000:2.0:1790945791.364692:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945791.364741:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40af69a300 going to sleep for 11 seconds 00000100:00100000:0.0:1790945791.364799:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638503168 00000100:00100000:0.0:1790945791.364807:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638503168 00000100:00100000:0.0:1790945791.364869:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1790945791.364878:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:6519:x1877942638503168:12345-0@lo:503: 00000100:00100000:0.0:1790945791.365019:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:6519:x1877942638503168:12345-0@lo:503: Request processed in 141us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945791.365029:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1790945791.365391:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638503168:0@lo:503: 00000100:00100000:2.0:1790945791.368235:0:8909:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:8909:1877942638503296:0@lo:502: 00000100:00100000:2.0:1790945791.368320:0:8909:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945791.368372:0:8909:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40af69ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1790945791.368383:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638503296 00000100:00100000:0.0:1790945791.368391:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638503296 00000100:00100000:0.0:1790945791.368451:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1790945791.368461:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:8909:x1877942638503296:12345-0@lo:502: 00000100:00100000:0.0:1790945791.368614:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:8909:x1877942638503296:12345-0@lo:502: Request processed in 154us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945791.368621:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790945791.368667:0:8909:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:8909:1877942638503296:0@lo:502: 00000020:01000000:2.0:1790945791.368701:0:8909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790945791.368708:0:8909:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1790945791.368715:0:8909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945791.368717:0:8909:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1790945791.368722:0:8909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790945791.368726:0:8909:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.120@tcp to nid 0x20000c0a8cc78 (192.168.204.120@tcp) 00000020:01000000:2.0:1790945791.368749:0:8909:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1790945791.368752:0:8909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790945791.368777:0:8909:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9d40bca819c0) 00000020:00000080:2.0:1790945791.368800:0:8909:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1790945791.368807:0:8909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790945791.368888:0:8909:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1790945791.368895:0:8909:0:(osd_handler.c:8931:osd_obd_connect()) connect #4 00000020:00000080:2.0:1790945791.368903:0:8909:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd9f4181e0d27cf54 00010000:00080000:2.0:1790945791.368932:0:8909:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d40bc913000@lustre-OST0000-osc-MDT0001: add connection 192.168.204.120@tcp at head 00010000:00010000:2.0:1790945791.369351:0:8909:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1790945791.384683:0:8909:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1790945791.384720:0:8909:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1790945791.384971:0:8909:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790945791.385254:0:8909:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790945791.385491:0:8909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1790945791.385606:0:8909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1790945791.393548:0:8910:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790945791.393556:0:8910:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1790945791.394816:0:8909:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790945791.394828:0:8909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1790945791.394867:0:8909:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1790945791.394888:0:8909:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd9f4181e0d27cf5b 00000100:00080000:0.0:1790945791.394902:0:8909:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790945791.394913:0:8909:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9d40bc913000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1790945791.395065:0:8909:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f825a4a80 x1877942638503424/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790945791.395128:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638503424:0@lo:8: 00000100:00100000:2.0:1790945791.395237:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790945791.395336:0:8909:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1790945791.395422:0:8909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790945791.395427:0:8909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945791.395430:0:8909:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1790945791.395434:0:8909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790945791.395439:0:8909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945791.395440:0:8909:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790945791.395444:0:8909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790945791.395446:0:8909:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1790945791.395473:0:8909:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:8909:1877942638504320:0@lo:502: 00000100:00100000:1.0:1790945791.395479:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638503936:0@lo:400: 00000100:00100000:0.0:1790945791.395540:0:8909:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945791.395542:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945791.395564:0:8909:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408704f000 going to sleep for 11 seconds 00000100:00100000:1.0:1790945791.395575:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790945791.395582:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877942638503552:0@lo:400: 00000100:00100000:1.0:1790945791.395607:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945791.395624:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40baceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1877942638504064:0@lo:400: 00000100:00100000:1.0:1790945791.395648:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945791.395675:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638503936 00000100:00100000:1.0:1790945791.395681:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638503936 00000100:00100000:3.0:1790945791.395704:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638503424 00000100:00100000:3.0:1790945791.395710:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638503424 00000100:00100000:1.0:1790945791.395723:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790945791.395732:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638503936:12345-0@lo:400: 00000100:00100000:3.0:1790945791.395738:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790945791.395745:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1877942638503424:12345-0@lo:8: 00010000:00080000:3.0:1790945791.395767:0:8435:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 242 last 0 00000100:00100000:1.0:1790945791.395789:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638503936:12345-0@lo:400: Request processed in 57us (249us total) trans 0 rc 0/0 00000020:00000080:3.0:1790945791.395793:0:8435:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd9f4181e0d27cf62 00000100:00100000:1.0:1790945791.395809:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00002000:00100000:3.0:1790945791.395824:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9d3f81b16800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1790945791.395830:0:8435:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000100:00100000:1.0:1790945791.395831:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638503552 00000001:00000004:3.0:1790945791.395834:0:8435:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1790945791.395836:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638503552 00000100:00100000:1.0:1790945791.395861:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638504064 00000100:00100000:1.0:1790945791.395864:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638504064 00002000:00100000:3.0:1790945791.395889:0:8435:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1790945791.395890:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790945791.395899:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877942638503552:12345-0@lo:400: 00000100:00100000:1.0:1790945791.395928:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877942638503552:12345-0@lo:400: Request processed in 32us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945791.395933:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790945791.395944:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790945791.395950:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877942638504064:12345-0@lo:400: 00000100:00100000:1.0:1790945791.396001:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877942638504064:12345-0@lo:400: Request processed in 52us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945791.396007:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1790945791.396103:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790945791.396140:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d40bacee300 x1877942638503552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1790945791.396142:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00100000:1.0:1790945791.396163:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877942638503552:0@lo:400: 00000100:00080000:3.0:1790945791.396192:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9d3f81b14000 : changing import state from RECOVER to FULL 00010000:00080000:1.0:1790945791.396198:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d40baceca80 x1877942638504064/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945791.396207:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40baceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1877942638504064:0@lo:400: 00000100:00100000:1.0:1790945791.396217:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638503936:0@lo:400: 00000100:00100000:1.0:1790945791.396243:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638504320 00000100:00100000:1.0:1790945791.396247:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638504320 00000100:00100000:1.0:1790945791.396271:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1790945791.396502:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1877942638503808:0@lo:400: 00000100:00100000:0.0:1790945791.396536:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945791.396561:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790945791.396567:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40baced880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638503680:0@lo:400: 00000100:00100000:0.0:1790945791.396588:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945791.396618:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1877942638504192:0@lo:400: 00000100:00100000:0.0:1790945791.396637:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945791.396673:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638503680 00000100:00100000:0.0:1790945791.396677:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638503680 00000100:00100000:0.0:1790945791.396714:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790945791.396721:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638503680:12345-0@lo:400: 00000100:00100000:0.0:1790945791.396757:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638503680:12345-0@lo:400: Request processed in 37us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945791.396770:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790945791.396796:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40baced880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638503680:0@lo:400: 00000100:00100000:0.0:1790945791.396809:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638503808 00000100:00100000:0.0:1790945791.396811:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638503808 00000100:00100000:0.0:1790945791.396827:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638504192 00000100:00100000:0.0:1790945791.396829:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638504192 00000100:00100000:0.0:1790945791.396844:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790945791.396849:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1877942638503808:12345-0@lo:400: 00000100:00100000:0.0:1790945791.396876:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1877942638503808:12345-0@lo:400: Request processed in 27us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945791.396881:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790945791.396892:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790945791.396897:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1877942638504192:12345-0@lo:400: 00000100:00100000:0.0:1790945791.396922:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1877942638504192:12345-0@lo:400: Request processed in 25us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945791.396941:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1790945791.396976:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d40b4d02300 x1877942638504192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945791.396985:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1877942638504192:0@lo:400: 00010000:00080000:0.0:1790945791.396994:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d40bacedc00 x1877942638503808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945791.397001:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1877942638503808:0@lo:400: 00000100:00100000:1.0:1790945791.397022:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:8909:x1877942638504320:12345-0@lo:502: 00000100:00080000:0.0:1790945791.397040:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790945791.397531:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:8909:x1877942638504320:12345-0@lo:502: Request processed in 1253us (1993us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945791.397540:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1790945791.397650:0:8909:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:8909:1877942638504320:0@lo:502: 00000020:01000000:0.0:1790945791.397677:0:8909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790945791.397688:0:8909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945791.397690:0:8909:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:0.0:1790945791.397705:0:8909:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:1.0:1790945791.397826:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:1.0:1790945791.397854:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1790945791.397864:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27cf3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cf46 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945791.397874:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27cf3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cf46 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945791.397894:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1790945791.397897:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d4087223000 from 30 10000000:01000000:1.0:1790945791.397900:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790945791.397927:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6800/0xd9f4181e0d27cf69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945791.397934:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6800/0xd9f4181e0d27cf69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945791.397943:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6800/0xd9f4181e0d27cf69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945791.397968:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d00e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638504448:0@lo:101: 00000100:00100000:1.0:1790945791.397997:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945791.398029:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4084878b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790945791.398223:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638504448 00000100:00100000:0.0:1790945791.398229:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638504448 00000100:00100000:0.0:1790945791.398257:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1790945791.398264:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:6519:x1877942638504448:12345-0@lo:101: 00010000:00010000:0.0:1790945791.398274:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945791.398358:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d4086a4c800/0xd9f4181e0d27cf70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27cf69 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945791.398380:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d4086a4c800/0xd9f4181e0d27cf70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27cf69 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945791.398391:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d4086a4c800/0xd9f4181e0d27cf70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27cf69 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945791.398399:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4086a4c800, rc 0) 00000100:00100000:0.0:1790945791.398431:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:6519:x1877942638504448:12345-0@lo:101: Request processed in 166us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945791.398436:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1790945791.398606:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d00e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638504448:0@lo:101: 00010000:00010000:1.0:1790945791.398724:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6800/0xd9f4181e0d27cf69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cf70 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945791.398733:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6800/0xd9f4181e0d27cf69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27cf70 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945791.398782:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d00e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638504576:0@lo:501: 00000100:00100000:1.0:1790945791.398866:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945791.398893:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4084878b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790945791.398916:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638504576 00000100:00100000:1.0:1790945791.398919:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638504576 00000100:00100000:1.0:1790945791.398938:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790945791.398951:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:6519:x1877942638504576:12345-0@lo:501: 00000100:00100000:1.0:1790945791.399129:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:6519:x1877942638504576:12345-0@lo:501: Request processed in 177us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945791.399136:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790945791.399162:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d00e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638504576:0@lo:501: 00000100:00100000:1.0:1790945791.399217:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d00e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638504704:0@lo:503: 00000100:00100000:1.0:1790945791.399253:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945791.399265:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4084878b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790945791.400071:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638504704 00000100:00100000:0.0:1790945791.400079:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638504704 00000100:00100000:0.0:1790945791.400111:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1790945791.400119:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:6519:x1877942638504704:12345-0@lo:503: 00000100:00100000:0.0:1790945791.400242:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:6519:x1877942638504704:12345-0@lo:503: Request processed in 124us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945791.400250:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1790945791.400356:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d00e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638504704:0@lo:503: 00000100:00100000:0.0:1790945791.402586:0:8912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:8912:1877942638504832:0@lo:502: 00000100:00100000:0.0:1790945791.402663:0:8912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945791.402703:0:8912:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408704f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790945791.402944:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638504832 00000100:00100000:1.0:1790945791.402952:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638504832 00000100:00100000:1.0:1790945791.403008:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1790945791.403018:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:8912:x1877942638504832:12345-0@lo:502: 00000100:00100000:1.0:1790945791.403151:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:8912:x1877942638504832:12345-0@lo:502: Request processed in 135us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945791.403159:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1790945791.403226:0:8912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:8912:1877942638504832:0@lo:502: 00000100:00100000:1.0:1790945791.403296:0:8912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d01180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:8912:1877942638504960:0@lo:502: 00000100:00100000:1.0:1790945791.403328:0:8912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945791.403347:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638504960 00000100:00100000:1.0:1790945791.403350:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638504960 00000100:00100000:1.0:1790945791.403367:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1790945791.403372:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:8912:x1877942638504960:12345-0@lo:502: 00000100:00100000:1.0:1790945791.403428:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:8912:x1877942638504960:12345-0@lo:502: Request processed in 55us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945791.403434:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1790945791.403463:0:8912:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bc901840 going to sleep for 11 seconds 00000100:00100000:0.0:1790945791.403476:0:8912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d01180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:8912:1877942638504960:0@lo:502: 00000040:00080000:0.0:1790945791.403496:0:8912:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00010000:00080000:2.0:1790945791.403624:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f825a4a80 x1877942638503424/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790945801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945791.403636:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790945791.403644:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1790945791.403652:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000020:01000000:1.0:1790945791.403662:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 00000100:00080000:2.0:1790945791.403666:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1790945791.403671:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40bc913000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790945791.403682:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1877942638503424:12345-0@lo:8: Request processed in 7932us (8441us total) trans 0 rc 0/0 00000004:00080000:2.0:1790945791.403686:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 10000000:01000000:1.0:1790945791.403686:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00100000:2.0:1790945791.403697:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638503424:0@lo:8: 00010000:00010000:1.0:1790945791.403698:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6800/0xd9f4181e0d27cf69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cf70 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945791.403706:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1790945791.403715:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6800/0xd9f4181e0d27cf69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cf70 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945791.403726:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790945791.403728:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d4087223000 from 5 10000000:01000000:1.0:1790945791.403732:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790945791.403757:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27cf77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945791.403765:0:8911:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8911:1877942638505216:0@lo:700: 00010000:00010000:1.0:1790945791.403767:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27cf77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945791.403780:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27cf77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945791.403795:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d00700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638505088:0@lo:101: 00000100:00100000:3.0:1790945791.403808:0:8911:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945791.403829:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945791.403840:0:8911:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40871a93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790945791.403849:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4091069300 going to sleep for 11 seconds 00000100:00100000:1.0:1790945791.403866:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638505088 00000100:00100000:1.0:1790945791.403869:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638505088 00000100:00100000:1.0:1790945791.403989:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1790945791.403997:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:6519:x1877942638505088:12345-0@lo:101: 00010000:00010000:1.0:1790945791.404006:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945791.404019:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40c21d7400/0xd9f4181e0d27cf7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27cf77 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945791.404066:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40c21d7400/0xd9f4181e0d27cf7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27cf77 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945791.404077:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40c21d7400/0xd9f4181e0d27cf7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27cf77 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945791.404085:0:8443:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638505216 00010000:00010000:1.0:1790945791.404086:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40c21d7400, rc 0) 00000100:00100000:2.0:1790945791.404094:0:8443:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638505216 00000100:00100000:1.0:1790945791.404121:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+19:6519:x1877942638505088:12345-0@lo:101: Request processed in 125us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945791.404127:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1790945791.404156:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790945791.404197:0:8443:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8911:x1877942638505216:12345-0@lo:700: 00000100:00100000:2.0:1790945791.404227:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc3480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8443:1877942638505344:0@lo:700: 00000100:00100000:2.0:1790945791.404261:0:8443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945791.404396:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638505344 00000100:00100000:1.0:1790945791.404401:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638505344 00000100:00100000:1.0:1790945791.404429:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1790945791.404433:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790945791.404437:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8443:x1877942638505344:12345-0@lo:700: 00000100:00100000:3.0:1790945791.404459:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d00700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638505088:0@lo:101: 00010000:00010000:3.0:1790945791.404473:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27cf77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cf7e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945791.404496:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27cf77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27cf7e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945791.404676:0:8443:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40af69a240 going to sleep for 11 seconds 00000100:00100000:3.0:1790945791.404768:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638505472:0@lo:256: 00000100:00100000:3.0:1790945791.404803:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945791.404834:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40871a9900 going to sleep for 11 seconds 00000100:00100000:1.0:1790945791.404874:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638505472 00000100:00100000:1.0:1790945791.404879:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638505472 00000004:00080000:0.0:1790945791.404895:0:8910:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1790945791.404908:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1790945791.404914:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+19:6519:x1877942638505472:12345-0@lo:256: 20000000:01000000:1.0:1790945791.404927:0:6516:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790945791.404943:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790945791.404946:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000004:00080000:0.0:1790945791.404946:0:8910:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 242220778031ns, next at 0ns, rc = 0 00080000:00080000:0.0:1790945791.404952:0:8910:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1790945791.405068:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+19:6519:x1877942638505472:12345-0@lo:256: Request processed in 153us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945791.405076:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1790945791.405495:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638505472:0@lo:256: 10000000:01000000:0.0:1790945791.405554:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790945791.405561:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27cf77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cf7e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945791.405568:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27cf77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cf7e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945791.405576:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1790945791.405578:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1790945791.405580:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1790945791.405600:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d200/0xd9f4181e0d27cf85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945791.405607:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d200/0xd9f4181e0d27cf85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945791.405614:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d200/0xd9f4181e0d27cf85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945791.405648:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638505600:0@lo:101: 00000100:00100000:0.0:1790945791.405676:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945791.405704:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408704f240 going to sleep for 11 seconds 00000100:00100000:3.0:1790945791.405767:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638505600 00000100:00100000:3.0:1790945791.405773:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638505600 00000100:00100000:3.0:1790945791.405818:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1790945791.405827:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+19:6519:x1877942638505600:12345-0@lo:101: 00010000:00010000:3.0:1790945791.405836:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945791.405847:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40baef1800/0xd9f4181e0d27cf8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27cf85 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945791.405864:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40baef1800/0xd9f4181e0d27cf8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27cf85 expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945791.405874:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40baef1800/0xd9f4181e0d27cf8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27cf85 expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945791.405882:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40baef1800, rc 0) 00000100:00100000:0.0:1790945791.405988:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638505600:0@lo:101: 00010000:00010000:0.0:1790945791.406000:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d200/0xd9f4181e0d27cf85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cf8c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945791.406008:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d200/0xd9f4181e0d27cf85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27cf8c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945791.406123:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638505728:0@lo:501: 00000100:00100000:0.0:1790945791.406150:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945791.406232:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408704f240 going to sleep for 11 seconds 00000100:00100000:1.0:1790945791.406368:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638505728 00000100:00100000:1.0:1790945791.406373:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638505728 00000100:00100000:1.0:1790945791.406428:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1790945791.406443:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:6519:x1877942638505728:12345-0@lo:501: 00000100:00100000:1.0:1790945791.406566:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:6519:x1877942638505728:12345-0@lo:501: Request processed in 124us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945791.406573:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1790945791.406748:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638505728:0@lo:501: 00000100:00100000:1.0:1790945791.406778:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d03b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638505856:0@lo:503: 00000100:00100000:1.0:1790945791.406813:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945791.406868:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4084073240 going to sleep for 11 seconds 00000100:00100000:0.0:1790945791.406901:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638505856 00000100:00100000:0.0:1790945791.406907:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638505856 00000100:00100000:0.0:1790945791.406974:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1790945791.406981:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:6519:x1877942638505856:12345-0@lo:503: 00000100:00100000:0.0:1790945791.407072:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:6519:x1877942638505856:12345-0@lo:503: Request processed in 91us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945791.407078:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1790945791.408477:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+20:6519:x1877942638505600:12345-0@lo:101: Request processed in 102us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945791.408489:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1790945791.408822:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d03b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638505856:0@lo:503: 00000100:00100000:1.0:1790945791.409045:0:8913:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d03b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:8913:1877942638505984:0@lo:502: 00000100:00100000:1.0:1790945791.409098:0:8913:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945791.409127:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638505984 00000100:00100000:1.0:1790945791.409132:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638505984 00000100:00100000:1.0:1790945791.409159:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1790945791.409179:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+20:8913:x1877942638505984:12345-0@lo:502: 00000100:00100000:1.0:1790945791.409272:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+20:8913:x1877942638505984:12345-0@lo:502: Request processed in 107us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945791.409391:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1790945791.409432:0:8913:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4084073780 going to sleep for 11 seconds 00000100:00100000:1.0:1790945791.409444:0:8913:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d03b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:8913:1877942638505984:0@lo:502: 00000020:01000000:1.0:1790945791.409465:0:8913:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790945791.409472:0:8913:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1790945791.409480:0:8913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790945791.409482:0:8913:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1790945791.409487:0:8913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790945791.409496:0:8913:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.120@tcp to nid 0x20000c0a8cc78 (192.168.204.120@tcp) 00000020:01000000:1.0:1790945791.409518:0:8913:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1790945791.409521:0:8913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790945791.409547:0:8913:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9d40bfe90000) 00000020:00000080:1.0:1790945791.409568:0:8913:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1790945791.409574:0:8913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790945791.411013:0:8913:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1790945791.411024:0:8913:0:(osd_handler.c:8931:osd_obd_connect()) connect #6 00000020:00000080:1.0:1790945791.411091:0:8913:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd9f4181e0d27cf9a 00010000:00080000:1.0:1790945791.411125:0:8913:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d40bfe9d800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.120@tcp at head 00010000:00010000:1.0:1790945791.411515:0:8913:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000004:00080000:2.0:1790945791.413851:0:7452:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 40000000:02000000:1.0:1790945791.414803:0:6528:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:1.0:1790945791.424763:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8443:x1877942638505344:12345-0@lo:700: Request processed in 20321us (20494us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945791.424778:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790945791.425273:0:8443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d40bcbc3480 x1877942638505344/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790945807 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945791.425287:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc3480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8443:1877942638505344:0@lo:700: 40000000:02000000:3.0:1790945791.425308:0:8443:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:01000000:2.0:1790945791.430322:0:8913:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1790945791.430354:0:8913:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1790945791.430603:0:8913:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790945791.430801:0:8913:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790945791.430879:0:8913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1790945791.430977:0:8913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1790945791.439208:0:8914:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790945791.439217:0:8914:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1790945791.441658:0:8913:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790945791.441675:0:8913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1790945791.441730:0:8913:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1790945791.441757:0:8913:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd9f4181e0d27cfa1 00000100:00080000:1.0:1790945791.441770:0:8913:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790945791.441781:0:8913:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9d40bfe9d800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1790945791.441821:0:8913:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d40b4d03b80 x1877942638506112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790945791.441862:0:8913:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1790945791.441944:0:8913:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790945791.441950:0:8913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790945791.441952:0:8913:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1790945791.441955:0:8913:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790945791.441973:0:8913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790945791.441981:0:8913:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790945791.441987:0:8913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790945791.441989:0:8913:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1790945791.442019:0:8913:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d03480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:8913:1877942638506240:0@lo:502: 00000100:00100000:1.0:1790945791.442105:0:8913:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945791.442159:0:8913:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bacc5900 going to sleep for 11 seconds 00000100:00100000:3.0:1790945791.442428:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638506112:0@lo:8: 00000100:00100000:3.0:1790945791.442480:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945791.442611:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638506112 00000100:00100000:2.0:1790945791.442633:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638506112 00000100:00100000:2.0:1790945791.442674:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790945791.442682:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3646:x1877942638506112:12345-0@lo:8: 00010000:00080000:2.0:1790945791.442707:0:8437:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 242 last 0 00000020:00000080:2.0:1790945791.442733:0:8437:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd9f4181e0d27cfa8 00002000:00100000:2.0:1790945791.442746:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9d40b4b74800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1790945791.442750:0:8437:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1790945791.442759:0:8437:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1790945791.443255:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638506240 00000100:00100000:0.0:1790945791.443261:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638506240 00000100:00100000:0.0:1790945791.443307:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1790945791.443315:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+20:8913:x1877942638506240:12345-0@lo:502: 00000100:00100000:0.0:1790945791.443439:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+20:8913:x1877942638506240:12345-0@lo:502: Request processed in 125us (1334us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945791.443457:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1790945791.443620:0:8913:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d03480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:8913:1877942638506240:0@lo:502: 00000020:01000000:1.0:1790945791.443647:0:8913:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790945791.443653:0:8913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790945791.443655:0:8913:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790945791.443659:0:8913:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1790945791.443869:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1790945791.443894:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1790945791.443903:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d200/0xd9f4181e0d27cf85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cf8c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945791.443914:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d200/0xd9f4181e0d27cf85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cf8c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945791.443923:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1790945791.443926:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9d40af68cd40 from 1 10000000:01000000:0.0:1790945791.443929:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790945791.443969:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4086a4ce00/0xd9f4181e0d27cfaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945791.443977:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d4086a4ce00/0xd9f4181e0d27cfaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945791.443987:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d4086a4ce00/0xd9f4181e0d27cfaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945791.444001:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638506368:0@lo:101: 00000100:00100000:0.0:1790945791.444100:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945791.444138:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408704f480 going to sleep for 11 seconds 00000100:00100000:1.0:1790945791.444147:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638506368 00000100:00100000:1.0:1790945791.444153:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638506368 00000100:00100000:1.0:1790945791.444208:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1790945791.444217:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+20:6519:x1877942638506368:12345-0@lo:101: 00010000:00010000:1.0:1790945791.444227:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945791.444241:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40c21d6c00/0xd9f4181e0d27cfb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27cfaf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1790945791.444245:0:8437:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00010000:00010000:1.0:1790945791.444268:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40c21d6c00/0xd9f4181e0d27cfb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27cfaf expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1790945791.444273:0:8437:0:(import.c:65:import_set_state_nolock()) ffff9d40b4b75000 : changing import state from RECOVER to FULL 00010000:00010000:1.0:1790945791.444280:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40c21d6c00/0xd9f4181e0d27cfb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27cfaf expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945791.444288:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40c21d6c00, rc 0) 00000100:00100000:2.0:1790945791.444325:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1877942638506112:12345-0@lo:8: Request processed in 1641us (1843us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945791.444335:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790945791.444338:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:6519:x1877942638506368:12345-0@lo:101: Request processed in 119us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945791.444346:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1790945791.444383:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638506368:0@lo:101: 00010000:00010000:1.0:1790945791.444404:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d4086a4ce00/0xd9f4181e0d27cfaf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cfb6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945791.444413:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d4086a4ce00/0xd9f4181e0d27cfaf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27cfb6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945791.444474:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d03480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638506496:0@lo:501: 00000100:00100000:1.0:1790945791.444502:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945791.444658:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bacc5180 going to sleep for 11 seconds 00000100:00100000:2.0:1790945791.444713:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638506496 00000100:00100000:2.0:1790945791.444719:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638506496 00000100:00100000:2.0:1790945791.444751:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1790945791.444759:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408397d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:6519:x1877942638506496:12345-0@lo:501: 00000100:00100000:2.0:1790945791.444830:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408397d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:6519:x1877942638506496:12345-0@lo:501: Request processed in 72us (327us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790945791.444838:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1790945791.444928:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d03480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638506496:0@lo:501: 10000000:01000000:1.0:1790945791.444947:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1790945791.444953:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4086a4ce00/0xd9f4181e0d27cfaf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cfb6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945791.444972:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d4086a4ce00/0xd9f4181e0d27cfaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cfb6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1790945791.445806:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d40b4d03b80 x1877942638506112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790945801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945791.445818:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790945791.445825:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1790945791.445833:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1790945791.445838:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1790945791.445842:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40bfe9d800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1790945791.445873:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1790945791.445878:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638506112:0@lo:8: 00000004:00080000:1.0:1790945791.445945:0:8914:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1790945791.446020:0:8914:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 242261850951ns, next at 0ns, rc = 0 00080000:00080000:1.0:1790945791.446026:0:8914:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0000: async commit OSD 00000001:00100000:3.0:1790945791.449825:0:8429:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1790945791.450289:0:8443:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8911:x1877942638505216:12345-0@lo:700: Request processed in 46120us (46477us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945791.450302:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1790945791.450396:0:8911:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f81bd1c00 x1877942638505216/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790945807 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945791.450411:0:8911:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8911:1877942638505216:0@lo:700: 00000004:00080000:0.0:1790945791.452247:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1790945791.461002:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790945791.461028:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638506624:0@lo:13: 00000100:00100000:3.0:1790945791.461112:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1790945791.461156:0:8911:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1790945791.461202:0:8911:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8911:1877942638506752:0@lo:7: 00000100:00100000:3.0:1790945791.461227:0:8911:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945791.461251:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638506752 00000100:00100000:3.0:1790945791.461441:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638506752 00000100:00100000:3.0:1790945791.461486:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790945791.461580:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8911:x1877942638506752:12345-0@lo:7: 00000100:00100000:1.0:1790945791.461797:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638506624 00000100:00100000:1.0:1790945791.461801:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638506624 00000100:00100000:1.0:1790945791.461827:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790945791.461833:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1877942638506624:12345-0@lo:13: 00002000:00000024:1.0:1790945791.461854:0:8438:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1790945791.461908:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1877942638506624:12345-0@lo:13: Request processed in 75us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945791.461915:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1790945791.461983:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f81bd1c00 x1877942638506624/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945807 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945791.462002:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638506624:0@lo:13: 00010000:00010000:1.0:1790945791.466238:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945791.471852:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000004:00080000:2.0:1790945791.473704:0:8915:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1790945791.473751:0:8915:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8915:1877942638507008:0@lo:7: 00000100:00100000:2.0:1790945791.473830:0:8915:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945791.473870:0:8915:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40af69a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790945791.474191:0:8437:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1790945791.474199:0:8437:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00002000:00080000:3.0:1790945791.475239:0:8435:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1790945791.475246:0:8435:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1790945791.476124:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638507008 00000100:00100000:1.0:1790945791.476135:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638507008 00000100:00100000:2.0:1790945791.476424:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790945791.476436:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8915:x1877942638507008:12345-0@lo:7: 00000100:00100000:3.0:1790945791.477833:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8911:x1877942638506752:12345-0@lo:7: Request processed in 16251us (16600us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945791.477844:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1790945791.477882:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790945791.477904:0:8911:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40871a93c0 going to sleep for 11 seconds 00010000:00080000:3.0:1790945791.477930:0:8911:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f81bd1f80 x1877942638506752/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790945807 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945791.477945:0:8911:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8911:1877942638506752:0@lo:7: 00000004:00080000:3.0:1790945791.477970:0:8911:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:3.0:1790945791.478005:0:8911:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8911:1877942638507136:0@lo:5: 00000100:00100000:3.0:1790945791.478238:0:8911:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945791.480357:0:8911:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40871a93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790945791.482283:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638506880:0@lo:13: 00000100:00100000:0.0:1790945791.482362:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945791.482481:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638506880 00000100:00100000:3.0:1790945791.482490:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638506880 00000100:00100000:3.0:1790945791.482560:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790945791.482570:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1877942638506880:12345-0@lo:13: 00002000:00000024:3.0:1790945791.482603:0:8438:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1790945791.482650:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1877942638506880:12345-0@lo:13: Request processed in 82us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945791.482657:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790945791.482846:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d40bcbc3800 x1877942638506880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945807 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945791.482874:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638506880:0@lo:13: 00000100:00100000:1.0:1790945791.484225:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638507136 00000100:00100000:1.0:1790945791.484235:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638507136 00000100:00100000:1.0:1790945791.484424:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790945791.484433:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8911:x1877942638507136:12345-0@lo:5: 00002000:00080000:1.0:1790945791.484458:0:8437:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1790945791.484532:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8911:x1877942638507136:12345-0@lo:5: Request processed in 100us (6293us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945791.484538:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1790945791.484606:0:8911:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f81bd1f80 x1877942638507136/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790945807 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945791.484619:0:8911:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8911:1877942638507136:0@lo:5: 00000004:00080000:3.0:1790945791.484632:0:8911:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1790945791.484683:0:8911:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8911:1877942638507264:0@lo:5: 00000100:00100000:3.0:1790945791.484711:0:8911:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:2.0:1790945791.486044:0:8916:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1790945791.486052:0:8916:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1790945791.486125:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8915:x1877942638507008:12345-0@lo:7: Request processed in 9690us (12293us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945791.486134:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1790945791.486763:0:8915:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d40bcbc0380 x1877942638507008/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790945807 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945791.486787:0:8915:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8915:1877942638507008:0@lo:7: 00000004:00080000:2.0:1790945791.486803:0:8915:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1790945791.486836:0:8915:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8915:1877942638507392:0@lo:5: 00000100:00100000:2.0:1790945791.486870:0:8915:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945791.486883:0:8915:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408fc76300 going to sleep for 11 seconds 00000100:00100000:2.0:1790945791.486897:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638507264 00000100:00100000:2.0:1790945791.486904:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638507264 00000100:00100000:2.0:1790945791.486931:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638507392 00000100:00100000:2.0:1790945791.486934:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638507392 00000100:00100000:2.0:1790945791.486947:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790945791.486967:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8911:x1877942638507264:12345-0@lo:5: 00002000:00080000:2.0:1790945791.487003:0:8916:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1790945791.489403:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:8911:x1877942638507264:12345-0@lo:5: Request processed in 2443us (4685us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1790945791.489414:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790945791.489442:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790945791.489451:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8915:x1877942638507392:12345-0@lo:5: 00002000:00080000:2.0:1790945791.489474:0:8916:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1790945791.489477:0:8916:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1790945791.490201:0:8911:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40871a93c0 going to sleep for 11 seconds 00010000:00080000:0.0:1790945791.490236:0:8911:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f81bd1f80 x1877942638507264/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790945807 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945791.490363:0:8911:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8911:1877942638507264:0@lo:5: 00000004:00080000:0.0:1790945791.490380:0:8911:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1790945791.490417:0:8911:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8911:1877942638507520:0@lo:900: 00000100:00100000:0.0:1790945791.490453:0:8911:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945791.490473:0:8911:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408704fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1790945791.490591:0:6533:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638507520 00000100:00100000:2.0:1790945791.490653:0:6533:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638507520 00000100:00100000:2.0:1790945791.490690:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790945791.490697:0:6533:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8911:x1877942638507520:12345-0@lo:900: 00000100:00100000:2.0:1790945791.490749:0:6533:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8911:x1877942638507520:12345-0@lo:900: Request processed in 52us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945791.490755:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790945791.490847:0:8911:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f825a7800 x1877942638507520/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790945807 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945791.490858:0:8911:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8911:1877942638507520:0@lo:900: 00000001:00080000:3.0:1790945791.507601:0:8429:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:3.0:1790945791.507619:0:8429:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1790945791.507633:0:8429:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1790945791.507865:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8915:x1877942638507392:12345-0@lo:5: Request processed in 18412us (20989us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1790945791.507876:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1790945791.507985:0:8915:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d40bcbc0380 x1877942638507392/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790945807 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945791.507997:0:8915:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1790945791.508004:0:8915:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8915:1877942638507392:0@lo:5: 00000004:00080000:0.0:1790945791.508019:0:8915:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1790945791.508078:0:8915:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8915:1877942638507648:0@lo:700: 00000100:00100000:0.0:1790945791.508123:0:8915:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945791.508162:0:8915:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408704ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1790945791.508302:0:8444:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638507648 00000100:00100000:2.0:1790945791.508310:0:8444:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638507648 00000100:00100000:2.0:1790945791.508352:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790945791.508361:0:8444:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8915:x1877942638507648:12345-0@lo:700: 00000100:00100000:2.0:1790945791.536446:0:8444:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8915:x1877942638507648:12345-0@lo:700: Request processed in 28076us (28313us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945791.536461:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790945791.536772:0:8915:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f825a5180 x1877942638507648/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790945807 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945791.536787:0:8915:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8915:1877942638507648:0@lo:700: 00000004:02000040:0.0:1790945791.540070:0:8915:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:0.0:1790945791.553094:0:8915:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8915:1877942638507776:0@lo:5: 00000100:00100000:0.0:1790945791.553217:0:8915:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945791.553278:0:8915:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408704ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1790945791.553886:0:8436:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638507776 00000100:00100000:1.0:1790945791.553897:0:8436:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638507776 00000100:00100000:1.0:1790945791.553951:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790945791.553970:0:8436:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8915:x1877942638507776:12345-0@lo:5: 00002000:00080000:1.0:1790945791.572018:0:8436:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1790945791.572052:0:8436:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:1.0:1790945791.582037:0:8436:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8915:x1877942638507776:12345-0@lo:5: Request processed in 28060us (28812us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1790945791.582050:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1790945791.582425:0:8915:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f825a5180 x1877942638507776/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790945807 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945791.582443:0:8915:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8915:1877942638507776:0@lo:5: 00000004:00080000:0.0:1790945791.582458:0:8915:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000001:00080000:1.0:1790945791.823134:0:8429:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:3.0:1790945792.479857:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1790945792.905613:0:8966:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790945792.906409:0:8966:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1790945793.376397:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638507904:0@lo:41: 00000100:00100000:0.0:1790945793.376497:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945793.377036:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638507904 00000100:00100000:2.0:1790945793.377045:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638507904 00000100:00100000:2.0:1790945793.377102:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790945793.377112:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638507904:12345-0@lo:41: 00000004:00000024:2.0:1790945793.377148:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1790945793.377250:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638507904:12345-0@lo:41: Request processed in 139us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945793.377258:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790945793.377351:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638507904:0@lo:41: 00010000:00010000:1.0:1790945793.504623:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945793.890064:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790945793.890091:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638508032:0@lo:41: 00000100:00100000:0.0:1790945793.890161:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945793.890252:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638508032 00000100:00100000:0.0:1790945793.890260:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638508032 00000100:00100000:0.0:1790945793.890302:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790945793.890311:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638508032:12345-0@lo:41: 00000004:00000024:0.0:1790945793.890347:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1790945793.890393:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638508032:12345-0@lo:41: Request processed in 82us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945793.890401:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790945793.890445:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638508032:0@lo:41: 00000020:00000004:1.0:1790945794.049149:0:9014:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790945794.049161:0:9014:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:3.0:1790945794.527639:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945795.551392:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945796.448586:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8841fcfb-fb47-4307-92c2-97500c1c82bd:3648:1877942638508160:0@lo:400: 00000100:00100000:2.0:1790945796.448658:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945796.448705:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638508672:0@lo:400: 00000100:00100000:2.0:1790945796.448731:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945796.448750:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bad2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638509184:0@lo:400: 00000100:00100000:2.0:1790945796.448772:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945796.448798:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1790945796.448804:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1877942638508544:0@lo:400: 00000100:00100000:2.0:1790945796.448827:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945796.448855:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bad2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638509056:0@lo:400: 00000100:00100000:2.0:1790945796.448892:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945796.448924:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638508672 00000100:00100000:2.0:1790945796.448931:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638508672 00000100:00100000:2.0:1790945796.448989:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790945796.448999:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bad28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638508672:12345-0@lo:400: 00000100:00100000:2.0:1790945796.449051:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bad28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638508672:12345-0@lo:400: Request processed in 53us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945796.449059:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790945796.449079:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638509184 00000100:00100000:2.0:1790945796.449082:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638509184 00000100:00100000:2.0:1790945796.449119:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638509056 00000100:00100000:2.0:1790945796.449122:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638509056 00000100:00100000:2.0:1790945796.449141:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790945796.449146:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bad28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638509184:12345-0@lo:400: 00000100:00100000:2.0:1790945796.449261:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bad28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638509184:12345-0@lo:400: Request processed in 114us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945796.449269:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790945796.449281:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790945796.449287:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bad2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638509056:12345-0@lo:400: 00000100:00100000:2.0:1790945796.449383:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bad2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638509056:12345-0@lo:400: Request processed in 96us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945796.449389:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790945796.449406:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638508544 00000100:00100000:2.0:1790945796.449409:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638508544 00000100:00100000:2.0:1790945796.449431:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790945796.449436:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bad29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1877942638508544:12345-0@lo:400: 00000100:00100000:2.0:1790945796.449462:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bad29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1877942638508544:12345-0@lo:400: Request processed in 26us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945796.449474:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1790945796.449518:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d40bcbc3100 x1877942638508544/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945796.449531:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1877942638508544:0@lo:400: 00010000:00080000:2.0:1790945796.449542:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d40bad2aa00 x1877942638509056/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945796.449549:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1790945796.449564:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bad2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638509056:0@lo:400: 00000100:00100000:2.0:1790945796.449573:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638508672:0@lo:400: 00010000:00080000:2.0:1790945796.449582:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d40bad2b100 x1877942638509184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945796.449589:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1790945796.449596:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bad2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638509184:0@lo:400: 00000100:00080000:3.0:1790945796.452080:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790945796.453462:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877942638508288:0@lo:400: 00000100:00100000:1.0:1790945796.453670:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945796.453743:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1877942638508800:0@lo:400: 00000100:00100000:1.0:1790945796.453765:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945796.456640:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638508288 00000100:00100000:2.0:1790945796.456658:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638508288 00000100:00100000:1.0:1790945796.456686:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790945796.456699:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638508416:0@lo:400: 00000100:00100000:1.0:1790945796.456751:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945796.456784:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1877942638508928:0@lo:400: 00000100:00100000:1.0:1790945796.456813:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945796.456871:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638508160 00000100:00100000:1.0:1790945796.456876:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638508160 00000100:00100000:1.0:1790945796.456918:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1790945796.456926:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408397fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:3648:x1877942638508160:12345-0@lo:400: 00000100:00100000:1.0:1790945796.456998:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408397fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:3648:x1877942638508160:12345-0@lo:400: Request processed in 73us (8341us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945796.457006:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1790945796.457794:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638508800 00000100:00100000:1.0:1790945796.457801:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638508800 00000100:00100000:1.0:1790945796.457841:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638508928 00000100:00100000:1.0:1790945796.457844:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638508928 00000100:00100000:1.0:1790945796.457873:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790945796.457881:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877942638508800:12345-0@lo:400: 00000100:00100000:1.0:1790945796.457940:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877942638508800:12345-0@lo:400: Request processed in 60us (4173us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945796.457946:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790945796.457959:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790945796.457965:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877942638508928:12345-0@lo:400: 00000100:00100000:1.0:1790945796.457993:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877942638508928:12345-0@lo:400: Request processed in 28us (1178us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945796.457998:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1790945796.458038:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d40bcbc3480 x1877942638508928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945796.458052:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1877942638508928:0@lo:400: 00010000:00080000:1.0:1790945796.458064:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d40bcbc3800 x1877942638508800/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945796.458072:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1877942638508800:0@lo:400: 00000100:00100000:1.0:1790945796.458249:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8841fcfb-fb47-4307-92c2-97500c1c82bd:3648:1877942638508160:0@lo:400: 00000100:00100000:2.0:1790945796.459710:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638508416 00000100:00100000:2.0:1790945796.459723:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638508416 00000100:00100000:2.0:1790945796.459767:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790945796.459776:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638508416:12345-0@lo:400: 00000100:00100000:2.0:1790945796.459848:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638508416:12345-0@lo:400: Request processed in 75us (3098us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945796.459855:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790945796.459904:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638508416:0@lo:400: 00000100:00100000:2.0:1790945796.461140:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790945796.461157:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877942638508288:12345-0@lo:400: 00000100:00100000:2.0:1790945796.461378:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877942638508288:12345-0@lo:400: Request processed in 222us (7708us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945796.461387:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1790945796.461433:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d40bcbc2d80 x1877942638508288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945796.461447:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877942638508288:0@lo:400: 00000100:00080000:3.0:1790945796.463085:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790945796.463094:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790945796.577693:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945796.959637:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bad2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638509312:0@lo:13: 00000100:00100000:3.0:1790945796.959714:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945796.959861:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638509312 00000100:00100000:1.0:1790945796.959870:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638509312 00000100:00100000:1.0:1790945796.959918:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790945796.959926:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638509312:12345-0@lo:13: 00002000:00000024:1.0:1790945796.959952:0:8438:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790945796.960524:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638509312:12345-0@lo:13: Request processed in 597us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945796.960532:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790945796.960563:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638509440:0@lo:13: 00000100:00100000:1.0:1790945796.960609:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945796.960713:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638509440 00000100:00100000:2.0:1790945796.960719:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638509440 00000100:00100000:2.0:1790945796.960750:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790945796.960758:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638509440:12345-0@lo:13: 00002000:00000024:2.0:1790945796.960772:0:8438:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790945796.960808:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638509440:12345-0@lo:13: Request processed in 51us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945796.960814:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1790945796.960867:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f825a6680 x1877942638509440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945812 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945796.960886:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638509440:0@lo:13: 00010000:00080000:3.0:1790945796.961128:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d40bad2b100 x1877942638509312/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945812 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945796.961141:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bad2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638509312:0@lo:13: 00010000:00010000:1.0:1790945797.604468:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945798.496923:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638509568:0@lo:41: 00000100:00100000:2.0:1790945798.497002:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945798.497083:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638509568 00000100:00100000:2.0:1790945798.497105:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638509568 00000100:00100000:2.0:1790945798.497150:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790945798.497159:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bad2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638509568:12345-0@lo:41: 00000004:00000024:2.0:1790945798.497214:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1790945798.497275:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bad2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638509568:12345-0@lo:41: Request processed in 116us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945798.497282:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790945798.497328:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638509568:0@lo:41: 00010000:00010000:2.0:1790945798.623425:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945799.007898:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bad2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638509696:0@lo:41: 00000100:00100000:1.0:1790945799.007968:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945799.008288:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638509696 00000100:00100000:2.0:1790945799.008296:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638509696 00000100:00100000:2.0:1790945799.008349:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790945799.008359:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638509696:12345-0@lo:41: 00000004:00000024:2.0:1790945799.008393:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1790945799.008450:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638509696:12345-0@lo:41: Request processed in 92us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945799.008458:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790945799.008545:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bad2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638509696:0@lo:41: 00010000:00010000:1.0:1790945799.652518:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945800.671911:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945801.567857:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1877942638510208:0@lo:400: 00000100:00100000:1.0:1790945801.567938:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945801.567990:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638510720:0@lo:400: 00000100:00100000:1.0:1790945801.568017:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945801.568051:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1790945801.568057:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638510080:0@lo:400: 00000100:00100000:2.0:1790945801.568187:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877942638509952:0@lo:400: 00000100:00100000:2.0:1790945801.568219:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945801.568243:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1877942638510464:0@lo:400: 00000100:00100000:2.0:1790945801.568265:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945801.568286:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1790945801.568292:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638509824:0@lo:400: 00000100:00100000:2.0:1790945801.568320:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945801.568341:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638510336:0@lo:400: 00000100:00100000:2.0:1790945801.568364:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945801.568381:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638510848:0@lo:400: 00000100:00100000:2.0:1790945801.568402:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945801.568433:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638510208 00000100:00100000:2.0:1790945801.568459:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638510208 00000100:00100000:2.0:1790945801.568507:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638509952 00000100:00100000:2.0:1790945801.568510:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638509952 00000100:00100000:2.0:1790945801.568522:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638510464 00000100:00100000:2.0:1790945801.568524:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638510464 00000100:00100000:2.0:1790945801.568550:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790945801.568557:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bacedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1877942638510208:12345-0@lo:400: 00000100:00100000:2.0:1790945801.568609:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bacedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1877942638510208:12345-0@lo:400: Request processed in 51us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945801.568617:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790945801.568637:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790945801.568643:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bad2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877942638509952:12345-0@lo:400: 00000100:00100000:2.0:1790945801.568676:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bad2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877942638509952:12345-0@lo:400: Request processed in 33us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945801.568682:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790945801.568694:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790945801.568700:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877942638510464:12345-0@lo:400: 00000100:00100000:2.0:1790945801.568729:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877942638510464:12345-0@lo:400: Request processed in 29us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945801.568736:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790945801.568773:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638510336 00000100:00100000:2.0:1790945801.568777:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638510336 00000100:00100000:2.0:1790945801.568799:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790945801.568806:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638510336:12345-0@lo:400: 00000100:00100000:2.0:1790945801.568841:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638510336:12345-0@lo:400: Request processed in 35us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945801.568847:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790945801.568865:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638510720 00000100:00100000:2.0:1790945801.568876:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638510720 00000100:00100000:2.0:1790945801.568902:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638510848 00000100:00100000:2.0:1790945801.568905:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638510848 00000100:00100000:2.0:1790945801.568923:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790945801.568928:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40baced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638510720:12345-0@lo:400: 00000100:00100000:2.0:1790945801.568957:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40baced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638510720:12345-0@lo:400: Request processed in 29us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945801.568962:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790945801.568973:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790945801.568978:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638510848:12345-0@lo:400: 00000100:00100000:2.0:1790945801.569001:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638510848:12345-0@lo:400: Request processed in 23us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945801.569007:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790945801.569041:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638510336:0@lo:400: 00010000:00080000:2.0:1790945801.569054:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d40b4d02300 x1877942638510848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945801.569064:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638510848:0@lo:400: 00010000:00080000:2.0:1790945801.569074:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d40b4d00000 x1877942638509952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790945801.569205:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790945801.569211:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790945801.569267:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877942638509952:0@lo:400: 00010000:00080000:2.0:1790945801.569281:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d40b4d00700 x1877942638510464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945801.569289:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1877942638510464:0@lo:400: 00000100:00100000:1.0:1790945801.569358:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945801.569389:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1877942638510592:0@lo:400: 00000100:00100000:1.0:1790945801.569414:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1790945801.569445:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d40b4d00a80 x1877942638510208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945801.569454:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1877942638510208:0@lo:400: 00010000:00080000:1.0:1790945801.569463:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d40b4d00e00 x1877942638510720/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945801.569470:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638510720:0@lo:400: 00000100:00100000:1.0:1790945801.569491:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638510592 00000100:00100000:1.0:1790945801.569494:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638510592 00000100:00100000:1.0:1790945801.569524:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790945801.569531:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40baceca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1877942638510592:12345-0@lo:400: 00000100:00100000:1.0:1790945801.569577:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40baceca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1877942638510592:12345-0@lo:400: Request processed in 45us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945801.569583:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1790945801.569613:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d40b4d01180 x1877942638510592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945801.569621:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1877942638510592:0@lo:400: 00000100:00080000:3.0:1790945801.569674:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790945801.569741:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638509824 00000100:00100000:0.0:1790945801.569745:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638509824 00000100:00100000:0.0:1790945801.569782:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1790945801.569790:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408397e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:3650:x1877942638509824:12345-0@lo:400: 00000100:00100000:0.0:1790945801.569843:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408397e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:3650:x1877942638509824:12345-0@lo:400: Request processed in 53us (1521us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945801.569849:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1790945801.569933:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638509824:0@lo:400: 00000100:00100000:2.0:1790945801.569979:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638510080 00000100:00100000:2.0:1790945801.569983:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638510080 00000100:00100000:2.0:1790945801.570024:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790945801.570030:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bacece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638510080:12345-0@lo:400: 00000100:00100000:2.0:1790945801.570432:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bacece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638510080:12345-0@lo:400: Request processed in 46us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945801.570440:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790945801.570658:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638510080:0@lo:400: 00010000:00010000:2.0:1790945801.696294:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945802.079813:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638510976:0@lo:13: 00000100:00100000:3.0:1790945802.079903:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945802.079993:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638510976 00000100:00100000:2.0:1790945802.080002:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638510976 00000100:00100000:2.0:1790945802.080058:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790945802.080068:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638510976:12345-0@lo:13: 00002000:00000024:2.0:1790945802.080097:0:8438:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790945802.080147:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638510976:12345-0@lo:13: Request processed in 80us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945802.080154:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1790945802.080355:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d40bcbc3800 x1877942638510976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945818 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945802.080376:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638510976:0@lo:13: 00000100:00100000:0.0:1790945802.080458:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790945802.080468:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638511104:0@lo:13: 00000100:00100000:0.0:1790945802.080498:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945802.080576:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638511104 00000100:00100000:2.0:1790945802.080581:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638511104 00000100:00100000:2.0:1790945802.080605:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790945802.080612:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638511104:12345-0@lo:13: 00002000:00000024:2.0:1790945802.080624:0:8438:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790945802.080659:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638511104:12345-0@lo:13: Request processed in 48us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945802.080666:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1790945802.080691:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f825a4a80 x1877942638511104/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945818 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945802.080704:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638511104:0@lo:13: 00010000:00010000:2.0:1790945802.719439:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790945803.618867:0:9513:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790945803.618871:0:9513:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1790945803.618878:0:9513:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000100:00100000:0.0:1790945803.618960:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638511232:0@lo:41: 00000080:01200004:3.0:1790945803.619005:0:9513:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9d3f8248e800 00000020:01000004:3.0:1790945803.619020:0:9513:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1790945803.619033:0:9513:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000100:00100000:0.0:1790945803.619037:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1790945803.619046:0:9513:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9d4084803380) 00000020:00000080:3.0:1790945803.619064:0:9513:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00000100:00100000:0.0:1790945803.622528:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638511232 00000100:00100000:0.0:1790945803.622542:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638511232 00000100:00100000:0.0:1790945803.622659:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790945803.622671:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638511232:12345-0@lo:41: 00000004:00000024:0.0:1790945803.622970:0:6526:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1790945803.623131:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638511232:12345-0@lo:41: Request processed in 451us (4080us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945803.623139:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790945803.623421:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638511232:0@lo:41: 00100000:10000000:0.0:1790945803.690444:0:9513:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1790945803.690500:0:9513:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:0.0:1790945803.718733:0:9513:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1790945803.718926:0:9513:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1790945803.718941:0:9513:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:0.0:1790945803.718953:0:9513:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd9f4181e0d27cfc4 00000020:01000004:0.0:1790945803.718959:0:9513:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1790945803.718981:0:9513:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.120@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1790945803.718984:0:9513:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1790945803.718991:0:9513:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1790945803.719024:0:9513:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1790945803.719028:0:9513:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.120@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00010000:00010000:1.0:1790945803.743961:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1790945803.768023:0:9513:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.120@tcp ctxt 0 is initialized 00000020:01000004:0.0:1790945803.768061:0:9513:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.120@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1790945803.768066:0:9513:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1790945803.768068:0:9513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790945803.768069:0:9513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790945803.768071:0:9513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790945803.768072:0:9513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790945803.768073:0:9513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790945803.768075:0:9513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790945803.768076:0:9513:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790945803.768077:0:9513:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790945803.768078:0:9513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790945803.768080:0:9513:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790945803.768084:0:9513:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1790945803.768086:0:9513:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790945803.768088:0:9513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790945803.768089:0:9513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790945803.768090:0:9513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790945803.768091:0:9513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790945803.768092:0:9513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790945803.768093:0:9513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790945803.768094:0:9513:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790945803.768095:0:9513:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790945803.768096:0:9513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790945803.768097:0:9513:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790945803.768123:0:9513:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1790945803.768140:0:9513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:9513:1877942638511360:0@lo:253: 00000100:00100000:0.0:1790945803.768240:0:9513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945803.768290:0:9513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f81b38f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790945803.768972:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638511360 00000100:00100000:1.0:1790945803.768981:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638511360 00000100:00100000:1.0:1790945803.769034:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1790945803.769044:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a72fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:9513:x1877942638511360:12345-0@lo:253: 20000000:01000000:1.0:1790945803.769074:0:6515:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1790945803.769078:0:6515:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1790945803.769083:0:6515:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1790945803.769086:0:6515:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1790945803.769428:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790945803.769555:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:1.0:1790945803.769570:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1790945803.769587:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:1.0:1790945803.769593:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1790945803.769605:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:1.0:1790945803.769619:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:1.0:1790945803.769703:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:1.0:1790945803.769729:0:6515:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.120@tcp 20000000:01000000:1.0:1790945803.769731:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.120@tcp (null) (null) (null) 00000040:00080000:1.0:1790945803.769747:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:1.0:1790945803.769753:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1790945803.769769:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:1.0:1790945803.769779:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.120@tcp (null) (null) 00000040:00080000:1.0:1790945803.769803:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:1.0:1790945803.769812:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1790945803.769825:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:1.0:1790945803.769841:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:1.0:1790945803.769909:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:1.0:1790945803.769921:0:6515:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.120@tcp 20000000:01000000:1.0:1790945803.769922:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.120@tcp (null) (null) (null) 00000040:00080000:1.0:1790945803.769949:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:1.0:1790945803.769956:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1790945803.769970:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:1.0:1790945803.769976:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.204.120@tcp (null) (null) 00000040:00080000:1.0:1790945803.769989:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:1.0:1790945803.769996:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1790945803.770011:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:1.0:1790945803.770026:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:1.0:1790945803.770940:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:1.0:1790945803.770959:0:6515:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.120@tcp 20000000:01000000:1.0:1790945803.770961:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.120@tcp (null) (null) (null) 00000040:00080000:1.0:1790945803.770977:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:1.0:1790945803.770983:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1790945803.770993:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:1.0:1790945803.770998:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.120@tcp (null) (null) 00000040:00080000:1.0:1790945803.771008:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:1.0:1790945803.771015:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1790945803.771027:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:1.0:1790945803.771043:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:1.0:1790945803.771057:0:6515:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1790945803.771060:0:6515:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1790945803.771064:0:6515:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1790945803.771107:0:6515:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1790945803.771110:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1790945803.778027:0:9519:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:3.0:1790945803.778082:0:9519:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:3.0:1790945803.778101:0:9519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:0.0:1790945803.784112:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:0.0:1790945803.784147:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:0.0:1790945803.784163:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:0.0:1790945803.784307:0:6515:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1790945803.784310:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1790945803.784684:0:9520:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 26 1->4: lustre sys.timeout 20000000:01000000:3.0:1790945803.786641:0:9520:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 26 2->4: lustre sys.timeout 00000040:00080000:3.0:1790945803.786670:0:9520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:0.0:1790945803.786984:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:0.0:1790945803.787028:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:0.0:1790945803.787044:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:0.0:1790945803.787058:0:6515:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1790945803.787061:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1790945803.789214:0:9521:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 27 1->4: lustre sys.timeout 20000000:01000000:1.0:1790945803.789271:0:9521:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 27 2->4: lustre sys.timeout 00000040:00080000:1.0:1790945803.789306:0:9521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1790945803.789607:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1790945803.789632:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:0.0:1790945803.789646:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:0.0:1790945803.789657:0:6515:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1790945803.789659:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1790945803.790072:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:2.0:1790945803.790240:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:2.0:1790945803.790269:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:2.0:1790945803.790283:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:2.0:1790945803.790294:0:6515:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1790945803.790295:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1790945803.791790:0:9523:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:1.0:1790945803.791829:0:9523:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:1.0:1790945803.791843:0:9523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:2.0:1790945803.792051:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:2.0:1790945803.792075:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:2.0:1790945803.792091:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 10000000:01000000:2.0:1790945803.792106:0:6515:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1790945803.792126:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d40813ffe00/0xd9f4181e0d27cfcb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945803.792143:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d4086a4d600/0xd9f4181e0d27cec1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ceba expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945803.792149:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d4086a4da00/0xd9f4181e0d27ceeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27cee4 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945803.792155:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d4086a4c000/0xd9f4181e0d27cf2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27cf23 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945803.792161:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40c21d7600/0xd9f4181e0d27cf46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27cf3f expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945803.792197:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d4086a4c800/0xd9f4181e0d27cf70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27cf69 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945803.792207:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40baef1800/0xd9f4181e0d27cf8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27cf85 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945803.792214:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40c21d6c00/0xd9f4181e0d27cfb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27cfaf expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945803.792237:0:6515:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d40813ffe00/0xd9f4181e0d27cfcb lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945803.792272:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40c21d6c00/0xd9f4181e0d27cfb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27cfaf expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945803.792286:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40c21d6c00/0xd9f4181e0d27cfb6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27cfaf expref: 21 pid: 6514 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945803.792300:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1877942638511488:0@lo:104: 00000100:00100000:2.0:1790945803.792373:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790945803.792425:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40baef1800/0xd9f4181e0d27cf8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27cf85 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945803.792432:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40baef1800/0xd9f4181e0d27cf8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27cf85 expref: 21 pid: 6514 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945803.792439:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc3100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1877942638511616:0@lo:104: 00000100:00100000:2.0:1790945803.792460:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790945803.792487:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d4086a4c800/0xd9f4181e0d27cf70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27cf69 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945803.792494:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d4086a4c800/0xd9f4181e0d27cf70 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27cf69 expref: 21 pid: 6514 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945803.792501:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d03100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1877942638511744:0@lo:104: 00000100:00100000:2.0:1790945803.792519:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790945803.792533:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40c21d7600/0xd9f4181e0d27cf46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27cf3f expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945803.792547:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40c21d7600/0xd9f4181e0d27cf46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27cf3f expref: 21 pid: 6515 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945803.792555:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d01180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1877942638511872:0@lo:104: 00000100:00100000:2.0:1790945803.792574:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790945803.792588:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d4086a4c000/0xd9f4181e0d27cf2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27cf23 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945803.792596:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d4086a4c000/0xd9f4181e0d27cf2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27cf23 expref: 21 pid: 6516 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945803.792602:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d00a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1877942638512000:0@lo:104: 00000100:00100000:2.0:1790945803.792619:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790945803.792634:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d4086a4da00/0xd9f4181e0d27ceeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27cee4 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945803.792640:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d4086a4da00/0xd9f4181e0d27ceeb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27cee4 expref: 21 pid: 6514 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945803.792647:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d00000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1877942638512128:0@lo:104: 00000100:00100000:2.0:1790945803.792672:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790945803.792686:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d4086a4d600/0xd9f4181e0d27cec1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27ceba expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945803.792699:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d4086a4d600/0xd9f4181e0d27cec1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27ceba expref: 21 pid: 6514 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945803.792706:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d02300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1877942638512256:0@lo:104: 00000100:00100000:2.0:1790945803.792740:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bc8ac300 going to sleep for 11 seconds 00000100:00100000:0.0:1790945803.792867:0:6504:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1790945803.792886:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945803.792900:0:6504:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638511488 00000100:00100000:0.0:1790945803.792905:0:6504:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638511488 00000100:00100000:0.0:1790945803.792937:0:6504:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638511616 00000100:00100000:0.0:1790945803.792940:0:6504:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638511616 00000100:00100000:0.0:1790945803.792950:0:6504:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638511744 00000100:00100000:0.0:1790945803.792952:0:6504:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638511744 00000100:00100000:0.0:1790945803.792961:0:6504:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638511872 00000100:00100000:0.0:1790945803.792963:0:6504:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638511872 00000100:00100000:0.0:1790945803.792972:0:6504:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638512000 00000100:00100000:0.0:1790945803.792975:0:6504:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638512000 00000100:00100000:0.0:1790945803.792982:0:6504:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638512128 00000100:00100000:0.0:1790945803.792984:0:6504:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638512128 00000100:00100000:0.0:1790945803.792991:0:6504:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638512256 00000100:00100000:0.0:1790945803.792993:0:6504:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638512256 00000100:00100000:0.0:1790945803.793004:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790945803.793011:0:6504:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+9:6515:x1877942638511488:12345-0@lo:104: 00010000:00010000:0.0:1790945803.793023:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d4086a4ce00/0xd9f4181e0d27cfaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27cfb6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945803.793080:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790945803.793085:0:6504:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+9:6515:x1877942638511488:12345-0@lo:104: Request processed in 75us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945803.793099:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790945803.793116:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790945803.793122:0:6504:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+8:6515:x1877942638511616:12345-0@lo:104: 00010000:00010000:0.0:1790945803.793130:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d200/0xd9f4181e0d27cf85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27cf8c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945803.793162:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790945803.793191:0:6504:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+8:6515:x1877942638511616:12345-0@lo:104: Request processed in 70us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945803.793198:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790945803.793210:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790945803.793216:0:6504:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+7:6515:x1877942638511744:12345-0@lo:104: 00010000:00010000:0.0:1790945803.793223:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6800/0xd9f4181e0d27cf69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27cf70 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945803.793249:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1790945803.793254:0:6504:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+7:6515:x1877942638511744:12345-0@lo:104: Request processed in 39us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945803.793259:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790945803.793271:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790945803.793276:0:6504:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+6:6515:x1877942638511872:12345-0@lo:104: 00010000:00010000:0.0:1790945803.793283:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27cf3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27cf46 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945803.793321:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1790945803.793326:0:6504:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+6:6515:x1877942638511872:12345-0@lo:104: Request processed in 50us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945803.793339:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790945803.793415:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790945803.793421:0:6504:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+5:6515:x1877942638512000:12345-0@lo:104: 00010000:00010000:0.0:1790945803.793428:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27cf23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27cf2a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945803.793455:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1790945803.793459:0:6504:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+5:6515:x1877942638512000:12345-0@lo:104: Request processed in 40us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945803.793464:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790945803.793475:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790945803.793480:0:6504:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f82388c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+4:6515:x1877942638512128:12345-0@lo:104: 00010000:00010000:0.0:1790945803.793486:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d40813ffa00/0xd9f4181e0d27cee4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27ceeb expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945803.793508:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1790945803.793512:0:6504:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f82388c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+4:6515:x1877942638512128:12345-0@lo:104: Request processed in 34us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945803.793517:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790945803.793541:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790945803.793547:0:6504:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+3:6515:x1877942638512256:12345-0@lo:104: 00010000:00010000:0.0:1790945803.793554:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d40813fe400/0xd9f4181e0d27ceba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27cec1 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945803.793578:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1790945803.793582:0:6504:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+3:6515:x1877942638512256:12345-0@lo:104: Request processed in 37us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945803.793593:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1790945803.794484:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1790945803.794495:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d4086a4ce00/0xd9f4181e0d27cfaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27cfb6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.794505:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4086a4ce00 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:1.0:1790945803.794509:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d4086a4ce00/0xd9f4181e0d27cfaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27cfb6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.794517:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d4086a4ce00/0xd9f4181e0d27cfaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27cfb6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790945803.794524:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d4086a4ce00/0xd9f4181e0d27cfaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27cfb6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945803.794530:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790945803.794574:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d4086a4ce00/0xd9f4181e0d27cfaf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cfb6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.794581:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790945803.794604:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d4086a4ce00/0xd9f4181e0d27cfaf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cfb6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.794610:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d4086a4ce00/0xd9f4181e0d27cfaf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cfb6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.794624:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1790945803.794635:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d200/0xd9f4181e0d27cf85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27cf8c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.794641:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4086a4d200 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:1.0:1790945803.794643:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d200/0xd9f4181e0d27cf85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27cf8c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.794650:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d200/0xd9f4181e0d27cf85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27cf8c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790945803.794656:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d200/0xd9f4181e0d27cf85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27cf8c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945803.794660:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790945803.794684:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d200/0xd9f4181e0d27cf85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cf8c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.794690:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790945803.794695:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d200/0xd9f4181e0d27cf85 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cf8c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.794701:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d200/0xd9f4181e0d27cf85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cf8c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.794709:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1790945803.794722:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6800/0xd9f4181e0d27cf69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27cf70 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.794728:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d6800 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:1.0:1790945803.794731:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6800/0xd9f4181e0d27cf69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27cf70 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.794748:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6800/0xd9f4181e0d27cf69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27cf70 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790945803.794754:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6800/0xd9f4181e0d27cf69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27cf70 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945803.794759:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790945803.794773:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6800/0xd9f4181e0d27cf69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cf70 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.794779:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790945803.794795:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6800/0xd9f4181e0d27cf69 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cf70 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.794801:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6800/0xd9f4181e0d27cf69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cf70 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.794810:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1790945803.794814:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27cf3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27cf46 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.794819:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef1000 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:1.0:1790945803.794822:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27cf3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27cf46 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.794828:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27cf3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27cf46 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790945803.794834:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27cf3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27cf46 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945803.794847:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790945803.794862:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27cf3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cf46 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.794868:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790945803.794873:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27cf3f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cf46 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.794879:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27cf3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cf46 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.794890:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790945803.794893:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27cf23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27cf2a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.794899:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40813ff000 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:1.0:1790945803.794902:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27cf23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27cf2a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.794908:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27cf23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27cf2a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790945803.794914:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27cf23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27cf2a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945803.794919:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790945803.794930:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27cf23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cf2a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.794936:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790945803.794947:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27cf23 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cf2a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.794953:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27cf23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cf2a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.794963:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790945803.794966:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40813ffa00/0xd9f4181e0d27cee4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27ceeb expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.794971:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40813ffa00 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:1.0:1790945803.794974:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40813ffa00/0xd9f4181e0d27cee4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27ceeb expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.794979:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40813ffa00/0xd9f4181e0d27cee4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27ceeb expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790945803.794985:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40813ffa00/0xd9f4181e0d27cee4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27ceeb expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945803.794990:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790945803.795003:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40813ffa00/0xd9f4181e0d27cee4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ceeb expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.795008:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790945803.795012:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40813ffa00/0xd9f4181e0d27cee4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ceeb expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.795018:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40813ffa00/0xd9f4181e0d27cee4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ceeb expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.795027:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790945803.795037:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40813fe400/0xd9f4181e0d27ceba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27cec1 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.795042:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40813fe400 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:1.0:1790945803.795045:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40813fe400/0xd9f4181e0d27ceba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27cec1 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.795051:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40813fe400/0xd9f4181e0d27ceba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27cec1 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790945803.795057:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40813fe400/0xd9f4181e0d27ceba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27cec1 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945803.795062:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790945803.795075:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40813fe400/0xd9f4181e0d27ceba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cec1 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.795080:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790945803.795083:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40813fe400/0xd9f4181e0d27ceba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cec1 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.795088:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40813fe400/0xd9f4181e0d27ceba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cec1 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.795101:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945803.795102:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945803.795104:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945803.795121:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638512384:0@lo:103: 00000100:00100000:1.0:1790945803.795188:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945803.795217:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4cec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638512896:0@lo:103: 00000100:00100000:1.0:1790945803.795245:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945803.795268:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790945803.795274:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4cef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638512512:0@lo:103: 00000100:00100000:1.0:1790945803.795292:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945803.795307:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4cef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638513024:0@lo:103: 00000100:00100000:1.0:1790945803.795326:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790945803.795451:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945803.795482:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1877942638511488:0@lo:104: 00000100:00100000:2.0:1790945803.795493:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc3100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1877942638511616:0@lo:104: 00000100:00100000:2.0:1790945803.795500:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d03100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1877942638511744:0@lo:104: 00000100:00100000:2.0:1790945803.795507:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d01180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1877942638511872:0@lo:104: 00000100:00100000:2.0:1790945803.795514:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d00a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1877942638512000:0@lo:104: 00000100:00100000:2.0:1790945803.795522:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d00000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1877942638512128:0@lo:104: 00000100:00100000:2.0:1790945803.795529:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d02300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1877942638512256:0@lo:104: 00010000:00010000:2.0:1790945803.795559:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d40813ffe00/0xd9f4181e0d27cfcb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945803.795654:0:7471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638512384 00000100:00100000:0.0:1790945803.795661:0:7471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638512384 00010000:00010000:0.0:1790945803.795686:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40c21d6c00/0xd9f4181e0d27cfb6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27cfaf expref: 22 pid: 6514 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945803.795702:0:7471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638512896 00000100:00100000:0.0:1790945803.795704:0:7471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638512896 00010000:00010000:0.0:1790945803.795712:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d4086a4c000/0xd9f4181e0d27cf2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27cf23 expref: 23 pid: 6516 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945803.795733:0:7471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638512512 00000100:00100000:0.0:1790945803.795735:0:7471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638512512 00010000:00010000:0.0:1790945803.795744:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40baef1800/0xd9f4181e0d27cf8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27cf85 expref: 24 pid: 6514 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945803.795751:0:7471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638513024 00000100:00100000:0.0:1790945803.795753:0:7471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638513024 00010000:00010000:0.0:1790945803.795761:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d4086a4da00/0xd9f4181e0d27ceeb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27cee4 expref: 25 pid: 6514 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945803.795773:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790945803.795780:0:7471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4ced180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8841fcfb-fb47-4307-92c2-97500c1c82bd+25:3649:x1877942638512384:12345-0@lo:103: 00010000:00010000:0.0:1790945803.795792:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945803.795796:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40c21d6c00/0xd9f4181e0d27cfb6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27cfaf expref: 25 pid: 6514 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945803.795805:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40c21d6c00/0xd9f4181e0d27cfb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27cfaf expref: 25 pid: 6514 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945803.795818:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40c21d6c00/0xd9f4181e0d27cfb6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27cfaf expref: 25 pid: 6514 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945803.795838:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945803.795885:0:7471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4ced180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3649:x1877942638512384:12345-0@lo:103: Request processed in 105us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945803.795891:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790945803.795906:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790945803.795913:0:7471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4cec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:3649:x1877942638512896:12345-0@lo:103: 00010000:00010000:0.0:1790945803.795920:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945803.795924:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d4086a4c000/0xd9f4181e0d27cf2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27cf23 expref: 23 pid: 6516 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945803.795931:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d4086a4c000/0xd9f4181e0d27cf2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27cf23 expref: 23 pid: 6516 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945803.795940:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d4086a4c000/0xd9f4181e0d27cf2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27cf23 expref: 23 pid: 6516 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945803.795948:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945803.795968:0:7471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4cec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:3649:x1877942638512896:12345-0@lo:103: Request processed in 56us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945803.795973:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790945803.795985:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790945803.795990:0:7471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:3649:x1877942638512512:12345-0@lo:103: 00010000:00010000:0.0:1790945803.795997:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945803.796001:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40baef1800/0xd9f4181e0d27cf8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27cf85 expref: 21 pid: 6514 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945803.796008:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40baef1800/0xd9f4181e0d27cf8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27cf85 expref: 21 pid: 6514 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945803.796024:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40baef1800/0xd9f4181e0d27cf8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27cf85 expref: 21 pid: 6514 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945803.796034:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945803.796057:0:7471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8841fcfb-fb47-4307-92c2-97500c1c82bd+20:3649:x1877942638512512:12345-0@lo:103: Request processed in 67us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945803.796062:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790945803.796073:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790945803.796079:0:7471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4096cbd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8841fcfb-fb47-4307-92c2-97500c1c82bd+19:3649:x1877942638513024:12345-0@lo:103: 00010000:00010000:0.0:1790945803.796085:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945803.796088:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d4086a4da00/0xd9f4181e0d27ceeb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27cee4 expref: 19 pid: 6514 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945803.796095:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d4086a4da00/0xd9f4181e0d27ceeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27cee4 expref: 19 pid: 6514 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945803.796103:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d4086a4da00/0xd9f4181e0d27ceeb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27cee4 expref: 19 pid: 6514 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945803.796110:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945803.796130:0:7471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4096cbd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:3649:x1877942638513024:12345-0@lo:103: Request processed in 52us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945803.796135:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790945803.796204:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4cee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8841fcfb-fb47-4307-92c2-97500c1c82bd:3648:1877942638512768:0@lo:103: 00000100:00100000:0.0:1790945803.796228:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945803.796255:0:7471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638512768 00000100:00100000:0.0:1790945803.796259:0:7471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638512768 00010000:00010000:0.0:1790945803.796272:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40c21d7600/0xd9f4181e0d27cf46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27cf3f expref: 18 pid: 6515 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945803.796296:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790945803.796301:0:7471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:3648:x1877942638512768:12345-0@lo:103: 00010000:00010000:0.0:1790945803.796307:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945803.796311:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40c21d7600/0xd9f4181e0d27cf46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27cf3f expref: 18 pid: 6515 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945803.796319:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40c21d7600/0xd9f4181e0d27cf46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27cf3f expref: 18 pid: 6515 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945803.796327:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40c21d7600/0xd9f4181e0d27cf46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27cf3f expref: 18 pid: 6515 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945803.796334:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945803.796455:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4cef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638512512:0@lo:103: 00000100:00100000:2.0:1790945803.796464:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4cef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638513024:0@lo:103: 00000100:00100000:2.0:1790945803.796471:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638512384:0@lo:103: 00000100:00100000:2.0:1790945803.796477:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4cec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638512896:0@lo:103: 00000100:00100000:1.0:1790945803.796534:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4cee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638512640:0@lo:103: 00000100:00100000:1.0:1790945803.796563:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945803.796575:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4cece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638513152:0@lo:103: 00000100:00100000:1.0:1790945803.796593:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945803.796616:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638512640 00000100:00100000:1.0:1790945803.796619:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638512640 00010000:00010000:1.0:1790945803.796633:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d4086a4c800/0xd9f4181e0d27cf70 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27cf69 expref: 18 pid: 6514 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945803.796644:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638513152 00000100:00100000:1.0:1790945803.796646:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638513152 00010000:00010000:1.0:1790945803.796655:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d4086a4d600/0xd9f4181e0d27cec1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27ceba expref: 19 pid: 6514 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945803.796665:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790945803.796671:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4cef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+19:3647:x1877942638512640:12345-0@lo:103: 00010000:00010000:1.0:1790945803.796678:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945803.796681:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d4086a4c800/0xd9f4181e0d27cf70 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27cf69 expref: 19 pid: 6514 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.796690:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d4086a4c800/0xd9f4181e0d27cf70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27cf69 expref: 19 pid: 6514 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.796711:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d4086a4c800/0xd9f4181e0d27cf70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27cf69 expref: 19 pid: 6514 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.796730:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945803.796803:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4cef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:3647:x1877942638512640:12345-0@lo:103: Request processed in 131us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945803.796809:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790945803.796821:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790945803.796827:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:3647:x1877942638513152:12345-0@lo:103: 00010000:00010000:1.0:1790945803.796834:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945803.796839:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d4086a4d600/0xd9f4181e0d27cec1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27ceba expref: 17 pid: 6514 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.796846:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d4086a4d600/0xd9f4181e0d27cec1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27ceba expref: 17 pid: 6514 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.796854:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d4086a4d600/0xd9f4181e0d27cec1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27ceba expref: 17 pid: 6514 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.796864:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d40813ffe00/0xd9f4181e0d27cfcb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.796871:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40813ffe00/0xd9f4181e0d27cfcb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.796884:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d40813ffe00/0xd9f4181e0d27cfcb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.796890:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d40813ffe00/0xd9f4181e0d27cfcb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.796902:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d40813ffe00/0xd9f4181e0d27cfcb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.796909:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d40813ffe00/0xd9f4181e0d27cfcb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.796914:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40813ffe00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:1.0:1790945803.796917:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d40813ffe00/0xd9f4181e0d27cfcb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.796925:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d40813ffe00/0xd9f4181e0d27cfcb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.796938:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d40813ffe00/0xd9f4181e0d27cfcb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.796951:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945803.796975:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:3647:x1877942638513152:12345-0@lo:103: Request processed in 149us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945803.796981:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790945803.798357:0:7471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:3648:x1877942638512768:12345-0@lo:103: Request processed in 2049us (2120us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945803.798370:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790945803.798430:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4cee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8841fcfb-fb47-4307-92c2-97500c1c82bd:3648:1877942638512768:0@lo:103: 00010000:00010000:3.0:1790945803.799257:0:6515:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d40813ffe00/0xd9f4181e0d27cfcb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945803.799271:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d40813ffe00/0xd9f4181e0d27cfcb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945803.799278:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40813ffe00/0xd9f4181e0d27cfcb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790945803.799295:0:6515:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1790945803.801769:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4cee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638512640:0@lo:103: 00000100:00100000:2.0:1790945803.801783:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4cece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638513152:0@lo:103: 00000100:00100000:3.0:1790945803.802524:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a72fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+14:9513:x1877942638511360:12345-0@lo:253: Request processed in 33478us (34281us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945803.802537:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1790945803.802610:0:9513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:9513:1877942638511360:0@lo:253: 10000000:01000000:0.0:1790945803.802623:0:9513:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1790945803.802627:0:9513:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790945803.802628:0:9513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790945803.802629:0:9513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790945803.802630:0:9513:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1790945803.802632:0:9513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790945803.802633:0:9513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790945803.802635:0:9513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790945803.802636:0:9513:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1790945803.802638:0:9513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790945803.802639:0:9513:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790945803.802674:0:9513:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d3f8248e800 from lustre-OST0001 10000000:01000000:0.0:1790945803.802776:0:9513:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1790945803.802779:0:9513:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1790945803.802788:0:9513:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d40af68cd40 local copy 10000000:01000000:0.0:1790945803.802792:0:9513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790945803.802830:0:9513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4086a4de00/0xd9f4181e0d27cfd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945803.802841:0:9513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.120@tcp lock: ffff9d4086a4de00/0xd9f4181e0d27cfd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945803.802852:0:9513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d4086a4de00/0xd9f4181e0d27cfd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945803.802870:0:9513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:9513:1877942638513280:0@lo:101: 00000100:00100000:0.0:1790945803.802905:0:9513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945803.802977:0:9513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f81b383c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790945803.803014:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638513280 00000100:00100000:1.0:1790945803.803021:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638513280 00000100:00100000:1.0:1790945803.803087:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1790945803.803097:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a72fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+14:9513:x1877942638513280:12345-0@lo:101: 00010000:00010000:1.0:1790945803.803109:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945803.803122:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40c21d7800/0xd9f4181e0d27cfd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27cfd2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.803144:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40c21d7800/0xd9f4181e0d27cfd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27cfd2 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.803161:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40c21d7800/0xd9f4181e0d27cfd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27cfd2 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.803200:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40c21d7800, rc 0) 00000100:00100000:1.0:1790945803.803235:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a72fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:9513:x1877942638513280:12345-0@lo:101: Request processed in 141us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945803.803241:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1790945803.803307:0:9513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:9513:1877942638513280:0@lo:101: 00010000:00010000:3.0:1790945803.803319:0:9513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d4086a4de00/0xd9f4181e0d27cfd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd9f4181e0d27cfd9 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945803.803337:0:9513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d4086a4de00/0xd9f4181e0d27cfd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd9f4181e0d27cfd9 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945803.803432:0:9513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:9513:1877942638513408:0@lo:501: 00000100:00100000:3.0:1790945803.803455:0:9513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945803.803653:0:9513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096d1ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1790945803.803756:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638513408 00000100:00100000:0.0:1790945803.803761:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638513408 00000100:00100000:0.0:1790945803.803782:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1790945803.803788:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a71e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:9513:x1877942638513408:12345-0@lo:501: 00000100:00100000:0.0:1790945803.803847:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a71e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:9513:x1877942638513408:12345-0@lo:501: Request processed in 59us (391us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790945803.803854:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1790945803.803907:0:9513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:9513:1877942638513408:0@lo:501: 10000000:01000000:3.0:1790945803.803918:0:9513:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1790945803.803933:0:9513:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1790945803.803938:0:9513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4086a4de00/0xd9f4181e0d27cfd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd9f4181e0d27cfd9 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945803.803946:0:9513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4086a4de00/0xd9f4181e0d27cfd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd9f4181e0d27cfd9 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945803.803953:0:9513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9d4086a4de00/0xd9f4181e0d27cfd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd9f4181e0d27cfd9 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945803.803976:0:9513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790945803.803998:0:9513:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d3f8248e800 10000000:01000000:3.0:1790945803.804002:0:9513:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790945803.804006:0:9513:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1790945803.804008:0:9513:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790945803.804012:0:9513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1790945803.804014:0:9513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1790945803.804028:0:9513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef1400/0xd9f4181e0d27cfe0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945803.804048:0:9513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40baef1400/0xd9f4181e0d27cfe0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945803.804056:0:9513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40baef1400/0xd9f4181e0d27cfe0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945803.804066:0:9513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:9513:1877942638513536:0@lo:101: 00000100:00100000:3.0:1790945803.804088:0:9513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945803.804099:0:9513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096d1a540 going to sleep for 11 seconds 00000100:00100000:1.0:1790945803.804136:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638513536 00000100:00100000:1.0:1790945803.804139:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638513536 00000100:00100000:1.0:1790945803.804157:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1790945803.804162:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a71e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:9513:x1877942638513536:12345-0@lo:101: 00010000:00010000:1.0:1790945803.804195:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945803.804204:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40c21d6400/0xd9f4181e0d27cfe7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27cfe0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.804217:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40c21d6400/0xd9f4181e0d27cfe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27cfe0 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.804226:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40c21d6400/0xd9f4181e0d27cfe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27cfe0 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.804233:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40c21d6400, rc 0) 00000100:00100000:1.0:1790945803.804259:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a71e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:9513:x1877942638513536:12345-0@lo:101: Request processed in 96us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945803.804265:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00010000:00010000:0.0:1790945803.804320:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790945803.804327:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d4086a4de00/0xd9f4181e0d27cfd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xd9f4181e0d27cfd9 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945803.804335:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4086a4de00 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:0.0:1790945803.804339:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d4086a4de00/0xd9f4181e0d27cfd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xd9f4181e0d27cfd9 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945803.804363:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d4086a4de00/0xd9f4181e0d27cfd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xd9f4181e0d27cfd9 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790945803.804371:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d4086a4de00/0xd9f4181e0d27cfd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xd9f4181e0d27cfd9 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945803.804376:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790945803.804392:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d4086a4de00/0xd9f4181e0d27cfd2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd9f4181e0d27cfd9 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945803.804398:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790945803.804422:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d4086a4de00/0xd9f4181e0d27cfd2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd9f4181e0d27cfd9 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945803.804429:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d4086a4de00/0xd9f4181e0d27cfd2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd9f4181e0d27cfd9 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945803.804441:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945803.804443:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945803.804444:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945803.804546:0:9513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:9513:1877942638513536:0@lo:101: 00010000:00010000:3.0:1790945803.804556:0:9513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40baef1400/0xd9f4181e0d27cfe0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cfe7 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945803.804565:0:9513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40baef1400/0xd9f4181e0d27cfe0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27cfe7 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945803.804614:0:9513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:9513:1877942638513792:0@lo:501: 00000100:00100000:3.0:1790945803.804649:0:9513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945803.804677:0:9513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096d1a540 going to sleep for 11 seconds 00000100:00100000:1.0:1790945803.804765:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8841fcfb-fb47-4307-92c2-97500c1c82bd:3648:1877942638513664:0@lo:103: 00000100:00100000:1.0:1790945803.804789:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945803.804852:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638513792 00000100:00100000:0.0:1790945803.804857:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638513792 00000100:00100000:0.0:1790945803.804884:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1790945803.804890:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a71e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:9513:x1877942638513792:12345-0@lo:501: 00000100:00100000:0.0:1790945803.804970:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a71e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:9513:x1877942638513792:12345-0@lo:501: Request processed in 80us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945803.804976:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1790945803.805043:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638513664 00000100:00100000:3.0:1790945803.805046:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638513664 00000100:00100000:3.0:1790945803.805076:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790945803.805082:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4cedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:3648:x1877942638513664:12345-0@lo:103: 00010000:00010000:3.0:1790945803.805090:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945803.805100:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40c21d7800/0xd9f4181e0d27cfd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd9f4181e0d27cfd2 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945803.805119:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945803.805149:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4cedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:3648:x1877942638513664:12345-0@lo:103: Request processed in 67us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945803.805155:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790945803.805200:0:9513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:9513:1877942638513792:0@lo:501: 00000100:00100000:3.0:1790945803.805223:0:9513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:9513:1877942638513920:0@lo:503: 00000100:00100000:3.0:1790945803.805253:0:9513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945803.805268:0:9513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096d1a540 going to sleep for 11 seconds 00000100:00100000:0.0:1790945803.805379:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8841fcfb-fb47-4307-92c2-97500c1c82bd:3648:1877942638513664:0@lo:103: 00000100:00100000:0.0:1790945803.805402:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638513920 00000100:00100000:0.0:1790945803.805405:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638513920 00000100:00100000:0.0:1790945803.805427:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1790945803.805433:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087036850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:9513:x1877942638513920:12345-0@lo:503: 00000100:00100000:0.0:1790945803.805492:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087036850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:9513:x1877942638513920:12345-0@lo:503: Request processed in 59us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945803.805497:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1790945803.805623:0:9513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:9513:1877942638513920:0@lo:503: 00000040:00080000:3.0:1790945803.805857:0:9513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790945803.805920:0:9513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:9513:1877942638514048:0@lo:502: 00000100:00100000:3.0:1790945803.805948:0:9513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945803.805970:0:9513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096d1a540 going to sleep for 11 seconds 00000100:00100000:0.0:1790945803.806119:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638514048 00000100:00100000:0.0:1790945803.806125:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638514048 00000100:00100000:0.0:1790945803.806156:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1790945803.806162:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087035050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:9513:x1877942638514048:12345-0@lo:502: 00000100:00100000:0.0:1790945803.806309:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087035050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:9513:x1877942638514048:12345-0@lo:502: Request processed in 147us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945803.806315:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1790945803.806601:0:9513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:9513:1877942638514048:0@lo:502: 00000040:00080000:3.0:1790945803.806845:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1790945803.806870:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1790945803.806885:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1790945803.806898:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1790945803.806910:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1790945803.806922:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1790945803.806943:0:9513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:9513:1877942638514176:0@lo:502: 00000100:00100000:3.0:1790945803.806981:0:9513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945803.807016:0:9513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096d1a540 going to sleep for 11 seconds 00000100:00100000:0.0:1790945803.807494:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638514176 00000100:00100000:0.0:1790945803.807502:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638514176 00000100:00100000:0.0:1790945803.807535:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1790945803.807541:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087037850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:9513:x1877942638514176:12345-0@lo:502: 00000100:00100000:0.0:1790945803.807634:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087037850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:9513:x1877942638514176:12345-0@lo:502: Request processed in 92us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945803.807641:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1790945803.807750:0:9513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:9513:1877942638514176:0@lo:502: 00000040:00080000:3.0:1790945803.807803:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1790945803.807819:0:9513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:0.0:1790945803.808229:0:9524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790945803.808236:0:9524:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1790945803.808243:0:9524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945803.808245:0:9524:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1790945803.808250:0:9524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790945803.808265:0:9524:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9d40bc9e0000) 00000020:00000080:0.0:1790945803.808289:0:9524:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:0.0:1790945803.808301:0:9524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790945803.808384:0:9524:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d3f8248e800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1790945803.808392:0:9524:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790945803.808407:0:9524:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd9f4181e0d27cff5 00010000:00010000:0.0:1790945803.812070:0:9524:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:0.0:1790945803.812407:0:9524:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1790945803.814785:0:9524:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1790945803.815117:0:9524:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1790945803.819667:0:9524:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1790945803.819880:0:9524:0:(osd_compat.c:1354:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1790945803.825011:0:9524:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1790945803.826785:0:9524:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1790945803.826800:0:9524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790945803.826807:0:9524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945803.826809:0:9524:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1790945803.826812:0:9524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790945803.826816:0:9524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945803.826817:0:9524:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790945803.826820:0:9524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790945803.826822:0:9524:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1790945803.826844:0:9524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790945803.826846:0:9524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945803.826848:0:9524:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:0.0:1790945803.826851:0:9524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1790945803.827015:0:9513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1790945803.827043:0:9513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1790945803.827064:0:9513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef1400/0xd9f4181e0d27cfe0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cfe7 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945803.827077:0:9513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40baef1400/0xd9f4181e0d27cfe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cfe7 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790945803.827086:0:9513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d3f8248e800 from 1 10000000:01000000:3.0:1790945803.827089:0:9513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790945803.827123:0:9513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef0a00/0xd9f4181e0d27cffc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945803.827131:0:9513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40baef0a00/0xd9f4181e0d27cffc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945803.827141:0:9513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40baef0a00/0xd9f4181e0d27cffc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945803.827164:0:9513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:9513:1877942638514304:0@lo:101: 00000100:00100000:3.0:1790945803.827262:0:9513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945803.827303:0:9513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096d1a780 going to sleep for 11 seconds 00000100:00100000:1.0:1790945803.827388:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638514304 00000100:00100000:1.0:1790945803.827395:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638514304 00000100:00100000:1.0:1790945803.827435:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1790945803.827444:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087036450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:9513:x1877942638514304:12345-0@lo:101: 00010000:00010000:1.0:1790945803.827456:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945803.827468:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27d003 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27cffc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.827490:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27d003 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27cffc expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.827500:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27d003 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27cffc expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.827509:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40c21d6800, rc 0) 00000100:00100000:1.0:1790945803.827551:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087036450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:9513:x1877942638514304:12345-0@lo:101: Request processed in 107us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945803.827558:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1790945803.827603:0:9513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:9513:1877942638514304:0@lo:101: 00010000:00010000:1.0:1790945803.827617:0:9513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40baef0a00/0xd9f4181e0d27cffc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d003 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.827626:0:9513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40baef0a00/0xd9f4181e0d27cffc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d003 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945803.827724:0:9513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4ced880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:9513:1877942638514432:0@lo:501: 00000100:00100000:1.0:1790945803.827751:0:9513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945803.827783:0:9513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f81b86480 going to sleep for 11 seconds 00000100:00100000:1.0:1790945803.827796:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638514432 00000100:00100000:1.0:1790945803.827800:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638514432 00000100:00100000:1.0:1790945803.827822:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1790945803.827828:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087037450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:9513:x1877942638514432:12345-0@lo:501: 00000100:00100000:1.0:1790945803.827916:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087037450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:9513:x1877942638514432:12345-0@lo:501: Request processed in 88us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945803.827923:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1790945803.827952:0:9513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4ced880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:9513:1877942638514432:0@lo:501: 00000100:00100000:1.0:1790945803.827979:0:9513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4ced880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:9513:1877942638514560:0@lo:503: 00000100:00100000:1.0:1790945803.828017:0:9513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945803.828030:0:9513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f81b86480 going to sleep for 11 seconds 00000100:00100000:1.0:1790945803.828043:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638514560 00000100:00100000:1.0:1790945803.828046:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638514560 00000100:00100000:1.0:1790945803.828065:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1790945803.828070:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087034050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:9513:x1877942638514560:12345-0@lo:503: 00000100:00100000:1.0:1790945803.828137:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087034050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:9513:x1877942638514560:12345-0@lo:503: Request processed in 66us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945803.828143:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1790945803.828202:0:9513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4ced880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:9513:1877942638514560:0@lo:503: 00000040:00080000:1.0:1790945803.828407:0:9513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790945803.828461:0:9513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4ced880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:9513:1877942638514688:0@lo:502: 00000100:00100000:1.0:1790945803.828493:0:9513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945803.828513:0:9513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096fa8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790945803.828526:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638514688 00000100:00100000:1.0:1790945803.828530:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638514688 00000100:00100000:1.0:1790945803.828551:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1790945803.828562:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087034450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:9513:x1877942638514688:12345-0@lo:502: 00000100:00100000:1.0:1790945803.828628:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087034450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:9513:x1877942638514688:12345-0@lo:502: Request processed in 65us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945803.828634:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1790945803.828670:0:9513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4ced880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:9513:1877942638514688:0@lo:502: 00000040:00080000:1.0:1790945803.828836:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1790945803.828858:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1790945803.828876:0:9513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4ced880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:9513:1877942638514816:0@lo:502: 00000100:00100000:1.0:1790945803.828907:0:9513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945803.828919:0:9513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096fa8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790945803.828930:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638514816 00000100:00100000:1.0:1790945803.828933:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638514816 00000100:00100000:1.0:1790945803.828951:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1790945803.828956:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087035850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:9513:x1877942638514816:12345-0@lo:502: 00000100:00100000:1.0:1790945803.829013:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087035850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:9513:x1877942638514816:12345-0@lo:502: Request processed in 56us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945803.829019:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1790945803.829057:0:9513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4ced880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:9513:1877942638514816:0@lo:502: 00000040:00080000:1.0:1790945803.829090:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1790945803.829098:0:9513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1790945803.831443:0:9527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790945803.831455:0:9527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945803.831457:0:9527:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790945803.831465:0:9527:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d3f8248e800 00000020:00000080:0.0:1790945803.831468:0:9527:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790945803.831480:0:9527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790945803.831482:0:9527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945803.831483:0:9527:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1790945803.831486:0:9527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1790945803.831623:0:9513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1790945803.831651:0:9513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790945803.831674:0:9513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef0a00/0xd9f4181e0d27cffc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d003 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.831685:0:9513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40baef0a00/0xd9f4181e0d27cffc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d003 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945803.831761:0:9513:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1790945803.831764:0:9513:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d3f8248e800 10000000:01000000:1.0:1790945803.831767:0:9513:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d3f8248e800 10000000:01000000:1.0:1790945803.831772:0:9513:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790945803.831777:0:9513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d3f8248e800 from 1 10000000:01000000:1.0:1790945803.831780:0:9513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790945803.831816:0:9513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7800/0xd9f4181e0d27d00a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.831825:0:9513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7800/0xd9f4181e0d27d00a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.831836:0:9513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7800/0xd9f4181e0d27d00a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945803.831857:0:9513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4ced880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:9513:1877942638514944:0@lo:101: 00000100:00100000:1.0:1790945803.831915:0:9513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945803.831956:0:9513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40af6606c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945803.832064:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638514944 00000100:00100000:3.0:1790945803.832072:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638514944 00000100:00100000:3.0:1790945803.832119:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1790945803.832128:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:9513:x1877942638514944:12345-0@lo:101: 00010000:00010000:3.0:1790945803.832142:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945803.832154:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40baef1600/0xd9f4181e0d27d011 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27d00a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945803.832212:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40baef1600/0xd9f4181e0d27d011 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27d00a expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945803.832223:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40baef1600/0xd9f4181e0d27d011 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d00a expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945803.832231:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40baef1600, rc 0) 00000100:00100000:3.0:1790945803.832275:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:9513:x1877942638514944:12345-0@lo:101: Request processed in 148us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945803.832282:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1790945803.832434:0:9513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4ced880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:9513:1877942638514944:0@lo:101: 00010000:00010000:0.0:1790945803.832449:0:9513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7800/0xd9f4181e0d27d00a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d011 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945803.832465:0:9513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7800/0xd9f4181e0d27d00a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d011 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945803.832540:0:9513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:9513:1877942638515072:0@lo:501: 00000100:00100000:0.0:1790945803.832564:0:9513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945803.832585:0:9513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f81b38c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790945803.832636:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638515072 00000100:00100000:1.0:1790945803.832641:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638515072 00000100:00100000:1.0:1790945803.832664:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1790945803.832671:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:9513:x1877942638515072:12345-0@lo:501: 00000100:00100000:1.0:1790945803.832780:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:9513:x1877942638515072:12345-0@lo:501: Request processed in 109us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945803.832788:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1790945803.833555:0:9513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:9513:1877942638515072:0@lo:501: 00000100:00100000:0.0:1790945803.833593:0:9513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:9513:1877942638515200:0@lo:503: 00000100:00100000:0.0:1790945803.833641:0:9513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945803.833661:0:9513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f81b38c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790945803.833722:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638515200 00000100:00100000:1.0:1790945803.833727:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638515200 00000100:00100000:1.0:1790945803.833765:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1790945803.833779:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087033050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:9513:x1877942638515200:12345-0@lo:503: 00000100:00100000:1.0:1790945803.833902:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087033050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:9513:x1877942638515200:12345-0@lo:503: Request processed in 124us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945803.833908:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1790945803.838492:0:9513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:9513:1877942638515200:0@lo:503: 00000040:00080000:0.0:1790945803.839236:0:9513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790945803.839334:0:9513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:9513:1877942638515328:0@lo:502: 00000100:00100000:0.0:1790945803.839801:0:9513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945803.839912:0:9513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f81b38c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790945803.840135:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638515328 00000100:00100000:3.0:1790945803.840142:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638515328 00000100:00100000:3.0:1790945803.840364:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1790945803.840374:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:9513:x1877942638515328:12345-0@lo:502: 00000100:00100000:3.0:1790945803.840499:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:9513:x1877942638515328:12345-0@lo:502: Request processed in 126us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945803.840506:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1790945803.840578:0:9513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:9513:1877942638515328:0@lo:502: 00000040:00080000:0.0:1790945803.840801:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1790945803.840828:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1790945803.840841:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1790945803.840853:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1790945803.840865:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1790945803.840879:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1790945803.840891:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1790945803.840904:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1790945803.840917:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1790945803.840929:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1790945803.840954:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1790945803.840969:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1790945803.840982:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1790945803.840994:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1790945803.841021:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1790945803.841038:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1790945803.841053:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1790945803.841067:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1790945803.841079:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1790945803.841091:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1790945803.841105:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1790945803.841119:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1790945803.841131:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1790945803.841145:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1790945803.841159:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1790945803.841226:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1790945803.841242:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1790945803.841256:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1790945803.841268:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1790945803.841280:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1790945803.841292:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1790945803.841315:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1790945803.841328:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1790945803.841341:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1790945803.841352:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1790945803.841366:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1790945803.841380:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:0.0:1790945803.841391:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1790945803.841404:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:0.0:1790945803.841417:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:0.0:1790945803.841428:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:0.0:1790945803.841442:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:0.0:1790945803.841454:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:0.0:1790945803.841479:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:0.0:1790945803.841493:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:0.0:1790945803.841505:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:0.0:1790945803.841534:0:9513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:9513:1877942638515456:0@lo:502: 00000100:00100000:0.0:1790945803.841578:0:9513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945803.841863:0:9513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f81b38180 going to sleep for 11 seconds 00000100:00100000:1.0:1790945803.841901:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638515456 00000100:00100000:1.0:1790945803.841907:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638515456 00000100:00100000:1.0:1790945803.841942:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1790945803.841952:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:9513:x1877942638515456:12345-0@lo:502: 00000100:00100000:1.0:1790945803.842094:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:9513:x1877942638515456:12345-0@lo:502: Request processed in 144us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945803.842101:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1790945803.842310:0:9513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:9513:1877942638515456:0@lo:502: 00000040:00080000:0.0:1790945803.842425:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:0.0:1790945803.842436:0:9513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:2.0:1790945803.843461:0:9529:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1790945803.843475:0:9529:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9d40bca84d40) 00000020:00000080:2.0:1790945803.843498:0:9529:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:2.0:1790945803.843576:0:9529:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d3f8248e800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1790945803.843580:0:9529:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d3f8248e800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1790945803.843587:0:9529:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d3f8248e800 3 00010000:00080000:2.0:1790945803.843618:0:9529:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d3f832dc800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.120@tcp at head 00010000:00010000:2.0:1790945803.845885:0:9529:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:2.0:1790945803.846096:0:9529:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1790945803.846140:0:9529:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790945803.846151:0:9529:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xd9f4181e0d27d01f 00000100:00080000:2.0:1790945803.846161:0:9529:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790945803.846841:0:9529:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9d3f832dc800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1790945803.846876:0:9529:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d40b4d02300 x1877942638515584/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790945803.846892:0:9529:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1790945803.849233:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1877942638515584:0@lo:38: 00000100:00100000:3.0:1790945803.849315:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945803.849393:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638515584 00000100:00100000:3.0:1790945803.849403:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638515584 00000100:00100000:3.0:1790945803.849444:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790945803.849451:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1877942638515584:12345-0@lo:38: 00010000:00080000:3.0:1790945803.849480:0:6522:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 254 last 0 00000020:00000080:3.0:1790945803.849517:0:6522:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xd9f4181e0d27d026 00000004:00100000:3.0:1790945803.849532:0:6522:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790945803.849571:0:6522:0:(import.c:65:import_set_state_nolock()) ffff9d40bff0d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790945803.849727:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1877942638515584:12345-0@lo:38: Request processed in 170us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945803.849734:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1790945803.849776:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d40b4d02300 x1877942638515584/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790945813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945803.849785:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790945803.849792:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1790945803.849798:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1790945803.849801:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790945803.849803:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d3f832dc800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790945803.849809:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1877942638515584:0@lo:38: 00000100:00100000:2.0:1790945803.853248:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4ceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877942638515712:0@lo:400: 00000100:00100000:2.0:1790945803.853322:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945803.853368:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1877942638516224:0@lo:400: 00000100:00100000:2.0:1790945803.853395:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945803.853424:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790945803.853430:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4ceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638515840:0@lo:400: 00000100:00100000:2.0:1790945803.853452:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945803.853485:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638515712 00000100:00100000:2.0:1790945803.853492:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638515712 00000100:00100000:2.0:1790945803.853529:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638516224 00000100:00100000:2.0:1790945803.853532:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638516224 00000100:00100000:2.0:1790945803.853554:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638515840 00000100:00100000:2.0:1790945803.853557:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638515840 00000100:00100000:2.0:1790945803.853571:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790945803.853578:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877942638515712:12345-0@lo:400: 00000100:00100000:2.0:1790945803.853761:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877942638515712:12345-0@lo:400: Request processed in 181us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945803.853778:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790945803.853802:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790945803.853807:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877942638516224:12345-0@lo:400: 00000100:00100000:2.0:1790945803.853838:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877942638516224:12345-0@lo:400: Request processed in 31us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945803.853844:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790945803.853855:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790945803.853862:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638515840:12345-0@lo:400: 00000100:00100000:2.0:1790945803.853887:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638515840:12345-0@lo:400: Request processed in 26us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945803.853893:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1790945803.853912:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1790945803.853938:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d40b4ceca80 x1877942638515840/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945803.853952:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4ceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638515840:0@lo:400: 00010000:00080000:2.0:1790945803.853963:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d40b4ceea00 x1877942638515712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945803.853971:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4ceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877942638515712:0@lo:400: 00010000:00080000:2.0:1790945803.853980:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d40b4cec000 x1877942638516224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945803.853987:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1877942638516224:0@lo:400: 00000020:01000004:2.0:1790945803.854114:0:9529:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1790945803.854128:0:9529:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9d40bca80000) 00000020:00000080:2.0:1790945803.854150:0:9529:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000100:00100000:1.0:1790945803.854230:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4ced500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638515968:0@lo:400: 00000020:01000004:2.0:1790945803.854249:0:9529:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d3f8248e800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1790945803.854253:0:9529:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d3f8248e800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1790945803.854255:0:9529:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d3f8248e800 3 00000100:00100000:1.0:1790945803.854262:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1790945803.854282:0:9529:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d3f832d8800@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.120@tcp at head 00000100:00100000:1.0:1790945803.854285:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790945803.854291:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4ceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1877942638516096:0@lo:400: 00000100:00100000:1.0:1790945803.854310:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945803.854577:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638515968 00000100:00100000:1.0:1790945803.854583:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638515968 00000100:00100000:1.0:1790945803.854618:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790945803.854624:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4cece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638515968:12345-0@lo:400: 00000100:00100000:1.0:1790945803.854666:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4cece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638515968:12345-0@lo:400: Request processed in 41us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945803.854672:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790945803.854688:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638516096 00000100:00100000:1.0:1790945803.854692:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638516096 00000100:00100000:1.0:1790945803.854729:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790945803.854736:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4cee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1877942638516096:12345-0@lo:400: 00000100:00100000:1.0:1790945803.854773:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4cee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1877942638516096:12345-0@lo:400: Request processed in 38us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945803.854779:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1790945803.854808:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d40b4ceed80 x1877942638516096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945803.854817:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4ceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1877942638516096:0@lo:400: 00000100:00100000:1.0:1790945803.854825:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4ced500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638515968:0@lo:400: 00000100:00080000:1.0:1790945803.854842:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790945803.854889:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4ced880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638516352:0@lo:400: 00000100:00100000:1.0:1790945803.854913:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945803.854941:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4ced500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638516480:0@lo:400: 00000100:00100000:1.0:1790945803.854961:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945803.854987:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638516352 00000100:00100000:1.0:1790945803.854990:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638516352 00000100:00100000:1.0:1790945803.855085:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638516480 00000100:00100000:1.0:1790945803.855089:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638516480 00000100:00100000:1.0:1790945803.855112:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790945803.855118:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638516352:12345-0@lo:400: 00000100:00100000:1.0:1790945803.855154:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638516352:12345-0@lo:400: Request processed in 36us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945803.855159:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790945803.855189:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790945803.855195:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4cee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638516480:12345-0@lo:400: 00000100:00100000:1.0:1790945803.855224:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4cee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638516480:12345-0@lo:400: Request processed in 30us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945803.855230:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1790945803.855253:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790945803.855273:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d40b4ced880 x1877942638516352/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945803.855283:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4ced880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638516352:0@lo:400: 00010000:00080000:1.0:1790945803.855302:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d40b4ced500 x1877942638516480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945803.855310:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4ced500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638516480:0@lo:400: 00010000:00010000:2.0:1790945803.857045:0:9529:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000100:00100000:1.0:1790945803.857278:0:9530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4ced500 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9530:1877942638516608:0@lo:901: 00000100:00100000:1.0:1790945803.857579:0:9530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945803.857630:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638516608 00000100:00100000:1.0:1790945803.857637:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638516608 00000100:00100000:1.0:1790945803.857687:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790945803.857696:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4ced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9530:x1877942638516608:12345-0@lo:901: 00000100:00100000:1.0:1790945803.857783:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4ced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9530:x1877942638516608:12345-0@lo:901: Request processed in 89us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945803.857790:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1790945803.857811:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790945803.857822:0:9530:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40af6603c0 going to sleep for 11 seconds 00010000:00080000:1.0:1790945803.857841:0:9530:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d40b4ced500 x1877942638516608/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1790945819 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945803.857853:0:9530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4ced500 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9530:1877942638516608:0@lo:901: 00000020:00000080:2.0:1790945803.858287:0:9529:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1790945803.858333:0:9529:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790945803.858344:0:9529:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xd9f4181e0d27d034 00000100:00080000:2.0:1790945803.858669:0:9529:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790945803.858680:0:9529:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9d3f832d8800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1790945803.858706:0:9529:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d40b4d03100 x1877942638516736/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790945803.858740:0:9529:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1790945803.858776:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1877942638516736:0@lo:38: 00000100:00100000:2.0:1790945803.858817:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945803.858953:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638516736 00000100:00100000:2.0:1790945803.858959:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638516736 00000100:00100000:2.0:1790945803.858981:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790945803.858986:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1877942638516736:12345-0@lo:38: 00010000:00080000:2.0:1790945803.859007:0:6522:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 254 last 0 00000020:00000080:2.0:1790945803.859042:0:6522:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xd9f4181e0d27d03b 00000004:00100000:2.0:1790945803.859058:0:6522:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790945803.859085:0:6522:0:(import.c:65:import_set_state_nolock()) ffff9d3f832db800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790945803.859126:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1877942638516736:12345-0@lo:38: Request processed in 138us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945803.859133:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1790945803.859165:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d40b4d03100 x1877942638516736/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790945813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945803.859199:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790945803.859206:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1790945803.859212:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1790945803.859216:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1790945803.859218:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d3f832d8800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790945803.859223:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1877942638516736:0@lo:38: 00000040:00080000:2.0:1790945803.860642:0:9529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:0.0:1790945803.861905:0:9513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:0.0:1790945803.861945:0:9513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790945803.862012:0:9513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7800/0xd9f4181e0d27d00a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d011 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945803.862025:0:9513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7800/0xd9f4181e0d27d00a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d011 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790945803.862085:0:9513:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790945803.862088:0:9513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790945803.862089:0:9513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790945803.862090:0:9513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790945803.862091:0:9513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790945803.862093:0:9513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790945803.862095:0:9513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790945803.862096:0:9513:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790945803.862097:0:9513:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790945803.862099:0:9513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790945803.862100:0:9513:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790945803.862105:0:9513:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1790945803.862108:0:9513:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790945803.862109:0:9513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790945803.862111:0:9513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790945803.862111:0:9513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790945803.862119:0:9513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790945803.862120:0:9513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790945803.862121:0:9513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790945803.862122:0:9513:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790945803.862123:0:9513:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790945803.862124:0:9513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790945803.862125:0:9513:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790945803.862150:0:9513:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1790945803.862212:0:9513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:9513:1877942638516864:0@lo:253: 00000100:00100000:0.0:1790945803.862302:0:9513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945803.862374:0:9513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f83421840 going to sleep for 11 seconds 00000100:00100000:3.0:1790945803.862424:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638516864 00000100:00100000:3.0:1790945803.862433:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638516864 00000100:00100000:3.0:1790945803.862489:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1790945803.862499:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:9513:x1877942638516864:12345-0@lo:253: 20000000:01000000:3.0:1790945803.862525:0:6514:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1790945803.862542:0:6514:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1790945803.867268:0:6514:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1790945803.867283:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1790945803.867347:0:6537:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790945803.867353:0:6537:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790945803.867387:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d40813fea00/0xd9f4181e0d27d042 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945803.867408:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40c21d7c00/0xd9f4181e0d27cf38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27cf31 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945803.867416:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40c21d7400/0xd9f4181e0d27cf7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27cf77 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945803.867423:0:6537:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d40813fea00/0xd9f4181e0d27d042 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945803.867464:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40c21d7400/0xd9f4181e0d27cf7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27cf77 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945803.867480:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40c21d7400/0xd9f4181e0d27cf7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27cf77 expref: 17 pid: 6515 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945803.867495:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d03100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1877942638516992:0@lo:104: 00000100:00100000:2.0:1790945803.867548:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945803.867581:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:9513:x1877942638516864:12345-0@lo:253: Request processed in 5081us (5277us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945803.867593:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00010000:00010000:2.0:1790945803.867604:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40c21d7c00/0xd9f4181e0d27cf38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27cf31 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945803.867614:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40c21d7c00/0xd9f4181e0d27cf38 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27cf31 expref: 16 pid: 6515 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945803.867637:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d02d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1877942638517120:0@lo:104: 00000100:00100000:2.0:1790945803.867663:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945803.867695:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bc8ac9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790945803.867726:0:6504:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638516992 00000100:00100000:3.0:1790945803.867733:0:6505:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638517120 00000100:00100000:2.0:1790945803.867734:0:6504:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638516992 00000100:00100000:3.0:1790945803.867740:0:6505:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638517120 00000100:00100000:2.0:1790945803.867775:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790945803.867785:0:6504:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+4:6537:x1877942638516992:12345-0@lo:104: 00010000:00010000:2.0:1790945803.867797:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27cf77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27cf7e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945803.867839:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790945803.867844:0:6504:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+4:6537:x1877942638516992:12345-0@lo:104: Request processed in 62us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945803.867912:0:9513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8841fcfb-fb47-4307-92c2-97500c1c82bd:9513:1877942638516864:0@lo:253: 10000000:01000000:0.0:1790945803.867924:0:9513:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1790945803.867927:0:9513:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790945803.867929:0:9513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790945803.867930:0:9513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790945803.867932:0:9513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790945803.867933:0:9513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790945803.867934:0:9513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790945803.867936:0:9513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790945803.867937:0:9513:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790945803.867939:0:9513:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790945803.867940:0:9513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790945803.867942:0:9513:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790945803.867955:0:9513:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1790945803.869240:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d03100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1877942638516992:0@lo:104: 00000100:00100000:2.0:1790945803.869805:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790945803.869842:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790945803.869855:0:6504:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+3:6537:x1877942638517120:12345-0@lo:104: 00010000:00010000:2.0:1790945803.869872:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27cf31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27cf38 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945803.869965:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790945803.869972:0:6504:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+3:6537:x1877942638517120:12345-0@lo:104: Request processed in 124us (2308us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945803.869992:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1790945803.870016:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790945803.870023:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27cf77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27cf7e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945803.870031:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d6200 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:2.0:1790945803.870036:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27cf77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27cf7e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945803.870044:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27cf77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27cf7e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790945803.870053:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27cf77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27cf7e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945803.870059:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:1.0:1790945803.870079:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d02d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1877942638517120:0@lo:104: 00010000:00010000:2.0:1790945803.870104:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27cf77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cf7e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.870111:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d40813fea00/0xd9f4181e0d27d042 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945803.870113:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790945803.870138:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27cf77 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cf7e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945803.870147:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27cf77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cf7e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945803.870160:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790945803.870163:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27cf31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27cf38 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945803.870201:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef0800 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:2.0:1790945803.870205:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27cf31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27cf38 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945803.870213:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27cf31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27cf38 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790945803.870220:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27cf31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27cf38 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945803.870226:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790945803.870227:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945803.870247:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27cf31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cf38 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945803.870255:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790945803.870274:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27cf31 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cf38 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945803.870281:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27cf31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cf38 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945803.870285:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638517376:0@lo:103: 00010000:00010000:2.0:1790945803.870301:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945803.870304:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945803.870306:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945803.870319:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8841fcfb-fb47-4307-92c2-97500c1c82bd:3648:1877942638517248:0@lo:103: 00000100:00100000:1.0:1790945803.870361:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945803.870396:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945803.870429:0:7471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638517376 00000100:00100000:1.0:1790945803.870437:0:7471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638517376 00000100:00100000:2.0:1790945803.870440:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638517248 00000100:00100000:2.0:1790945803.870446:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638517248 00010000:00010000:1.0:1790945803.870462:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40c21d7c00/0xd9f4181e0d27cf38 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27cf31 expref: 18 pid: 6515 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945803.870464:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40c21d7400/0xd9f4181e0d27cf7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27cf77 expref: 18 pid: 6515 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945803.870491:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790945803.870500:0:7471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4ced500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:3649:x1877942638517376:12345-0@lo:103: 00000100:00100000:2.0:1790945803.870503:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790945803.870515:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:3648:x1877942638517248:12345-0@lo:103: 00010000:00010000:1.0:1790945803.870516:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945803.870526:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40c21d7c00/0xd9f4181e0d27cf38 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27cf31 expref: 18 pid: 6515 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.870537:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40c21d7c00/0xd9f4181e0d27cf38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27cf31 expref: 18 pid: 6515 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.870551:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40c21d7c00/0xd9f4181e0d27cf38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27cf31 expref: 18 pid: 6515 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.870563:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945803.870591:0:7471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4ced500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:3649:x1877942638517376:12345-0@lo:103: Request processed in 93us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945803.870598:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790945803.870625:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638517376:0@lo:103: 00010000:00010000:2.0:1790945803.871198:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945803.871205:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40c21d7400/0xd9f4181e0d27cf7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27cf77 expref: 16 pid: 6515 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945803.871215:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40c21d7400/0xd9f4181e0d27cf7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27cf77 expref: 16 pid: 6515 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945803.871226:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40c21d7400/0xd9f4181e0d27cf7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27cf77 expref: 16 pid: 6515 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945803.871238:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d40813fea00/0xd9f4181e0d27d042 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945803.871245:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40813fea00/0xd9f4181e0d27d042 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790945803.871259:0:6506:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009262225s 00010000:00010000:2.0:1790945803.871263:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d40813fea00/0xd9f4181e0d27d042 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945803.871269:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d40813fea00/0xd9f4181e0d27d042 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945803.871276:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d40813fea00/0xd9f4181e0d27d042 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945803.871282:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d40813fea00/0xd9f4181e0d27d042 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945803.871294:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40813fea00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790945803.871298:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d40813fea00/0xd9f4181e0d27d042 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945803.871306:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d40813fea00/0xd9f4181e0d27d042 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945803.871322:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d40813fea00/0xd9f4181e0d27d042 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945803.871331:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945803.871367:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:3648:x1877942638517248:12345-0@lo:103: Request processed in 853us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945803.871374:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790945803.871408:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8841fcfb-fb47-4307-92c2-97500c1c82bd:3648:1877942638517248:0@lo:103: 00010000:00010000:1.0:1790945803.871770:0:6537:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d40813fea00/0xd9f4181e0d27d042 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.871781:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d40813fea00/0xd9f4181e0d27d042 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945803.871799:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40813fea00/0xd9f4181e0d27d042 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1790945803.878440:0:9513:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1790945803.878616:0:9513:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1790945803.878869:0:9513:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1790945803.879014:0:9513:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1790945803.879418:0:9513:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1790945803.879618:0:9513:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1790945803.880921:0:9513:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1790945803.888914:0:9513:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1790945803.888926:0:9513:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1790945803.888973:0:9513:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1790945803.889007:0:9513:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.120@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1790945803.889026:0:9513:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1790945803.889044:0:9513:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1790945803.889961:0:9513:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790945803.890138:0:9513:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:2.0:1790945804.135459:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790945804.135483:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638517504:0@lo:41: 00000100:00100000:2.0:1790945804.135549:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945804.135608:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638517504 00000100:00100000:2.0:1790945804.135615:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638517504 00000100:00100000:2.0:1790945804.135657:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790945804.135665:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638517504:12345-0@lo:41: 00000004:00000024:2.0:1790945804.135695:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1790945804.135745:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638517504:12345-0@lo:41: Request processed in 81us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945804.135752:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790945804.135796:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638517504:0@lo:41: 00010000:00010000:1.0:1790945804.768601:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1790945804.778026:0:9585:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790945804.778329:0:9585:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790945805.791465:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945806.815479:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945807.199530:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638517632:0@lo:13: 00000100:00100000:1.0:1790945807.199610:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945807.200428:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638517760:0@lo:13: 00000100:00100000:2.0:1790945807.200481:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945807.202964:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638517632 00000100:00100000:3.0:1790945807.202977:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638517632 00000100:00100000:3.0:1790945807.203077:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638517760 00000100:00100000:3.0:1790945807.203080:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638517760 00000100:00100000:0.0:1790945807.203120:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790945807.203131:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4cec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638517632:12345-0@lo:13: 00002000:00000024:0.0:1790945807.203161:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790945807.203273:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4cec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638517632:12345-0@lo:13: Request processed in 138us (3657us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945807.203281:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1790945807.203859:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40b4d00700 x1877942638517632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945823 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945807.203880:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638517632:0@lo:13: 00000100:00080000:1.0:1790945807.203952:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790945807.204074:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790945807.204082:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bacee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638517760:12345-0@lo:13: 00002000:00000024:3.0:1790945807.204096:0:8438:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790945807.204151:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bacee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638517760:12345-0@lo:13: Request processed in 70us (3669us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945807.204156:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1790945807.204245:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcbc3100 x1877942638517760/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945823 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945807.204276:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638517760:0@lo:13: 00010000:00010000:1.0:1790945807.843900:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945808.738361:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790945808.738384:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4cef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638517888:0@lo:41: 00000100:00100000:1.0:1790945808.738653:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945808.738725:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638517888 00000100:00100000:1.0:1790945808.738733:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638517888 00000100:00100000:1.0:1790945808.738780:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790945808.738789:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4cef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638517888:12345-0@lo:41: 00000004:00000024:1.0:1790945808.738823:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:1.0:1790945808.738871:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4cef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638517888:12345-0@lo:41: Request processed in 83us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945808.738878:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790945808.738920:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4cef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638517888:0@lo:41: 00010000:00010000:0.0:1790945808.866223:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945809.249022:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4cefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638518400:0@lo:400: 00000100:00100000:1.0:1790945809.249098:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945809.249152:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638518912:0@lo:400: 00000100:00100000:1.0:1790945809.249209:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945809.249239:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1790945809.249255:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4cef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638518016:0@lo:400: 00000100:00100000:1.0:1790945809.249285:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945809.249308:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638518528:0@lo:400: 00000100:00100000:1.0:1790945809.249331:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945809.249348:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638519040:0@lo:400: 00000100:00100000:1.0:1790945809.249369:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945809.249394:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4ced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638518144:0@lo:400: 00000100:00100000:1.0:1790945809.249419:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945809.249439:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4ceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1877942638518656:0@lo:400: 00000100:00100000:1.0:1790945809.249457:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945809.249473:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1877942638519168:0@lo:400: 00000100:00100000:1.0:1790945809.249493:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945809.249511:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1790945809.249516:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4cec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638518272:0@lo:400: 00000100:00100000:1.0:1790945809.249536:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945809.249552:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4ceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1877942638518784:0@lo:400: 00000100:00100000:1.0:1790945809.249571:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945809.249582:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1877942638519296:0@lo:400: 00000100:00100000:1.0:1790945809.249618:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945809.249647:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638518400 00000100:00100000:1.0:1790945809.249655:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638518400 00000100:00100000:1.0:1790945809.249690:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638518144 00000100:00100000:1.0:1790945809.249693:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638518144 00000100:00100000:1.0:1790945809.249704:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638518656 00000100:00100000:1.0:1790945809.249707:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638518656 00000100:00100000:1.0:1790945809.249726:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638519168 00000100:00100000:1.0:1790945809.249729:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638519168 00000100:00100000:1.0:1790945809.249750:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638518784 00000100:00100000:1.0:1790945809.249753:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638518784 00000100:00100000:1.0:1790945809.249766:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638519296 00000100:00100000:1.0:1790945809.249768:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638519296 00000100:00100000:1.0:1790945809.249783:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790945809.249791:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638518400:12345-0@lo:400: 00000100:00100000:1.0:1790945809.249844:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638518400:12345-0@lo:400: Request processed in 53us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945809.249851:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790945809.249869:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790945809.249875:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638518144:12345-0@lo:400: 00000100:00100000:1.0:1790945809.249908:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638518144:12345-0@lo:400: Request processed in 33us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945809.249913:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790945809.249925:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790945809.249930:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1877942638518656:12345-0@lo:400: 00000100:00100000:1.0:1790945809.249956:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1877942638518656:12345-0@lo:400: Request processed in 27us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945809.249960:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790945809.249969:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790945809.249975:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1877942638519168:12345-0@lo:400: 00000100:00100000:1.0:1790945809.249998:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1877942638519168:12345-0@lo:400: Request processed in 23us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945809.250003:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790945809.250013:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790945809.250019:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1877942638518784:12345-0@lo:400: 00000100:00100000:1.0:1790945809.250046:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1877942638518784:12345-0@lo:400: Request processed in 27us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945809.250058:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790945809.250070:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790945809.250076:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1877942638519296:12345-0@lo:400: 00000100:00100000:1.0:1790945809.250103:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1877942638519296:12345-0@lo:400: Request processed in 28us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945809.250108:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790945809.250127:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638518912 00000100:00100000:1.0:1790945809.250131:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638518912 00000100:00100000:1.0:1790945809.250157:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638519040 00000100:00100000:1.0:1790945809.250160:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638519040 00000100:00100000:1.0:1790945809.250204:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790945809.250210:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638518912:12345-0@lo:400: 00000100:00100000:1.0:1790945809.250240:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638518912:12345-0@lo:400: Request processed in 31us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945809.250246:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790945809.250256:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790945809.250262:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638519040:12345-0@lo:400: 00000100:00100000:1.0:1790945809.250288:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638519040:12345-0@lo:400: Request processed in 27us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945809.250294:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790945809.250317:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638518016 00000100:00100000:1.0:1790945809.250321:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638518016 00000100:00100000:1.0:1790945809.250342:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1790945809.250348:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087031050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:3649:x1877942638518016:12345-0@lo:400: 00000100:00100000:1.0:1790945809.250377:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087031050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:3649:x1877942638518016:12345-0@lo:400: Request processed in 29us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945809.250392:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1790945809.250419:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638518528 00000100:00100000:1.0:1790945809.250423:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638518528 00000100:00100000:1.0:1790945809.250444:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638518272 00000100:00100000:1.0:1790945809.250447:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638518272 00000100:00100000:1.0:1790945809.250464:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790945809.250469:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638518528:12345-0@lo:400: 00000100:00100000:2.0:1790945809.251552:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790945809.251570:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638519424:0@lo:41: 00000100:00100000:2.0:1790945809.251626:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945809.253066:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638518528:12345-0@lo:400: Request processed in 2589us (3726us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945809.253080:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790945809.253105:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638519424 00000100:00100000:1.0:1790945809.253112:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638519424 00000100:00100000:1.0:1790945809.253141:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790945809.253150:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638518272:12345-0@lo:400: 00000100:00100000:1.0:1790945809.253474:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638518272:12345-0@lo:400: Request processed in 325us (3935us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945809.253481:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790945809.253494:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790945809.253499:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638519424:12345-0@lo:41: 00000004:00000024:1.0:1790945809.253522:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1790945809.253597:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638519424:12345-0@lo:41: Request processed in 97us (1970us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945809.253603:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1790945809.253652:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790945809.253658:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790945809.253660:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790945809.253696:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4cec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638518272:0@lo:400: 00010000:00080000:1.0:1790945809.253721:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40b4ceca80 x1877942638518784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945809.253730:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4ceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1877942638518784:0@lo:400: 00010000:00080000:1.0:1790945809.253740:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f833f0e00 x1877942638519296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945809.253748:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1877942638519296:0@lo:400: 00010000:00080000:1.0:1790945809.253757:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40b4ced180 x1877942638518144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945809.253765:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4ced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638518144:0@lo:400: 00010000:00080000:1.0:1790945809.253774:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40b4ceea00 x1877942638518656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945809.253781:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4ceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1877942638518656:0@lo:400: 00010000:00080000:1.0:1790945809.253791:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f833f3800 x1877942638519168/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945809.253798:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1877942638519168:0@lo:400: 00000100:00100000:1.0:1790945809.253841:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4cef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638518016:0@lo:400: 00000100:00100000:1.0:1790945809.253851:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638518528:0@lo:400: 00010000:00080000:1.0:1790945809.253862:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f833f0380 x1877942638519040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945809.253870:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638519040:0@lo:400: 00010000:00080000:1.0:1790945809.253881:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40b4cefb80 x1877942638518400/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945809.253904:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4cefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638518400:0@lo:400: 00010000:00080000:1.0:1790945809.253919:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f833f2680 x1877942638518912/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945809.253926:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638518912:0@lo:400: 00000100:00100000:2.0:1790945809.256118:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638519424:0@lo:41: 10000000:01000000:2.0:1790945809.759271:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1790945809.759281:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d40bc9be000 from 39 10000000:01000000:2.0:1790945809.759287:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790945809.759348:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40813ff800/0xd9f4181e0d27d049 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945809.759361:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40813ff800/0xd9f4181e0d27d049 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945809.759373:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40813ff800/0xd9f4181e0d27d049 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945809.759397:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f835e8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638519552:0@lo:101: 00000100:00100000:2.0:1790945809.759476:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945809.759533:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4d05cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790945809.759685:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638519552 00000100:00100000:1.0:1790945809.759694:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638519552 00000100:00100000:1.0:1790945809.759839:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1790945809.759851:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:6519:x1877942638519552:12345-0@lo:101: 00010000:00010000:1.0:1790945809.759944:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945809.759961:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40c21d7400/0xd9f4181e0d27d050 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27d049 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945809.759990:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40c21d7400/0xd9f4181e0d27d050 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27d049 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945809.760003:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40c21d7400/0xd9f4181e0d27d050 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d049 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945809.760013:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40c21d7400, rc 0) 00000100:00100000:1.0:1790945809.760068:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:6519:x1877942638519552:12345-0@lo:101: Request processed in 220us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945809.760075:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1790945809.760340:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f835e8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638519552:0@lo:101: 00010000:00010000:2.0:1790945809.760357:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40813ff800/0xd9f4181e0d27d049 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d050 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945809.760366:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40813ff800/0xd9f4181e0d27d049 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d050 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945809.760428:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f835e8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638519680:0@lo:501: 00000100:00100000:2.0:1790945809.760455:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945809.760478:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4d05cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790945809.760492:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638519680 00000100:00100000:2.0:1790945809.760496:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638519680 00000100:00100000:2.0:1790945809.760521:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1790945809.760526:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087032450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:6519:x1877942638519680:12345-0@lo:501: 00000100:00100000:2.0:1790945809.760649:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087032450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:6519:x1877942638519680:12345-0@lo:501: Request processed in 122us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945809.760654:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1790945809.760690:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f835e8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638519680:0@lo:501: 00000100:00100000:2.0:1790945809.760715:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f835e8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638519808:0@lo:503: 00000100:00100000:2.0:1790945809.762008:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945809.762038:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4d05cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790945809.762104:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638519808 00000100:00100000:1.0:1790945809.762110:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638519808 00000100:00100000:1.0:1790945809.762149:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1790945809.762156:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:6519:x1877942638519808:12345-0@lo:503: 00000100:00100000:1.0:1790945809.762373:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:6519:x1877942638519808:12345-0@lo:503: Request processed in 216us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945809.762381:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1790945809.762854:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f835e8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638519808:0@lo:503: 00000100:00100000:1.0:1790945809.764414:0:9871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:9871:1877942638519936:0@lo:502: 00000100:00100000:1.0:1790945809.764488:0:9871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945809.766648:0:9871:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d409103c240 going to sleep for 11 seconds 00000100:00100000:2.0:1790945809.771348:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638519936 00000100:00100000:2.0:1790945809.771365:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638519936 00000100:00100000:2.0:1790945809.771437:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1790945809.771449:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:9871:x1877942638519936:12345-0@lo:502: 00000100:00100000:2.0:1790945809.771634:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:9871:x1877942638519936:12345-0@lo:502: Request processed in 187us (7145us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945809.771642:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1790945809.771700:0:9871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:9871:1877942638519936:0@lo:502: 00000100:00100000:2.0:1790945809.773414:0:9871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f835e8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:9871:1877942638520064:0@lo:502: 00000100:00100000:2.0:1790945809.773492:0:9871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945809.773534:0:9871:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4d05480 going to sleep for 11 seconds 00000100:00100000:2.0:1790945809.773558:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638520064 00000100:00100000:2.0:1790945809.773565:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638520064 00000100:00100000:2.0:1790945809.773629:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1790945809.773637:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:9871:x1877942638520064:12345-0@lo:502: 00000100:00100000:2.0:1790945809.774963:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:9871:x1877942638520064:12345-0@lo:502: Request processed in 1320us (1465us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945809.774976:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1790945809.775096:0:9871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f835e8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:9871:1877942638520064:0@lo:502: 00000040:00080000:3.0:1790945809.775132:0:9871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1790945809.775836:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1790945809.775947:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790945809.775961:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40813ff800/0xd9f4181e0d27d049 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d050 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945809.775974:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40813ff800/0xd9f4181e0d27d049 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d050 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945809.775986:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1790945809.775988:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1790945809.775991:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1790945809.776039:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40813ff200/0xd9f4181e0d27d057 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945809.776048:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40813ff200/0xd9f4181e0d27d057 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945809.776057:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40813ff200/0xd9f4181e0d27d057 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945809.776075:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f835e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638520192:0@lo:101: 00000100:00100000:2.0:1790945809.776118:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945809.776164:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40baeabf00 going to sleep for 11 seconds 00000100:00100000:3.0:1790945809.776827:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638520192 00000100:00100000:3.0:1790945809.776834:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638520192 00000100:00100000:3.0:1790945809.778563:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1790945809.778586:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087031850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:6519:x1877942638520192:12345-0@lo:101: 00010000:00010000:3.0:1790945809.778616:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945809.778638:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40baef0c00/0xd9f4181e0d27d05e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27d057 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945809.778673:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40baef0c00/0xd9f4181e0d27d05e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27d057 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945809.778687:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40baef0c00/0xd9f4181e0d27d05e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d057 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945809.778696:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40baef0c00, rc 0) 00000100:00100000:3.0:1790945809.778791:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087031850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:6519:x1877942638520192:12345-0@lo:101: Request processed in 215us (2672us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945809.778811:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1790945809.781268:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f835e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638520192:0@lo:101: 00010000:00010000:2.0:1790945809.781301:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40813ff200/0xd9f4181e0d27d057 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d05e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945809.781316:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40813ff200/0xd9f4181e0d27d057 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d05e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945809.781402:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f835e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638520320:0@lo:501: 00000100:00100000:2.0:1790945809.781459:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945809.781503:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40baeabf00 going to sleep for 11 seconds 00000100:00100000:2.0:1790945809.781525:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638520320 00000100:00100000:2.0:1790945809.781531:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638520320 00000100:00100000:2.0:1790945809.781571:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1790945809.781580:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:6519:x1877942638520320:12345-0@lo:501: 00000100:00100000:2.0:1790945809.781939:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:6519:x1877942638520320:12345-0@lo:501: Request processed in 359us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945809.781947:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1790945809.782006:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f835e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638520320:0@lo:501: 00000100:00100000:2.0:1790945809.782033:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f835e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638520448:0@lo:503: 00000100:00100000:2.0:1790945809.782073:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945809.782087:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40baeabf00 going to sleep for 11 seconds 00000100:00100000:2.0:1790945809.782824:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638520448 00000100:00100000:2.0:1790945809.782833:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638520448 00000100:00100000:2.0:1790945809.782950:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1790945809.782958:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:6519:x1877942638520448:12345-0@lo:503: 00000100:00100000:2.0:1790945809.783072:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:6519:x1877942638520448:12345-0@lo:503: Request processed in 115us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945809.783079:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1790945809.783133:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f835e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638520448:0@lo:503: 00000100:00100000:3.0:1790945809.788163:0:9873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:9873:1877942638520576:0@lo:502: 00000100:00100000:3.0:1790945809.788292:0:9873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945809.788331:0:9873:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4d05900 going to sleep for 11 seconds 00000100:00100000:0.0:1790945809.788455:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638520576 00000100:00100000:0.0:1790945809.788463:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638520576 00000100:00100000:0.0:1790945809.788513:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1790945809.788522:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087033c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:9873:x1877942638520576:12345-0@lo:502: 00000100:00100000:0.0:1790945809.788670:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087033c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:9873:x1877942638520576:12345-0@lo:502: Request processed in 148us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945809.788678:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1790945809.788839:0:9873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:9873:1877942638520576:0@lo:502: 00000020:01000000:3.0:1790945809.788887:0:9873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790945809.788897:0:9873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945809.788899:0:9873:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790945809.788905:0:9873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790945809.788907:0:9873:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1790945809.788925:0:9873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:9873:1877942638520704:0@lo:502: 00000100:00100000:3.0:1790945809.788958:0:9873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945809.788988:0:9873:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4d05900 going to sleep for 11 seconds 00000100:00100000:0.0:1790945809.789144:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638520704 00000100:00100000:0.0:1790945809.789149:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638520704 00000100:00100000:0.0:1790945809.789402:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1790945809.789411:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af617450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:9873:x1877942638520704:12345-0@lo:502: 00000100:00100000:0.0:1790945809.789499:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af617450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:9873:x1877942638520704:12345-0@lo:502: Request processed in 88us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945809.789506:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1790945809.789616:0:9873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:9873:1877942638520704:0@lo:502: 00000020:01000000:3.0:1790945809.789636:0:9873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790945809.789641:0:9873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945809.789643:0:9873:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:3.0:1790945809.789647:0:9873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1790945809.789939:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1790945809.789963:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1790945809.789973:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40813ff200/0xd9f4181e0d27d057 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d05e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945809.789984:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40813ff200/0xd9f4181e0d27d057 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d05e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945809.789995:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1790945809.789997:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d40bacd0800 from 39 10000000:01000000:2.0:1790945809.790000:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790945809.790025:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27d065 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945809.790034:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27d065 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945809.790054:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27d065 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945809.790070:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f835e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638520832:0@lo:101: 00000100:00100000:2.0:1790945809.790106:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945809.790138:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f81b86c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790945809.790207:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638520832 00000100:00100000:3.0:1790945809.790212:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638520832 00000100:00100000:3.0:1790945809.790308:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1790945809.790316:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af614050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:6519:x1877942638520832:12345-0@lo:101: 00010000:00010000:3.0:1790945809.790327:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945809.790339:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40baef0200/0xd9f4181e0d27d06c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27d065 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945809.790360:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40baef0200/0xd9f4181e0d27d06c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27d065 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945809.790378:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40baef0200/0xd9f4181e0d27d06c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d065 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945809.790387:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40baef0200, rc 0) 00000100:00100000:3.0:1790945809.790423:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af614050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:6519:x1877942638520832:12345-0@lo:101: Request processed in 108us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945809.790430:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1790945809.790505:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f835e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638520832:0@lo:101: 00010000:00010000:2.0:1790945809.790522:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27d065 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d06c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945809.790530:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27d065 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d06c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945809.790576:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f835e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638520960:0@lo:501: 00000100:00100000:2.0:1790945809.790617:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945809.790642:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f81b86c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790945809.790708:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638520960 00000100:00100000:0.0:1790945809.790713:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638520960 00000100:00100000:0.0:1790945809.790828:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1790945809.790834:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af614450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:6519:x1877942638520960:12345-0@lo:501: 00000100:00100000:0.0:1790945809.791025:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af614450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:6519:x1877942638520960:12345-0@lo:501: Request processed in 191us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945809.791033:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1790945809.791099:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f835e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638520960:0@lo:501: 00000100:00100000:2.0:1790945809.791128:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f835e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638521088:0@lo:503: 00000100:00100000:2.0:1790945809.791164:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945809.791215:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f81b86c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790945809.791227:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638521088 00000100:00100000:2.0:1790945809.791231:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638521088 00000100:00100000:2.0:1790945809.791321:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1790945809.791327:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af615850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:6519:x1877942638521088:12345-0@lo:503: 00000100:00100000:2.0:1790945809.791401:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af615850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:6519:x1877942638521088:12345-0@lo:503: Request processed in 74us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945809.791414:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1790945809.791457:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f835e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638521088:0@lo:503: 00000100:00100000:2.0:1790945809.791650:0:9874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f835e9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:9874:1877942638521216:0@lo:502: 00000100:00100000:2.0:1790945809.791683:0:9874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945809.791702:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638521216 00000100:00100000:2.0:1790945809.791706:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638521216 00000100:00100000:2.0:1790945809.791900:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1790945809.791910:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af616c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:9874:x1877942638521216:12345-0@lo:502: 00000100:00100000:2.0:1790945809.791976:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af616c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:9874:x1877942638521216:12345-0@lo:502: Request processed in 68us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945809.805269:0:9874:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4084cae540 going to sleep for 11 seconds 00000100:00100000:0.0:1790945809.805321:0:9874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f835e9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:9874:1877942638521216:0@lo:502: 00000100:00100000:0.0:1790945809.805412:0:9874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:9874:1877942638521344:0@lo:502: 00000100:00100000:0.0:1790945809.805484:0:9874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945809.805520:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638521344 00000100:00100000:0.0:1790945809.805527:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638521344 00000100:00100000:0.0:1790945809.805567:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1790945809.805575:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af614c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+19:9874:x1877942638521344:12345-0@lo:502: 00000100:00100000:0.0:1790945809.805717:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af614c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+19:9874:x1877942638521344:12345-0@lo:502: Request processed in 141us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945809.805738:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1790945809.805778:0:9874:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f825a9300 going to sleep for 11 seconds 00000100:00100000:0.0:1790945809.805791:0:9874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:9874:1877942638521344:0@lo:502: 00000040:00080000:0.0:1790945809.805808:0:9874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000100:00100000:2.0:1790945809.812841:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000020:01000000:2.0:1790945809.812981:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1790945809.813017:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790945809.813030:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27d065 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d06c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945809.813043:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27d065 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d06c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945809.813054:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790945809.813058:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d40bacd0800 from 6 10000000:01000000:2.0:1790945809.813061:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790945809.813100:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40813ffa00/0xd9f4181e0d27d073 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945809.813109:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40813ffa00/0xd9f4181e0d27d073 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945809.813134:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40813ffa00/0xd9f4181e0d27d073 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945809.813156:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f835e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638521472:0@lo:101: 00000100:00100000:2.0:1790945809.814363:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945809.814417:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f83588f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790945809.814450:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638521472 00000100:00100000:2.0:1790945809.814458:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638521472 00000100:00100000:2.0:1790945809.814508:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1790945809.814519:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af617c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:6519:x1877942638521472:12345-0@lo:101: 00010000:00010000:2.0:1790945809.814535:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945809.814552:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40813fe400/0xd9f4181e0d27d07a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27d073 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945809.814577:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40813fe400/0xd9f4181e0d27d07a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27d073 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945809.814589:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40813fe400/0xd9f4181e0d27d07a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d073 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945809.814607:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40813fe400, rc 0) 00000100:00100000:2.0:1790945809.814650:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af617c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+19:6519:x1877942638521472:12345-0@lo:101: Request processed in 133us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945809.814657:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1790945809.814701:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f835e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638521472:0@lo:101: 00010000:00010000:2.0:1790945809.814717:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40813ffa00/0xd9f4181e0d27d073 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d07a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945809.815992:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40813ffa00/0xd9f4181e0d27d073 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d07a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945809.816059:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f835e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638521600:0@lo:256: 00000100:00100000:2.0:1790945809.816109:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945809.816144:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f83588f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790945809.816179:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638521600 00000100:00100000:2.0:1790945809.816185:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638521600 00000100:00100000:2.0:1790945809.816223:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1790945809.816232:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af615450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+19:6519:x1877942638521600:12345-0@lo:256: 20000000:01000000:2.0:1790945809.817224:0:6514:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790945809.817312:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790945809.817316:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1790945809.817426:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af615450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+19:6519:x1877942638521600:12345-0@lo:256: Request processed in 1193us (1314us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945809.817437:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1790945809.817607:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f835e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638521600:0@lo:256: 10000000:01000000:3.0:1790945809.817661:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790945809.817671:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40813ffa00/0xd9f4181e0d27d073 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d07a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945809.817680:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40813ffa00/0xd9f4181e0d27d073 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d07a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790945809.817689:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1790945809.817691:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:3.0:1790945809.817694:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1790945809.817720:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef1c00/0xd9f4181e0d27d081 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945809.818116:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40baef1c00/0xd9f4181e0d27d081 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945809.818126:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40baef1c00/0xd9f4181e0d27d081 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945809.818143:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638521728:0@lo:101: 00000100:00100000:3.0:1790945809.818382:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945809.818418:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40871c6240 going to sleep for 11 seconds 00000100:00100000:3.0:1790945809.818437:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638521728 00000100:00100000:3.0:1790945809.818443:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638521728 00000100:00100000:3.0:1790945809.818485:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1790945809.818493:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af615c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+19:6519:x1877942638521728:12345-0@lo:101: 00010000:00010000:3.0:1790945809.818504:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945809.818518:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40baef0000/0xd9f4181e0d27d088 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27d081 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945809.818540:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40baef0000/0xd9f4181e0d27d088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27d081 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945809.818550:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40baef0000/0xd9f4181e0d27d088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d081 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945809.818558:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40baef0000, rc 0) 00000100:00100000:3.0:1790945809.818591:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af615c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+20:6519:x1877942638521728:12345-0@lo:101: Request processed in 98us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945809.818609:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1790945809.818648:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638521728:0@lo:101: 00010000:00010000:3.0:1790945809.818663:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40baef1c00/0xd9f4181e0d27d081 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d088 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945809.818672:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40baef1c00/0xd9f4181e0d27d081 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d088 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945809.818744:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638521856:0@lo:501: 00000100:00100000:3.0:1790945809.820886:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945809.820944:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40917c1840 going to sleep for 11 seconds 00000100:00100000:2.0:1790945809.821075:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638521856 00000100:00100000:2.0:1790945809.821084:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638521856 00000100:00100000:2.0:1790945809.821136:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1790945809.821146:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af617050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+20:6519:x1877942638521856:12345-0@lo:501: 00000100:00100000:2.0:1790945809.821326:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af617050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+20:6519:x1877942638521856:12345-0@lo:501: Request processed in 181us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945809.821335:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1790945809.821388:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638521856:0@lo:501: 00000100:00100000:2.0:1790945809.821429:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f835ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638521984:0@lo:503: 00000100:00100000:2.0:1790945809.821483:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945809.821498:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f83588a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790945809.821511:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638521984 00000100:00100000:2.0:1790945809.821515:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638521984 00000100:00100000:2.0:1790945809.821539:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1790945809.821546:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af614850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+20:6519:x1877942638521984:12345-0@lo:503: 00000100:00100000:2.0:1790945809.821640:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af614850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+20:6519:x1877942638521984:12345-0@lo:503: Request processed in 94us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945809.821647:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1790945809.821685:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f835ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638521984:0@lo:503: 00000100:00100000:2.0:1790945809.821898:0:9879:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f835ebb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:9879:1877942638522112:0@lo:502: 00000100:00100000:2.0:1790945809.821932:0:9879:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945809.821951:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638522112 00000100:00100000:2.0:1790945809.821955:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638522112 00000100:00100000:2.0:1790945809.821976:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1790945809.821982:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af616050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+20:9879:x1877942638522112:12345-0@lo:502: 00000100:00100000:2.0:1790945809.822052:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af616050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+20:9879:x1877942638522112:12345-0@lo:502: Request processed in 70us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945809.822059:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1790945809.822088:0:9879:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f83588600 going to sleep for 11 seconds 00000100:00100000:2.0:1790945809.822100:0:9879:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f835ebb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:9879:1877942638522112:0@lo:502: 00000020:01000000:2.0:1790945809.822119:0:9879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790945809.822127:0:9879:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1790945809.822134:0:9879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945809.822136:0:9879:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1790945809.822142:0:9879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790945809.822151:0:9879:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.120@tcp to nid 0x20000c0a8cc78 (192.168.204.120@tcp) 00000020:01000000:2.0:1790945809.822194:0:9879:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1790945809.822198:0:9879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790945809.822213:0:9879:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9d40bca83380) 00000020:00000080:2.0:1790945809.822235:0:9879:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1790945809.822242:0:9879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790945809.822315:0:9879:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1790945809.822322:0:9879:0:(osd_handler.c:8931:osd_obd_connect()) connect #5 00000020:00000080:2.0:1790945809.822329:0:9879:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd9f4181e0d27d096 00010000:00080000:2.0:1790945809.822373:0:9879:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d3f8340b000@lustre-OST0001-osc-MDT0001: add connection 192.168.204.120@tcp at head 00010000:00010000:2.0:1790945809.822592:0:9879:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:2.0:1790945809.822726:0:9879:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1790945809.822738:0:9879:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1790945809.822915:0:9879:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790945809.823016:0:9879:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790945809.823157:0:9879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1790945809.823291:0:9879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1790945809.825394:0:9880:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790945809.825402:0:9880:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000001:02000400:0.0:1790945809.833572:0:9878:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000080:1.0:1790945809.839649:0:9879:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1790945809.839668:0:9879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1790945809.839720:0:9879:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1790945809.840946:0:9879:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd9f4181e0d27d09d 00000100:00080000:1.0:1790945809.840964:0:9879:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790945809.840979:0:9879:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9d3f8340b000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1790945809.841024:0:9879:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f833f0380 x1877942638522240/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790945809.841123:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638522240:0@lo:8: 00000100:00100000:2.0:1790945809.841232:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790945809.841354:0:9879:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1790945809.841426:0:9879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790945809.841431:0:9879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790945809.841433:0:9879:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1790945809.841436:0:9879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790945809.841440:0:9879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790945809.841441:0:9879:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790945809.841444:0:9879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790945809.841446:0:9879:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1790945809.841471:0:9879:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:9879:1877942638522368:0@lo:502: 00000100:00100000:1.0:1790945809.841528:0:9879:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945809.841548:0:9879:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d409103c240 going to sleep for 11 seconds 00000100:00100000:3.0:1790945809.841639:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638522240 00000100:00100000:3.0:1790945809.841647:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638522240 00000100:00100000:3.0:1790945809.841687:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790945809.841694:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1877942638522240:12345-0@lo:8: 00010000:00080000:3.0:1790945809.841720:0:8916:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 260 last 0 00000020:00000080:3.0:1790945809.841760:0:8916:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd9f4181e0d27d0a4 00002000:00100000:3.0:1790945809.841773:0:8916:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9d40bff0e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1790945809.841777:0:8916:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:3.0:1790945809.841780:0:8916:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1790945809.841839:0:8916:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1790945809.842092:0:8916:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1790945809.842117:0:8916:0:(import.c:65:import_set_state_nolock()) ffff9d40bff0d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790945809.845364:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3646:x1877942638522240:12345-0@lo:8: Request processed in 3661us (4123us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945809.845379:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1790945809.845849:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f833f0380 x1877942638522240/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790945819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945809.845943:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790945809.845954:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1790945809.845964:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1790945809.845969:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1790945809.845972:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d3f8340b000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1790945809.845990:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1790945809.845997:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638522240:0@lo:8: 00000100:00100000:2.0:1790945809.846056:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638522368 00000100:00100000:2.0:1790945809.846071:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638522368 00000100:00100000:2.0:1790945809.846112:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1790945809.846121:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af616850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+20:9879:x1877942638522368:12345-0@lo:502: 00000004:00080000:3.0:1790945809.846334:0:9880:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1790945809.846410:0:9880:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 260662241021ns, next at 0ns, rc = 0 00080000:00080000:3.0:1790945809.846416:0:9880:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1790945809.847065:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af616850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+20:9879:x1877942638522368:12345-0@lo:502: Request processed in 943us (5534us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945809.847074:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1790945809.847205:0:9881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f835eb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9881:1877942638522496:0@lo:700: 00000100:00100000:3.0:1790945809.847360:0:9879:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:9879:1877942638522368:0@lo:502: 00000020:01000000:3.0:1790945809.847390:0:9879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790945809.847397:0:9879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945809.847400:0:9879:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:3.0:1790945809.847406:0:9879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:3.0:1790945809.848341:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:3.0:1790945809.848385:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1790945809.848398:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef1c00/0xd9f4181e0d27d081 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d088 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945809.848411:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40baef1c00/0xd9f4181e0d27d081 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d088 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790945809.848422:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1790945809.848425:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d4087223000 from 39 10000000:01000000:3.0:1790945809.848428:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00000100:00100000:2.0:1790945809.848808:0:9881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945809.849252:0:8444:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638522496 00000100:00100000:2.0:1790945809.849260:0:8444:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638522496 00000100:00100000:2.0:1790945809.849322:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790945809.849331:0:8444:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9881:x1877942638522496:12345-0@lo:700: 00000100:00100000:2.0:1790945809.849383:0:8444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f835e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8444:1877942638522624:0@lo:700: 00000100:00100000:2.0:1790945809.849435:0:8444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945809.849457:0:8444:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4088c76840 going to sleep for 11 seconds 00000100:00080000:2.0:1790945809.849472:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790945809.849484:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638522624 00000100:00100000:2.0:1790945809.849487:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638522624 00000100:00100000:2.0:1790945809.849511:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790945809.849516:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8444:x1877942638522624:12345-0@lo:700: 00000100:00100000:2.0:1790945809.849637:0:9881:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4088c76300 going to sleep for 11 seconds 00010000:00010000:3.0:1790945809.851046:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27d0ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945809.851060:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27d0ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945809.851070:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27d0ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945809.851089:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638522752:0@lo:101: 00000100:00100000:3.0:1790945809.851143:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945809.851205:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40871c6240 going to sleep for 11 seconds 00000100:00100000:0.0:1790945809.851547:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638522752 00000100:00100000:0.0:1790945809.851554:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638522752 00000100:00100000:0.0:1790945809.851614:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1790945809.851623:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af615050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+20:6519:x1877942638522752:12345-0@lo:101: 00010000:00010000:0.0:1790945809.851635:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945809.851654:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d4086a4da00/0xd9f4181e0d27d0b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27d0ab expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945809.851678:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d4086a4da00/0xd9f4181e0d27d0b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27d0ab expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945809.851689:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d4086a4da00/0xd9f4181e0d27d0b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d0ab expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945809.851697:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4086a4da00, rc 0) 00000100:00100000:0.0:1790945809.852539:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af615050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:6519:x1877942638522752:12345-0@lo:101: Request processed in 916us (1393us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945809.852548:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1790945809.852623:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638522752:0@lo:101: 00010000:00010000:0.0:1790945809.852640:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27d0ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d0b2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945809.852650:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27d0ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d0b2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945809.852716:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638522880:0@lo:501: 00000100:00100000:0.0:1790945809.852762:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945809.852786:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f825a99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790945809.852799:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638522880 00000100:00100000:0.0:1790945809.852803:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638522880 00000100:00100000:0.0:1790945809.852829:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1790945809.852836:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af617850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:6519:x1877942638522880:12345-0@lo:501: 00000100:00100000:0.0:1790945809.852949:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af617850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:6519:x1877942638522880:12345-0@lo:501: Request processed in 114us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945809.852963:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1790945809.852991:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638522880:0@lo:501: 00000100:00100000:0.0:1790945809.853032:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638523008:0@lo:503: 00000100:00100000:0.0:1790945809.853070:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945809.853087:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f825a99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790945809.853092:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638523008 00000100:00100000:1.0:1790945809.853097:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638523008 00000100:00100000:1.0:1790945809.853135:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1790945809.853141:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af616450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:6519:x1877942638523008:12345-0@lo:503: 00000100:00100000:1.0:1790945809.853470:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af616450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:6519:x1877942638523008:12345-0@lo:503: Request processed in 328us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945809.853470:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638523008:0@lo:503: 00000100:00100000:1.0:1790945809.853477:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1790945809.853793:0:9882:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:9882:1877942638523136:0@lo:502: 00000100:00100000:1.0:1790945809.853827:0:9882:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945809.853982:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638523136 00000100:00100000:0.0:1790945809.853988:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638523136 00000100:00100000:0.0:1790945809.854013:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1790945809.854020:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:9882:x1877942638523136:12345-0@lo:502: 00000100:00100000:0.0:1790945809.854091:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:9882:x1877942638523136:12345-0@lo:502: Request processed in 71us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945809.854097:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000004:00080000:0.0:1790945809.854329:0:7452:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:1.0:1790945809.854575:0:9882:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d409103c840 going to sleep for 11 seconds 00000100:00100000:1.0:1790945809.854604:0:9882:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:9882:1877942638523136:0@lo:502: 00000100:00100000:1.0:1790945809.854651:0:9882:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:9882:1877942638523264:0@lo:502: 00000100:00100000:1.0:1790945809.854687:0:9882:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945809.854709:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638523264 00000100:00100000:1.0:1790945809.854713:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638523264 00000100:00100000:1.0:1790945809.855121:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1790945809.855128:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:9882:x1877942638523264:12345-0@lo:502: 00000100:00100000:1.0:1790945809.855227:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:9882:x1877942638523264:12345-0@lo:502: Request processed in 99us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945809.855294:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1790945809.856323:0:9882:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4083c76180 going to sleep for 11 seconds 00000100:00100000:2.0:1790945809.856352:0:9882:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:9882:1877942638523264:0@lo:502: 00000040:00080000:2.0:1790945809.856387:0:9882:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1790945809.856474:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1790945809.856498:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790945809.856508:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27d0ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d0b2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945809.856519:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27d0ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d0b2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945809.856528:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790945809.856530:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d4087223000 from 6 10000000:01000000:0.0:1790945809.856532:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790945809.856561:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4086a4de00/0xd9f4181e0d27d0b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945809.856577:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d4086a4de00/0xd9f4181e0d27d0b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945809.856586:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d4086a4de00/0xd9f4181e0d27d0b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945809.856612:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638523392:0@lo:101: 00000100:00100000:0.0:1790945809.856658:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945809.856688:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f825a9e40 going to sleep for 11 seconds 40000000:02000000:0.0:1790945809.856952:0:6528:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:2.0:1790945809.857691:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638523392 00000100:00100000:2.0:1790945809.857701:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638523392 00000100:00100000:2.0:1790945809.857746:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1790945809.857763:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:6519:x1877942638523392:12345-0@lo:101: 00010000:00010000:2.0:1790945809.857776:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945809.857790:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40813ffe00/0xd9f4181e0d27d0c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27d0b9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945809.857814:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40813ffe00/0xd9f4181e0d27d0c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27d0b9 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945809.857825:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40813ffe00/0xd9f4181e0d27d0c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d0b9 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945809.857832:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40813ffe00, rc 0) 00000100:00100000:2.0:1790945809.857887:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:6519:x1877942638523392:12345-0@lo:101: Request processed in 127us (1229us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945809.857894:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1790945809.865637:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8444:x1877942638522624:12345-0@lo:700: Request processed in 16112us (16192us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945809.865655:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790945809.865716:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638523392:0@lo:101: 00010000:00080000:1.0:1790945809.865961:0:8444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f835e9c00 x1877942638522624/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790945825 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945809.865975:0:8444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f835e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8444:1877942638522624:0@lo:700: 40000000:02000000:1.0:1790945809.865988:0:8444:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00010000:00010000:0.0:1790945809.866340:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d4086a4de00/0xd9f4181e0d27d0b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d0c0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945809.866354:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d4086a4de00/0xd9f4181e0d27d0b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d0c0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945809.866415:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638523520:0@lo:256: 00000100:00100000:0.0:1790945809.866460:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945809.866490:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f825a9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790945809.866506:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638523520 00000100:00100000:0.0:1790945809.866512:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638523520 00000100:00100000:0.0:1790945809.866550:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1790945809.866560:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:6519:x1877942638523520:12345-0@lo:256: 20000000:01000000:0.0:1790945809.866587:0:6514:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790945809.866614:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790945809.866618:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1790945809.866693:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:6519:x1877942638523520:12345-0@lo:256: Request processed in 136us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945809.866701:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1790945809.867254:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638523520:0@lo:256: 10000000:01000000:0.0:1790945809.867300:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790945809.867308:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4086a4de00/0xd9f4181e0d27d0b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d0c0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945809.867318:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d4086a4de00/0xd9f4181e0d27d0b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d0c0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945809.867327:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1790945809.867329:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1790945809.867332:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1790945809.867357:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d600/0xd9f4181e0d27d0c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945809.867365:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d600/0xd9f4181e0d27d0c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945809.867373:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d600/0xd9f4181e0d27d0c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945809.867386:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638523648:0@lo:101: 00000100:00100000:0.0:1790945809.867416:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945809.867444:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f825a9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790945809.869306:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638523648 00000100:00100000:2.0:1790945809.869319:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638523648 00000100:00100000:2.0:1790945809.869373:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1790945809.869383:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:6519:x1877942638523648:12345-0@lo:101: 00010000:00010000:2.0:1790945809.869399:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945809.869414:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40813fea00/0xd9f4181e0d27d0ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27d0c7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945809.869441:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40813fea00/0xd9f4181e0d27d0ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27d0c7 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945809.869453:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40813fea00/0xd9f4181e0d27d0ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d0c7 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945809.869462:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40813fea00, rc 0) 00000100:00100000:2.0:1790945809.869548:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:6519:x1877942638523648:12345-0@lo:101: Request processed in 154us (2118us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945809.869556:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1790945809.869564:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638523648:0@lo:101: 00010000:00010000:0.0:1790945809.869582:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d600/0xd9f4181e0d27d0c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d0ce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945809.869590:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d600/0xd9f4181e0d27d0c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d0ce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945809.869668:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638523776:0@lo:501: 00000100:00100000:0.0:1790945809.869701:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945809.869748:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f825a9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790945809.869777:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638523776 00000100:00100000:2.0:1790945809.869782:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638523776 00000100:00100000:2.0:1790945809.869810:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1790945809.869816:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:6519:x1877942638523776:12345-0@lo:501: 00000100:00100000:2.0:1790945809.869940:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:6519:x1877942638523776:12345-0@lo:501: Request processed in 124us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945809.869948:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1790945809.869963:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638523776:0@lo:501: 00000100:00100000:0.0:1790945809.869988:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638523904:0@lo:503: 00000100:00100000:0.0:1790945809.870024:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945809.870036:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f825a9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790945809.870049:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638523904 00000100:00100000:0.0:1790945809.870052:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638523904 00000100:00100000:0.0:1790945809.870074:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1790945809.870079:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:6519:x1877942638523904:12345-0@lo:503: 00000100:00100000:0.0:1790945809.870150:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:6519:x1877942638523904:12345-0@lo:503: Request processed in 70us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945809.870156:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1790945809.870208:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638523904:0@lo:503: 00000100:00100000:0.0:1790945809.870569:0:9884:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:9884:1877942638524032:0@lo:502: 00000100:00100000:0.0:1790945809.870615:0:9884:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945809.870643:0:9884:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f825a9480 going to sleep for 11 seconds 00000100:00100000:3.0:1790945809.870686:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638524032 00000100:00100000:3.0:1790945809.870691:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638524032 00000100:00100000:3.0:1790945809.870728:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1790945809.870736:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:9884:x1877942638524032:12345-0@lo:502: 00000100:00100000:3.0:1790945809.870811:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:9884:x1877942638524032:12345-0@lo:502: Request processed in 75us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945809.870816:0:9884:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:9884:1877942638524032:0@lo:502: 00000100:00100000:3.0:1790945809.870817:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000020:01000000:2.0:1790945809.870837:0:9884:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790945809.870844:0:9884:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1790945809.870850:0:9884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945809.870853:0:9884:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1790945809.870858:0:9884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790945809.870862:0:9884:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.120@tcp to nid 0x20000c0a8cc78 (192.168.204.120@tcp) 00000020:01000000:2.0:1790945809.870882:0:9884:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1790945809.870885:0:9884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790945809.870906:0:9884:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9d3f836cb380) 00000020:00000080:2.0:1790945809.870928:0:9884:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:2.0:1790945809.870937:0:9884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790945809.871005:0:9884:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1790945809.871011:0:9884:0:(osd_handler.c:8931:osd_obd_connect()) connect #7 00000020:00000080:2.0:1790945809.871017:0:9884:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd9f4181e0d27d0dc 00010000:00080000:2.0:1790945809.871052:0:9884:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d3f8340d800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.120@tcp at head 00010000:00010000:2.0:1790945809.871454:0:9884:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:2.0:1790945809.871697:0:9884:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1790945809.871709:0:9884:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1790945809.871887:0:9884:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790945809.872012:0:9884:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790945809.872149:0:9884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1790945809.872279:0:9884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1790945809.873135:0:9885:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790945809.873142:0:9885:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000001:00100000:3.0:1790945809.876743:0:9515:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1790945809.876923:0:8444:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9881:x1877942638522496:12345-0@lo:700: Request processed in 27589us (29676us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945809.876940:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1790945809.877208:0:9881:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f835eb480 x1877942638522496/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790945825 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945809.877224:0:9881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f835eb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9881:1877942638522496:0@lo:700: 00000020:00000080:3.0:1790945809.878081:0:9884:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790945809.878096:0:9884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1790945809.878139:0:9884:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1790945809.878163:0:9884:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd9f4181e0d27d0e3 00000100:00080000:3.0:1790945809.878591:0:9884:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790945809.878820:0:9884:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d3f8340d800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1790945809.878999:0:9884:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f81bd3100 x1877942638524160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790945809.879059:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638524160:0@lo:8: 00000100:00100000:2.0:1790945809.879127:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945809.879315:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638524160 00000100:00100000:1.0:1790945809.879323:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638524160 00000100:00100000:1.0:1790945809.879363:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790945809.879370:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1877942638524160:12345-0@lo:8: 00010000:00080000:1.0:1790945809.879402:0:8435:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 260 last 0 00000020:00000080:1.0:1790945809.879427:0:8435:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd9f4181e0d27d0ea 00002000:00100000:1.0:1790945809.879440:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9d40bfe9c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1790945809.879445:0:8435:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1790945809.879448:0:8435:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1790945809.879532:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1790945809.879554:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9d40bfe9b000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1790945809.879706:0:9884:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1790945809.879788:0:9884:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790945809.879793:0:9884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945809.879796:0:9884:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1790945809.879799:0:9884:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790945809.879803:0:9884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945809.879804:0:9884:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790945809.879808:0:9884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790945809.879810:0:9884:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1790945809.879836:0:9884:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:9884:1877942638524288:0@lo:502: 00000100:00100000:3.0:1790945809.879894:0:9884:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945809.879921:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638524288 00000100:00100000:3.0:1790945809.879926:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638524288 00000100:00100000:3.0:1790945809.879955:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1790945809.879962:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:9884:x1877942638524288:12345-0@lo:502: 00000100:00100000:3.0:1790945809.880052:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:9884:x1877942638524288:12345-0@lo:502: Request processed in 90us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945809.880068:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1790945809.880115:0:9884:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f83588a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790945809.880135:0:9884:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:9884:1877942638524288:0@lo:502: 00000020:01000000:3.0:1790945809.880157:0:9884:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790945809.880161:0:9884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945809.880163:0:9884:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:3.0:1790945809.880441:0:9884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:3.0:1790945809.880493:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:3.0:1790945809.880511:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1790945809.880521:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d600/0xd9f4181e0d27d0c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d0ce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945809.880531:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d600/0xd9f4181e0d27d0c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d0ce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790945809.880541:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1790945809.880544:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9d40af68cd40 from 1 10000000:01000000:3.0:1790945809.880547:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790945809.880647:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27d0f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945809.880656:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27d0f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945809.880665:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27d0f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945809.880678:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638524416:0@lo:101: 00000100:00100000:3.0:1790945809.880706:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945809.880800:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096d19600 going to sleep for 11 seconds 00000100:00100000:0.0:1790945809.880825:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638524416 00000100:00100000:0.0:1790945809.880835:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638524416 00000100:00100000:0.0:1790945809.880864:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1790945809.880871:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:6519:x1877942638524416:12345-0@lo:101: 00010000:00010000:0.0:1790945809.880881:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945809.880894:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d4086a4c800/0xd9f4181e0d27d0f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27d0f1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945809.880914:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d4086a4c800/0xd9f4181e0d27d0f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27d0f1 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945809.880924:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d4086a4c800/0xd9f4181e0d27d0f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d0f1 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945809.880932:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4086a4c800, rc 0) 00000100:00100000:0.0:1790945809.880974:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:6519:x1877942638524416:12345-0@lo:101: Request processed in 103us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945809.880979:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1790945809.881024:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638524416:0@lo:101: 00000100:00100000:1.0:1790945809.881031:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1877942638524160:12345-0@lo:8: Request processed in 1661us (1904us total) trans 0 rc 0/0 00010000:00010000:3.0:1790945809.881036:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27d0f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d0f8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945809.881039:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1790945809.881045:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27d0f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d0f8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945809.881092:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638524544:0@lo:501: 00010000:00080000:2.0:1790945809.881097:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f81bd3100 x1877942638524160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790945819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945809.881106:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790945809.881113:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00100000:3.0:1790945809.881116:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790945809.881119:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1790945809.881123:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1790945809.881127:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d3f8340d800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1790945809.881136:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1790945809.881137:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096d19600 going to sleep for 11 seconds 00000100:00100000:2.0:1790945809.881141:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638524160:0@lo:8: 00000100:00100000:0.0:1790945809.881205:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638524544 00000100:00100000:0.0:1790945809.881210:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638524544 00000100:00100000:0.0:1790945809.881230:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1790945809.881235:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:6519:x1877942638524544:12345-0@lo:501: 00000100:00100000:0.0:1790945809.881302:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:6519:x1877942638524544:12345-0@lo:501: Request processed in 65us (183us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790945809.881309:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000004:00080000:2.0:1790945809.881420:0:9885:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790945809.881476:0:9885:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 260697307602ns, next at 0ns, rc = 0 00080000:00080000:2.0:1790945809.881482:0:9885:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1790945809.882297:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638524544:0@lo:501: 10000000:01000000:1.0:1790945809.882330:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1790945809.882339:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27d0f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d0f8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945809.882349:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27d0f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d0f8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790945809.883153:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1790945809.883317:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790945809.883332:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638524672:0@lo:13: 00000100:00100000:1.0:1790945809.883393:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1790945809.883431:0:9887:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1790945809.883450:0:9887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9887:1877942638524800:0@lo:7: 00000100:00100000:1.0:1790945809.883477:0:9887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945809.883502:0:9887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4084073480 going to sleep for 11 seconds 00000100:00100000:2.0:1790945809.883548:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638524800 00000100:00100000:2.0:1790945809.883555:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638524800 00000100:00100000:3.0:1790945809.883633:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638524672 00000100:00100000:3.0:1790945809.883638:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638524672 00000100:00100000:3.0:1790945809.883680:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790945809.883689:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1877942638524672:12345-0@lo:13: 00000100:00100000:2.0:1790945809.883703:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790945809.883709:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:9887:x1877942638524800:12345-0@lo:7: 00002000:00000024:3.0:1790945809.883715:0:8438:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1790945809.883757:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1877942638524672:12345-0@lo:13: Request processed in 70us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945809.883763:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1790945809.887756:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790945809.888039:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1790945809.888097:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f833f2d80 x1877942638524672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945825 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945809.888122:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638524672:0@lo:13: 00000004:00080000:1.0:1790945809.888801:0:9881:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1790945809.888829:0:9881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9881:1877942638525056:0@lo:7: 00000100:00100000:0.0:1790945809.889103:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638524928:0@lo:13: 00000100:00100000:0.0:1790945809.889158:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945809.889224:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638524928 00000100:00100000:0.0:1790945809.889250:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638524928 00000100:00100000:0.0:1790945809.889292:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790945809.889300:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638524928:12345-0@lo:13: 00002000:00000024:0.0:1790945809.889322:0:8438:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:0.0:1790945809.889364:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638524928:12345-0@lo:13: Request processed in 64us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945809.889371:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1790945809.889407:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f833f2d80 x1877942638524928/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945825 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945809.889421:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638524928:0@lo:13: 00002000:00080000:2.0:1790945809.889545:0:8437:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1790945809.889551:0:8437:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1790945809.889683:0:9881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945809.889712:0:9881:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4084073240 going to sleep for 11 seconds 00000100:00100000:2.0:1790945809.889971:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9887:x1877942638524800:12345-0@lo:7: Request processed in 6260us (6490us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945809.889988:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790945809.890007:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638525056 00000100:00100000:2.0:1790945809.890011:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638525056 00000100:00100000:2.0:1790945809.890041:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790945809.890047:0:8436:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9881:x1877942638525056:12345-0@lo:7: 00010000:00080000:1.0:1790945809.892850:0:9887:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f833f3100 x1877942638524800/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790945825 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945809.892939:0:9887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9887:1877942638524800:0@lo:7: 00000004:00080000:1.0:1790945809.892954:0:9887:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1790945809.892990:0:9887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9887:1877942638525184:0@lo:5: 00000100:00100000:1.0:1790945809.893037:0:9887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945809.893075:0:9887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4084073480 going to sleep for 11 seconds 00000100:00100000:3.0:1790945809.893231:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638525184 00000100:00100000:3.0:1790945809.893250:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638525184 00000100:00100000:3.0:1790945809.893295:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790945809.893303:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9887:x1877942638525184:12345-0@lo:5: 00002000:00080000:3.0:1790945809.893333:0:8435:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1790945809.893337:0:8435:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00002000:00080000:2.0:1790945809.894284:0:8436:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1790945809.894290:0:8436:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1790945809.894406:0:8436:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9881:x1877942638525056:12345-0@lo:7: Request processed in 4357us (4721us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945809.894414:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1790945809.894511:0:9881:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f833f0e00 x1877942638525056/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790945825 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945809.894523:0:9881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9881:1877942638525056:0@lo:7: 00000004:00080000:1.0:1790945809.894534:0:9881:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1790945809.894561:0:9881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9881:1877942638525312:0@lo:5: 00000100:00100000:1.0:1790945809.894661:0:9881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945809.894719:0:9881:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4084073240 going to sleep for 11 seconds 00000100:00100000:2.0:1790945809.894819:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638525312 00000100:00100000:2.0:1790945809.894824:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638525312 00000100:00100000:2.0:1790945809.894951:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790945809.894959:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9881:x1877942638525312:12345-0@lo:5: 00002000:00080000:2.0:1790945809.894979:0:8437:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1790945809.895009:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9881:x1877942638525312:12345-0@lo:5: Request processed in 52us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945809.895015:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1790945809.895036:0:9881:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f833f0e00 x1877942638525312/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790945825 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945809.895044:0:9881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9881:1877942638525312:0@lo:5: 00000004:00080000:2.0:1790945809.895052:0:9881:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1790945809.895072:0:9881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f835e8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9881:1877942638525440:0@lo:5: 00000100:00100000:2.0:1790945809.895092:0:9881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945809.895146:0:9881:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bcbcdd80 going to sleep for 11 seconds 00000100:00100000:1.0:1790945809.895473:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638525440 00000100:00100000:1.0:1790945809.895485:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638525440 00000100:00100000:1.0:1790945809.895506:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790945809.895511:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9881:x1877942638525440:12345-0@lo:5: 00002000:00080000:1.0:1790945809.895533:0:8916:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:1.0:1790945809.898724:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:9881:x1877942638525440:12345-0@lo:5: Request processed in 3204us (3623us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1790945809.898739:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1790945809.899846:0:9881:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f835e8a80 x1877942638525440/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790945825 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945809.899946:0:9881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f835e8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9881:1877942638525440:0@lo:5: 00000004:00080000:0.0:1790945809.899962:0:9881:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1790945809.900005:0:9881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9881:1877942638525568:0@lo:900: 00000100:00100000:0.0:1790945809.900056:0:9881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945809.900093:0:9881:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f825a9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790945809.900160:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638525568 00000100:00100000:2.0:1790945809.900214:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638525568 00000100:00100000:2.0:1790945809.900267:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790945809.900276:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9881:x1877942638525568:12345-0@lo:900: 00000100:00100000:2.0:1790945809.900339:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9881:x1877942638525568:12345-0@lo:900: Request processed in 63us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945809.900345:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790945809.900426:0:9881:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcbc0380 x1877942638525568/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790945825 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945809.900436:0:9881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9881:1877942638525568:0@lo:900: 00000001:00080000:0.0:1790945809.907963:0:9515:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:0.0:1790945809.907981:0:9515:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1790945809.907992:0:9515:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1790945809.908125:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9887:x1877942638525184:12345-0@lo:5: Request processed in 14818us (15083us total) trans 4294967297 rc 0/0 00010000:00080000:1.0:1790945809.908144:0:9887:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f833f3100 x1877942638525184/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790945825 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945809.908144:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790945809.908155:0:9887:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1790945809.908161:0:9887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9887:1877942638525184:0@lo:5: 00000004:00080000:1.0:1790945809.908193:0:9887:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1790945809.908245:0:9887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9887:1877942638525696:0@lo:700: 00000100:00100000:1.0:1790945809.908278:0:9887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945809.908326:0:9887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4084073480 going to sleep for 11 seconds 00000100:00100000:0.0:1790945809.908750:0:8443:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638525696 00000100:00100000:0.0:1790945809.908758:0:8443:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638525696 00000100:00100000:0.0:1790945809.908800:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790945809.908808:0:8443:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9887:x1877942638525696:12345-0@lo:700: 00000100:00100000:3.0:1790945809.921825:0:8443:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9887:x1877942638525696:12345-0@lo:700: Request processed in 13008us (13537us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945809.921840:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1790945809.922000:0:9887:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f833f3100 x1877942638525696/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790945825 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945809.922015:0:9887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9887:1877942638525696:0@lo:700: 00000004:02000040:1.0:1790945809.927693:0:9887:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:1.0:1790945809.931094:0:9887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9887:1877942638525824:0@lo:5: 00000100:00100000:1.0:1790945809.931163:0:9887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945809.931229:0:9887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4084073480 going to sleep for 11 seconds 00000100:00100000:2.0:1790945809.932647:0:8436:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638525824 00000100:00100000:2.0:1790945809.932668:0:8436:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638525824 00000100:00100000:2.0:1790945809.932765:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790945809.932779:0:8436:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9887:x1877942638525824:12345-0@lo:5: 00002000:00080000:1.0:1790945809.941873:0:8436:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1790945809.941893:0:8436:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:1.0:1790945809.945391:0:8436:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9887:x1877942638525824:12345-0@lo:5: Request processed in 12607us (14219us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1790945809.945424:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1790945809.947682:0:9887:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f833f3100 x1877942638525824/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790945825 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945809.947705:0:9887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9887:1877942638525824:0@lo:5: 00000004:00080000:1.0:1790945809.947723:0:9887:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000020:00000004:3.0:1790945810.723432:0:9937:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790945810.724019:0:9937:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1790945810.916356:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790945811.466765:0:9515:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:0.0:1790945811.939131:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945812.319490:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790945812.319515:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638526080:0@lo:13: 00000100:00100000:2.0:1790945812.319599:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945812.320031:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638526080 00000100:00100000:0.0:1790945812.320042:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638526080 00000100:00100000:0.0:1790945812.320106:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790945812.320117:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638526080:12345-0@lo:13: 00002000:00000024:0.0:1790945812.320146:0:8438:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790945812.320218:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638526080:12345-0@lo:13: Request processed in 103us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945812.320225:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1790945812.320324:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790945812.320353:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcbc0380 x1877942638526080/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945828 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945812.320371:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638526080:0@lo:13: 00000100:00100000:1.0:1790945812.320614:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f835ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638525952:0@lo:13: 00000100:00100000:1.0:1790945812.320654:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945812.320977:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638525952 00000100:00100000:0.0:1790945812.320983:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638525952 00000100:00100000:0.0:1790945812.321033:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790945812.321041:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638525952:12345-0@lo:13: 00002000:00000024:0.0:1790945812.321057:0:8438:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790945812.321100:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638525952:12345-0@lo:13: Request processed in 60us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945812.321107:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1790945812.321537:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790945812.321615:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f835ead80 x1877942638525952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945828 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945812.321633:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f835ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638525952:0@lo:13: 00010000:00010000:0.0:1790945812.959429:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1790945813.376997:0:10039:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790945813.377423:0:10039:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1790945813.855500:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790945813.855537:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638526208:0@lo:41: 00000100:00100000:3.0:1790945813.855608:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945813.855854:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638526208 00000100:00100000:1.0:1790945813.855863:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638526208 00000100:00100000:1.0:1790945813.855921:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790945813.855930:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638526208:12345-0@lo:41: 00000004:00000024:1.0:1790945813.855963:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1790945813.856029:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638526208:12345-0@lo:41: Request processed in 100us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945813.856037:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790945813.856306:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638526208:0@lo:41: 00010000:00010000:2.0:1790945813.985039:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1790945814.315939:0:10087:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790945814.315949:0:10087:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:3.0:1790945814.367516:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790945814.367541:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638526336:0@lo:41: 00000100:00100000:3.0:1790945814.367722:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945814.367791:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638526336 00000100:00100000:3.0:1790945814.367800:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638526336 00000100:00100000:3.0:1790945814.367851:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790945814.367861:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638526336:12345-0@lo:41: 00000004:00000024:3.0:1790945814.367895:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790945814.367939:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638526336:12345-0@lo:41: Request processed in 80us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945814.367946:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790945814.367990:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638526336:0@lo:41: 00000100:00100000:3.0:1790945814.829907:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945814.829995:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616457344 00000100:00100000:0.0:1790945814.830007:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616457344 00000100:00100000:0.0:1790945814.830057:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 179 00000100:00100000:0.0:1790945814.830065:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2400:x1877942616457344:12345-192.168.204.20@tcp:250: 00010000:00080000:0.0:1790945814.830095:0:6516:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 021de7e3-4377-4cbc-9af0-2b26e9ce67a1@192.168.204.20@tcp t0 exp 0000000000000000 cur 265 last 0 00000020:00000080:0.0:1790945814.830125:0:6516:0:(genops.c:1384:class_connect()) connect: client 021de7e3-4377-4cbc-9af0-2b26e9ce67a1, cookie 0xd9f4181e0d27d0ff 00000100:00080000:0.0:1790945814.830321:0:6516:0:(import.c:65:import_set_state_nolock()) ffff9d40bff15800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790945814.830389:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+5:2400:x1877942616457344:12345-192.168.204.20@tcp:250: Request processed in 323us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945814.830398:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 179 00000100:00100000:1.0:1790945814.843258:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945814.843388:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616457472 00000100:00100000:3.0:1790945814.843398:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616457472 00000100:00100000:3.0:1790945814.843444:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 180 00000100:00100000:3.0:1790945814.843454:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+5:6159:x1877942616457472:12345-192.168.204.20@tcp:101: 00010000:00010000:3.0:1790945814.843486:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945814.843513:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40baef1800/0xd9f4181e0d27d106 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330992 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945814.843543:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40baef1800/0xd9f4181e0d27d106 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330992 expref: 6 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945814.843555:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40baef1800/0xd9f4181e0d27d106 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330992 expref: 6 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945814.843564:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40baef1800, rc 0) 00000100:00100000:3.0:1790945814.843628:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+6:6159:x1877942616457472:12345-192.168.204.20@tcp:101: Request processed in 174us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945814.843635:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 180 00000100:00100000:3.0:1790945814.855274:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945814.863100:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616457600 00000100:00100000:1.0:1790945814.864265:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616457600 00000100:00100000:0.0:1790945814.864491:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 181 00000100:00100000:0.0:1790945814.864513:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+6:6159:x1877942616457600:12345-192.168.204.20@tcp:501: 00000100:00100000:0.0:1790945814.864697:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+6:6159:x1877942616457600:12345-192.168.204.20@tcp:501: Request processed in 185us (9430us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790945814.864706:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 181 00000100:00100000:2.0:1790945814.871005:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945814.871667:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616457728 00000100:00100000:0.0:1790945814.871678:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616457728 00000100:00100000:0.0:1790945814.871742:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 182 00000100:00100000:0.0:1790945814.871751:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+6:6159:x1877942616457728:12345-192.168.204.20@tcp:101: 00010000:00010000:0.0:1790945814.871767:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945814.871784:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d4086a4c400/0xd9f4181e0d27d10d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330999 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945814.871810:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d4086a4c400/0xd9f4181e0d27d10d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330999 expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945814.871947:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d4086a4c400/0xd9f4181e0d27d10d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330999 expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945814.871971:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4086a4c400, rc 0) 00000100:00100000:0.0:1790945814.872033:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+7:6159:x1877942616457728:12345-192.168.204.20@tcp:101: Request processed in 283us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945814.872040:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 182 00000100:00100000:2.0:1790945814.882095:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945814.882237:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616457856 00000100:00100000:3.0:1790945814.882247:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616457856 00000100:00100000:3.0:1790945814.882302:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 183 00000100:00100000:3.0:1790945814.882312:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+7:6159:x1877942616457856:12345-192.168.204.20@tcp:501: 00000100:00100000:3.0:1790945814.882478:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+8:6159:x1877942616457856:12345-192.168.204.20@tcp:501: Request processed in 167us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945814.882487:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 183 00000100:00100000:2.0:1790945814.891595:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945814.891875:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616457984 00000100:00100000:0.0:1790945814.891887:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616457984 00000100:00100000:0.0:1790945814.891950:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 184 00000100:00100000:0.0:1790945814.891961:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408397d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+8:6159:x1877942616457984:12345-192.168.204.20@tcp:503: 00000100:00100000:0.0:1790945814.892123:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408397d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+8:6159:x1877942616457984:12345-192.168.204.20@tcp:503: Request processed in 163us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945814.892131:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 184 00000100:00100000:2.0:1790945814.908907:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945814.909026:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616458112 00000100:00100000:0.0:1790945814.909036:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616458112 00000100:00100000:0.0:1790945814.909098:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 185 00000100:00100000:0.0:1790945814.909109:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408397fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+8:6178:x1877942616458112:12345-192.168.204.20@tcp:502: 00000100:00100000:0.0:1790945814.909321:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408397fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+8:6178:x1877942616458112:12345-192.168.204.20@tcp:502: Request processed in 213us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945814.909329:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 185 00000100:00100000:2.0:1790945814.964605:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945814.964763:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616458240 00000100:00100000:3.0:1790945814.964773:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616458240 00000100:00100000:3.0:1790945814.964826:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 186 00000100:00100000:3.0:1790945814.964836:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408397e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+8:6178:x1877942616458240:12345-192.168.204.20@tcp:502: 00000100:00100000:3.0:1790945814.965002:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408397e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+8:6178:x1877942616458240:12345-192.168.204.20@tcp:502: Request processed in 166us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945814.965017:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 186 00000100:00100000:3.0:1790945814.976573:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945814.976926:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616458368 00000100:00100000:2.0:1790945814.976936:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616458368 00000100:00100000:2.0:1790945814.976984:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 187 00000100:00100000:2.0:1790945814.976994:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a72fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+8:6159:x1877942616458368:12345-192.168.204.20@tcp:101: 00010000:00010000:2.0:1790945814.977022:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945814.977040:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d4080031600/0xd9f4181e0d27d114 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xccf0c8c2223309ca expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945814.977082:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d4080031600/0xd9f4181e0d27d114 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223309ca expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945814.977094:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d4080031600/0xd9f4181e0d27d114 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223309ca expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945814.977103:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4080031600, rc 0) 00000100:00100000:2.0:1790945814.977215:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a72fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+9:6159:x1877942616458368:12345-192.168.204.20@tcp:101: Request processed in 222us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945814.977223:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 187 00000100:00100000:2.0:1790945814.983757:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945814.983914:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616458496 00000100:00100000:0.0:1790945814.983924:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616458496 00000100:00100000:0.0:1790945814.983984:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 188 00000100:00100000:0.0:1790945814.983993:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a72fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+9:6159:x1877942616458496:12345-192.168.204.20@tcp:256: 20000000:01000000:0.0:1790945814.984020:0:6514:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1790945814.984056:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1790945814.984060:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1790945814.984068:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1790945814.984070:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1790945814.984073:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1790945814.986743:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a72fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+9:6159:x1877942616458496:12345-192.168.204.20@tcp:256: Request processed in 2740us (2985us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945814.986758:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 188 00000100:00100000:3.0:1790945814.990004:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945814.995774:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616458624 00000100:00100000:1.0:1790945814.995791:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616458624 00000100:00100000:1.0:1790945814.996278:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 189 00000100:00100000:1.0:1790945814.996362:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a71e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+9:6159:x1877942616458624:12345-192.168.204.20@tcp:101: 00010000:00010000:1.0:1790945814.996380:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945814.996399:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40c21d7c00/0xd9f4181e0d27d11b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xccf0c8c2223309d1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945814.996451:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40c21d7c00/0xd9f4181e0d27d11b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223309d1 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945814.996462:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40c21d7c00/0xd9f4181e0d27d11b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223309d1 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945814.996472:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40c21d7c00, rc 0) 00000100:00100000:1.0:1790945814.997009:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a71e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:6159:x1877942616458624:12345-192.168.204.20@tcp:101: Request processed in 719us (7010us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945814.997017:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 189 00000100:00100000:2.0:1790945815.006317:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945815.006523:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616458752 00000100:00100000:0.0:1790945815.006534:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616458752 00000100:00100000:0.0:1790945815.006603:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 190 00000100:00100000:0.0:1790945815.006613:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a71e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:6159:x1877942616458752:12345-192.168.204.20@tcp:501: 00000100:00100000:0.0:1790945815.006780:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a71e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:6159:x1877942616458752:12345-192.168.204.20@tcp:501: Request processed in 168us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945815.006789:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 190 00010000:00010000:0.0:1790945815.007407:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945815.009120:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945815.009235:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616458880 00000100:00100000:2.0:1790945815.009245:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616458880 00000100:00100000:2.0:1790945815.009371:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 191 00000100:00100000:2.0:1790945815.009382:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a71e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:6159:x1877942616458880:12345-192.168.204.20@tcp:503: 00000100:00100000:2.0:1790945815.009603:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a71e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:6159:x1877942616458880:12345-192.168.204.20@tcp:503: Request processed in 222us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945815.009611:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 191 00000100:00100000:3.0:1790945815.029593:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945815.030028:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616459008 00000100:00100000:1.0:1790945815.030039:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616459008 00000100:00100000:1.0:1790945815.030100:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 192 00000100:00100000:1.0:1790945815.030110:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087036850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:6183:x1877942616459008:12345-192.168.204.20@tcp:502: 00000100:00100000:1.0:1790945815.030382:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087036850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:6183:x1877942616459008:12345-192.168.204.20@tcp:502: Request processed in 273us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945815.030397:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 192 00000100:00100000:3.0:1790945815.045418:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945815.045740:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616459136 00000100:00100000:0.0:1790945815.045754:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616459136 00000100:00100000:0.0:1790945815.045831:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 193 00000100:00100000:0.0:1790945815.045841:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087035050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:6183:x1877942616459136:12345-192.168.204.20@tcp:502: 00000100:00100000:0.0:1790945815.046011:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087035050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:6183:x1877942616459136:12345-192.168.204.20@tcp:502: Request processed in 171us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945815.046018:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 193 00000100:00100000:3.0:1790945815.059556:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945815.059602:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945815.059736:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616459264 00000100:00100000:1.0:1790945815.059747:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616459264 00000100:00100000:1.0:1790945815.059797:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616459520 00000100:00100000:1.0:1790945815.059800:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616459520 00000100:00100000:1.0:1790945815.059837:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:1.0:1790945815.059846:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2400:x1877942616459264:12345-192.168.204.20@tcp:38: 00010000:00080000:1.0:1790945815.059876:0:6521:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 0cadc7a5-c0ba-4320-984f-d871ffb3a3ef@192.168.204.20@tcp t0 exp 0000000000000000 cur 265 last 0 00000100:00100000:3.0:1790945815.059881:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 8 00000100:00100000:3.0:1790945815.059889:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2400:x1877942616459520:12345-192.168.204.20@tcp:38: 00010000:00080000:3.0:1790945815.059908:0:6523:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 0cadc7a5-c0ba-4320-984f-d871ffb3a3ef@192.168.204.20@tcp t0 exp 0000000000000000 cur 265 last 0 00000020:00000080:3.0:1790945815.059953:0:6523:0:(genops.c:1384:class_connect()) connect: client 0cadc7a5-c0ba-4320-984f-d871ffb3a3ef, cookie 0xd9f4181e0d27d129 00000020:00000080:1.0:1790945815.059958:0:6521:0:(genops.c:1384:class_connect()) connect: client 0cadc7a5-c0ba-4320-984f-d871ffb3a3ef, cookie 0xd9f4181e0d27d122 00000004:00100000:3.0:1790945815.059980:0:6523:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000004:00100000:1.0:1790945815.059980:0:6521:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1790945815.060342:0:6523:0:(import.c:65:import_set_state_nolock()) ffff9d40bff08800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1790945815.060350:0:6521:0:(import.c:65:import_set_state_nolock()) ffff9d40bfe98800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790945815.060414:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2400:x1877942616459520:12345-192.168.204.20@tcp:38: Request processed in 523us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945815.060421:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 8 00000100:00100000:1.0:1790945815.060724:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2400:x1877942616459264:12345-192.168.204.20@tcp:38: Request processed in 876us (1176us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945815.060732:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:0.0:1790945815.391605:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4cef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638526464:0@lo:13: 00000100:00100000:0.0:1790945815.391976:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945815.391982:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4ceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638526592:0@lo:13: 00000100:00100000:3.0:1790945815.392023:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945815.392072:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638526464 00000100:00100000:3.0:1790945815.392081:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638526464 00000100:00100000:3.0:1790945815.392143:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638526592 00000100:00100000:3.0:1790945815.392146:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638526592 00000100:00100000:3.0:1790945815.392161:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790945815.392208:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638526464:12345-0@lo:13: 00002000:00000024:3.0:1790945815.392240:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790945815.392296:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638526464:12345-0@lo:13: Request processed in 128us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945815.392303:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790945815.392323:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790945815.392329:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638526592:12345-0@lo:13: 00002000:00000024:3.0:1790945815.392339:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790945815.392365:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638526592:12345-0@lo:13: Request processed in 36us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945815.392370:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1790945815.392401:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40b4ceea00 x1877942638526592/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945831 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945815.392411:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1790945815.392433:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4ceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638526592:0@lo:13: 00000100:00100000:3.0:1790945815.392942:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4ceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638527104:0@lo:400: 00000100:00100000:3.0:1790945815.392979:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945815.393013:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638527616:0@lo:400: 00000100:00100000:3.0:1790945815.393037:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945815.393054:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1790945815.393060:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4ced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638526720:0@lo:400: 00000100:00100000:3.0:1790945815.393086:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945815.393106:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638527232:0@lo:400: 00000100:00100000:3.0:1790945815.393133:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945815.393150:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638527744:0@lo:400: 00000100:00080000:0.0:1790945815.393164:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790945815.393197:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945815.393211:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4cec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638526976:0@lo:400: 00000100:00100000:3.0:1790945815.393230:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638527232 00000100:00100000:3.0:1790945815.393243:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638527232 00000100:00100000:0.0:1790945815.393245:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945815.393271:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1877942638527488:0@lo:400: 00000100:00100000:3.0:1790945815.393277:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638526976 00000100:00100000:0.0:1790945815.393305:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945815.393324:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1877942638528000:0@lo:400: 00000100:00100000:0.0:1790945815.393347:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945815.393354:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638526976 00010000:00080000:0.0:1790945815.393376:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40b4cef800 x1877942638526464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945831 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945815.393378:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790945815.393389:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1790945815.393390:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408aa8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638527232:12345-0@lo:400: 00000100:00100000:0.0:1790945815.393413:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4cef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638526464:0@lo:13: 00000100:00100000:0.0:1790945815.393428:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1790945815.393435:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4ceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877942638526848:0@lo:400: 00000100:00100000:3.0:1790945815.393444:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408aa8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638527232:12345-0@lo:400: Request processed in 55us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945815.393451:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790945815.393467:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790945815.393474:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638526976:12345-0@lo:400: 00000100:00100000:0.0:1790945815.393481:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945815.393515:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1877942638527360:0@lo:400: 00000100:00100000:3.0:1790945815.393525:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638526976:12345-0@lo:400: Request processed in 51us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945815.393533:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790945815.393543:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945815.393558:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1877942638527872:0@lo:400: 00000100:00100000:3.0:1790945815.393569:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638527232:0@lo:400: 00000100:00100000:0.0:1790945815.393597:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945815.393619:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4cec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638526976:0@lo:400: 00000100:00100000:0.0:1790945815.393640:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638527104 00000100:00100000:0.0:1790945815.393644:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638527104 00000100:00100000:0.0:1790945815.393664:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638527488 00000100:00100000:0.0:1790945815.393667:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638527488 00000100:00100000:0.0:1790945815.393685:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638528000 00000100:00100000:0.0:1790945815.393687:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638528000 00000100:00100000:0.0:1790945815.393698:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638526848 00000100:00100000:0.0:1790945815.393700:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638526848 00000100:00100000:0.0:1790945815.393708:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638527360 00000100:00100000:0.0:1790945815.393710:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638527360 00000100:00100000:0.0:1790945815.393721:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638527872 00000100:00100000:0.0:1790945815.393723:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638527872 00000100:00100000:0.0:1790945815.393746:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790945815.393753:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638527104:12345-0@lo:400: 00000100:00100000:2.0:1790945815.393780:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638526720 00000100:00100000:2.0:1790945815.393786:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638526720 00000100:00100000:0.0:1790945815.393797:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638527104:12345-0@lo:400: Request processed in 44us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945815.393815:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790945815.393834:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1790945815.393838:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790945815.393846:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087037850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3649:x1877942638526720:12345-0@lo:400: 00000100:00100000:0.0:1790945815.393850:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1877942638527488:12345-0@lo:400: 00000100:00100000:0.0:1790945815.393898:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1877942638527488:12345-0@lo:400: Request processed in 43us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945815.393906:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087037850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3649:x1877942638526720:12345-0@lo:400: Request processed in 62us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945815.393908:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790945815.393919:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1790945815.393928:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790945815.393937:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1877942638528000:12345-0@lo:400: 00000100:00100000:2.0:1790945815.393968:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790945815.393973:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1877942638528000:12345-0@lo:400: Request processed in 37us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945815.393981:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4cef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1877942638526848:12345-0@lo:400: 00000100:00100000:0.0:1790945815.393983:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790945815.394003:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790945815.394012:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1877942638527360:12345-0@lo:400: 00000100:00100000:2.0:1790945815.394019:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4cef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1877942638526848:12345-0@lo:400: Request processed in 42us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945815.394026:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790945815.394043:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790945815.394051:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1877942638527360:12345-0@lo:400: Request processed in 41us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945815.394052:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1877942638527872:12345-0@lo:400: 00000100:00100000:0.0:1790945815.394066:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1790945815.394088:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790945815.394092:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1877942638527872:12345-0@lo:400: Request processed in 41us (494us total) trans 0 rc 0/0 00000100:00080000:0.0:1790945815.394093:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790945815.394102:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790945815.394117:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4ced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638526720:0@lo:400: 00010000:00080000:0.0:1790945815.394133:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40b4ceea00 x1877942638527104/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945815.394142:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4ceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638527104:0@lo:400: 00010000:00080000:0.0:1790945815.394197:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40b4ceca80 x1877942638526848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945815.394206:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4ceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877942638526848:0@lo:400: 00010000:00080000:0.0:1790945815.394216:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcbbf100 x1877942638527360/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945815.394222:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1877942638527360:0@lo:400: 00010000:00080000:0.0:1790945815.394231:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcbbf800 x1877942638527872/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945815.394238:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1877942638527872:0@lo:400: 00010000:00080000:0.0:1790945815.394247:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcbbe300 x1877942638527488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945815.394255:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1877942638527488:0@lo:400: 00010000:00080000:0.0:1790945815.394266:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcbbce00 x1877942638528000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945815.394271:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638527616 00000100:00100000:0.0:1790945815.394274:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1877942638528000:0@lo:400: 00000100:00100000:1.0:1790945815.394278:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638527616 00000100:00100000:0.0:1790945815.394375:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638527744 00000100:00100000:0.0:1790945815.394380:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638527744 00000100:00100000:0.0:1790945815.394401:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790945815.394407:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638527616:12345-0@lo:400: 00000100:00100000:0.0:1790945815.394446:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638527616:12345-0@lo:400: Request processed in 38us (1408us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945815.394452:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1790945815.394500:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790945815.394562:0:8435:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1790945815.394572:0:8435:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1790945815.394598:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1790945815.394631:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcbbe680 x1877942638527616/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945815.394646:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638527616:0@lo:400: 00000100:00100000:1.0:1790945815.394736:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408aa8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638527744:12345-0@lo:400: 00000100:00100000:0.0:1790945815.394999:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408aa8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638527744:12345-0@lo:400: Request processed in 538us (1803us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945815.395006:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1790945815.395396:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcbbc380 x1877942638527744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945815.395407:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638527744:0@lo:400: 00010000:00010000:2.0:1790945816.031406:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945816.075378:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945816.075449:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945816.075526:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616459648 00000100:00100000:1.0:1790945816.075538:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616459648 00000100:00100000:2.0:1790945816.075556:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00080000:2.0:1790945816.075583:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790945816.075598:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616459776 00000100:00100000:1.0:1790945816.075611:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616459392 00000100:00100000:1.0:1790945816.075615:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616459392 00000100:00100000:2.0:1790945816.075618:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616459776 00000100:00100000:1.0:1790945816.075647:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:2.0:1790945816.075655:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:1.0:1790945816.075661:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:0:x1877942616459648:12345-192.168.204.20@tcp:41: 00000100:00100000:2.0:1790945816.075669:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:0:x1877942616459392:12345-192.168.204.20@tcp:41: 00000004:00000024:1.0:1790945816.075702:0:6522:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000004:00000024:2.0:1790945816.075703:0:6521:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1790945816.075784:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:0:x1877942616459648:12345-192.168.204.20@tcp:41: Request processed in 128us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945816.075792:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:1.0:1790945816.075813:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:1.0:1790945816.075828:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:6159:x1877942616459776:12345-192.168.204.20@tcp:41: 00000004:00000024:1.0:1790945816.075839:0:6522:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00080000:0.0:1790945816.077367:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790945816.077487:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:0:x1877942616459392:12345-192.168.204.20@tcp:41: Request processed in 1799us (1909us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945816.077516:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:1.0:1790945816.078758:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:6159:x1877942616459776:12345-192.168.204.20@tcp:41: Request processed in 2924us (3302us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945816.078785:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:0.0:1790945816.082413:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945816.082781:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616459904 00000100:00100000:1.0:1790945816.082791:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616459904 00000100:00100000:1.0:1790945816.082889:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:1.0:1790945816.082900:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40accd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:6159:x1877942616459904:12345-192.168.204.20@tcp:40: 00000100:00100000:1.0:1790945816.082992:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40accd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:6159:x1877942616459904:12345-192.168.204.20@tcp:40: Request processed in 94us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945816.082999:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:3.0:1790945816.086010:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945816.086077:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945816.086230:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616460416 00000100:00100000:2.0:1790945816.086240:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616460416 00000100:00100000:2.0:1790945816.086293:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 195 00000100:00100000:2.0:1790945816.086302:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087036450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:2402:x1877942616460416:12345-192.168.204.20@tcp:400: 00000100:00100000:2.0:1790945816.086373:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087036450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:2402:x1877942616460416:12345-192.168.204.20@tcp:400: Request processed in 71us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945816.086381:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 195 00000100:00100000:1.0:1790945816.086995:0:6533:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616460288 00000100:00100000:1.0:1790945816.087002:0:6533:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616460288 00000100:00100000:1.0:1790945816.087046:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4 00000100:00100000:1.0:1790945816.087053:0:6533:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408aa8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:6159:x1877942616460288:12345-192.168.204.20@tcp:900: 00000100:00100000:1.0:1790945816.087106:0:6533:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408aa8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:6159:x1877942616460288:12345-192.168.204.20@tcp:900: Request processed in 52us (1105us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945816.087574:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4 00000100:00100000:3.0:1790945816.088365:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945816.088407:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945816.089066:0:8436:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616460032 00000100:00100000:2.0:1790945816.089075:0:8436:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616460032 00000100:00100000:2.0:1790945816.089121:0:8436:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616460160 00000100:00100000:2.0:1790945816.089124:0:8436:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616460160 00000100:00100000:2.0:1790945816.089156:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:2.0:1790945816.089162:0:8436:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408aa8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2400:x1877942616460032:12345-192.168.204.20@tcp:8: 00010000:00080000:2.0:1790945816.089229:0:8436:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 0cadc7a5-c0ba-4320-984f-d871ffb3a3ef@192.168.204.20@tcp t0 exp 0000000000000000 cur 266 last 0 00000020:00000080:2.0:1790945816.089259:0:8436:0:(genops.c:1384:class_connect()) connect: client 0cadc7a5-c0ba-4320-984f-d871ffb3a3ef, cookie 0xd9f4181e0d27d130 00002000:00100000:2.0:1790945816.089269:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0cadc7a5-c0ba-4320-984f-d871ffb3a3ef/ffff9d3f83705800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790945816.089286:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790945816.089461:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790945816.089512:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9d3f83704800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790945816.089571:0:8436:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408aa8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2400:x1877942616460032:12345-192.168.204.20@tcp:8: Request processed in 407us (1209us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945816.089579:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:2.0:1790945816.089949:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:2.0:1790945816.089957:0:8436:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4ceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2400:x1877942616460160:12345-192.168.204.20@tcp:8: 00010000:00080000:2.0:1790945816.090004:0:8436:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 0cadc7a5-c0ba-4320-984f-d871ffb3a3ef@192.168.204.20@tcp t0 exp 0000000000000000 cur 266 last 0 00000020:00000080:2.0:1790945816.090021:0:8436:0:(genops.c:1384:class_connect()) connect: client 0cadc7a5-c0ba-4320-984f-d871ffb3a3ef, cookie 0xd9f4181e0d27d137 00002000:00100000:2.0:1790945816.090027:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0cadc7a5-c0ba-4320-984f-d871ffb3a3ef/ffff9d3f83700000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790945816.090034:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790945816.090191:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790945816.090210:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9d3f83702800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790945816.090257:0:8436:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4ceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2400:x1877942616460160:12345-192.168.204.20@tcp:8: Request processed in 299us (1848us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945816.094779:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:2.0:1790945816.095793:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945816.098330:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616460544 00000100:00100000:0.0:1790945816.098344:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616460544 00000100:00100000:0.0:1790945816.098440:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:0.0:1790945816.098451:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:6159:x1877942616460544:12345-192.168.204.20@tcp:33: 00000004:00080000:1.0:1790945816.128876:0:6524:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 30320us 00000004:00200000:0.0:1790945816.150764:0:6524:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1790945816.150881:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:6159:x1877942616460544:12345-192.168.204.20@tcp:33: Request processed in 52427us (55085us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945816.150892:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:3.0:1790945816.344817:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945816.344935:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616460672 00000100:00100000:2.0:1790945816.344946:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616460672 00000100:00100000:2.0:1790945816.345031:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:2.0:1790945816.345041:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4ceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:6201:x1877942616460672:12345-192.168.204.20@tcp:101: 00010000:00010000:2.0:1790945816.345060:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945816.345141:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030400/0xd9f4181e0d27d13e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330a02 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945816.345254:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d145 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945816.345269:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d145 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945816.345284:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d145 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945816.345331:0:6521:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790945816.345347:0:6521:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790945816.345366:0:6521:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d145 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945816.345392:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030400/0xd9f4181e0d27d13e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a02 expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945816.345409:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d145 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a02 expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945816.345418:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3f824ef100) 00010000:00010000:2.0:1790945816.345421:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790945816.345424:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4080031800, rc 0) 00000100:00100000:2.0:1790945816.345502:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4ceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:6201:x1877942616460672:12345-192.168.204.20@tcp:101: Request processed in 462us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945816.345509:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 13 00010000:00010000:0.0:1790945817.055374:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945817.439464:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790945817.439500:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40accd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638528128:0@lo:13: 00000100:00100000:2.0:1790945817.439581:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945817.439895:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638528128 00000100:00100000:3.0:1790945817.439905:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638528128 00000100:00100000:3.0:1790945817.439974:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790945817.439984:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638528128:12345-0@lo:13: 00002000:00000024:3.0:1790945817.440013:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790945817.440062:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638528128:12345-0@lo:13: Request processed in 81us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945817.440086:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1790945817.440129:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40accd2680 x1877942638528128/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945833 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945817.440147:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40accd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638528128:0@lo:13: 00000100:00080000:0.0:1790945817.440290:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790945817.440406:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f835e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638528256:0@lo:13: 00000100:00100000:3.0:1790945817.440435:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945817.446924:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638528256 00000100:00100000:2.0:1790945817.446941:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638528256 00000100:00080000:0.0:1790945817.447081:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790945817.447116:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790945817.447128:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4ced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638528256:12345-0@lo:13: 00002000:00000024:2.0:1790945817.447155:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790945817.447282:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4ced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638528256:12345-0@lo:13: Request processed in 156us (6844us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945817.447289:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1790945817.447374:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f835e8a80 x1877942638528256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945833 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945817.447396:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f835e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638528256:0@lo:13: 00010000:00010000:2.0:1790945818.079422:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945818.570556:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945818.570666:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616460800 00000100:00100000:0.0:1790945818.570676:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616460800 00000100:00100000:0.0:1790945818.570756:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 14 00000100:00100000:0.0:1790945818.570766:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:6254:x1877942616460800:12345-192.168.204.20@tcp:41: 00000004:00000024:0.0:1790945818.570804:0:6523:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1790945818.570879:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:6254:x1877942616460800:12345-192.168.204.20@tcp:41: Request processed in 114us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945818.570887:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 14 00000100:00080000:2.0:1790945818.570959:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790945818.573007:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945818.573220:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616460928 00000100:00100000:2.0:1790945818.573230:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616460928 00000100:00080000:0.0:1790945818.573296:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790945818.573329:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15 00000100:00100000:2.0:1790945818.573339:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40accd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:6254:x1877942616460928:12345-192.168.204.20@tcp:41: 00000004:00000024:2.0:1790945818.573373:0:6521:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790945818.573443:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40accd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:6254:x1877942616460928:12345-192.168.204.20@tcp:41: Request processed in 105us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945818.573450:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15 00000100:00100000:3.0:1790945818.590844:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945818.590984:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616461056 00000100:00100000:1.0:1790945818.590994:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616461056 00000100:00100000:1.0:1790945818.591122:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:1.0:1790945818.591133:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4cec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:6254:x1877942616461056:12345-192.168.204.20@tcp:13: 00002000:00000024:1.0:1790945818.591159:0:8438:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790945818.591261:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4cec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:6254:x1877942616461056:12345-192.168.204.20@tcp:13: Request processed in 130us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945818.591269:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00080000:0.0:1790945818.591875:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790945818.595980:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945818.596081:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616461184 00000100:00100000:1.0:1790945818.596106:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616461184 00000100:00100000:1.0:1790945818.596203:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:1.0:1790945818.596214:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40accd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:6254:x1877942616461184:12345-192.168.204.20@tcp:13: 00002000:00000024:1.0:1790945818.596245:0:8438:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1790945818.596388:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790945818.596549:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40accd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:6254:x1877942616461184:12345-192.168.204.20@tcp:13: Request processed in 336us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945818.596557:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:0.0:1790945818.975529:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790945818.975556:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638528384:0@lo:41: 00000100:00100000:0.0:1790945818.975627:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945818.975850:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638528384 00000100:00100000:3.0:1790945818.975858:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638528384 00000100:00100000:3.0:1790945818.975916:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790945818.975925:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40accd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638528384:12345-0@lo:41: 00000004:00000024:3.0:1790945818.975954:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1790945818.976007:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40accd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638528384:12345-0@lo:41: Request processed in 83us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945818.976022:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790945818.976191:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638528384:0@lo:41: 00010000:00010000:0.0:1790945819.104345:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945819.487430:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790945819.487456:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638528512:0@lo:41: 00000100:00100000:2.0:1790945819.487522:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945819.487667:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638528512 00000100:00100000:3.0:1790945819.487676:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638528512 00000100:00100000:3.0:1790945819.487732:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790945819.487741:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638528512:12345-0@lo:41: 00000004:00000024:3.0:1790945819.487774:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790945819.487827:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638528512:12345-0@lo:41: Request processed in 86us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945819.487834:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790945819.487904:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638528512:0@lo:41: 00000001:00100000:0.0:1790945820.003951:0:9515:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0cadc7a5-c0ba-4320-984f-d871ffb3a3ef 00010000:00010000:2.0:1790945820.130515:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945820.513749:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790945820.513778:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638528640:0@lo:13: 00000100:00100000:3.0:1790945820.513865:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945820.514145:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40accd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638529024:0@lo:400: 00000100:00100000:0.0:1790945820.514198:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945820.514216:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1877942638529536:0@lo:400: 00000100:00100000:0.0:1790945820.514239:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945820.514541:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1877942638530048:0@lo:400: 00000100:00100000:2.0:1790945820.514665:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638529152:0@lo:400: 00000100:00100000:2.0:1790945820.514695:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945820.514715:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638529664:0@lo:400: 00000100:00100000:2.0:1790945820.514737:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945820.514752:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638530176:0@lo:400: 00000100:00100000:2.0:1790945820.514773:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945820.514807:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1790945820.514813:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40accd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638528768:0@lo:400: 00000100:00100000:2.0:1790945820.514847:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945820.514867:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638529280:0@lo:400: 00000100:00100000:2.0:1790945820.514887:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945820.514905:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638529792:0@lo:400: 00000100:00100000:2.0:1790945820.514941:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945820.514968:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40accd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638528896:0@lo:400: 00000100:00100000:2.0:1790945820.514999:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945820.515016:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1877942638529408:0@lo:400: 00000100:00100000:2.0:1790945820.515036:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945820.515053:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1877942638529920:0@lo:400: 00000100:00100000:2.0:1790945820.515071:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945820.515097:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638529536 00000100:00100000:2.0:1790945820.515104:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638529536 00000100:00100000:2.0:1790945820.515148:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638529152 00000100:00100000:2.0:1790945820.515151:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638529152 00000100:00100000:2.0:1790945820.515162:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638528896 00000100:00100000:2.0:1790945820.515164:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638528896 00000100:00100000:2.0:1790945820.515200:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638529408 00000100:00100000:2.0:1790945820.515203:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638529408 00000100:00100000:2.0:1790945820.515213:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638529920 00000100:00100000:2.0:1790945820.515215:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638529920 00000100:00100000:2.0:1790945820.515230:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790945820.515238:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1877942638529536:12345-0@lo:400: 00000100:00100000:2.0:1790945820.515288:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1877942638529536:12345-0@lo:400: Request processed in 50us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945820.515294:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790945820.515315:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790945820.515321:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638529152:12345-0@lo:400: 00000100:00100000:2.0:1790945820.515353:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638529152:12345-0@lo:400: Request processed in 33us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945820.515358:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790945820.515370:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790945820.515382:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4db2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638528896:12345-0@lo:400: 00000100:00100000:0.0:1790945820.515529:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1790945820.515639:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcb14380 x1877942638529536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945820.515654:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1877942638529536:0@lo:400: 00000100:00100000:0.0:1790945820.515686:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638530048 00000100:00100000:0.0:1790945820.515691:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638530048 00000100:00100000:0.0:1790945820.515711:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790945820.515718:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4db2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1877942638529408:12345-0@lo:400: 00000100:00100000:0.0:1790945820.515759:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4db2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1877942638529408:12345-0@lo:400: Request processed in 41us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945820.515766:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790945820.515778:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790945820.515784:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4db0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1877942638529920:12345-0@lo:400: 00000100:00100000:0.0:1790945820.515810:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4db0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1877942638529920:12345-0@lo:400: Request processed in 27us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945820.515815:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790945820.515827:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790945820.515833:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1877942638530048:12345-0@lo:400: 00000100:00100000:0.0:1790945820.515865:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1877942638530048:12345-0@lo:400: Request processed in 31us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945820.515870:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1790945820.515895:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcb14700 x1877942638530048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945820.515905:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1877942638530048:0@lo:400: 00000100:00100000:0.0:1790945820.515949:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638529024 00000100:00100000:0.0:1790945820.515953:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638529024 00000100:00100000:0.0:1790945820.515975:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638529280 00000100:00100000:0.0:1790945820.515978:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638529280 00000100:00100000:0.0:1790945820.515992:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790945820.515997:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638529024:12345-0@lo:400: 00000100:00100000:0.0:1790945820.516037:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638529024:12345-0@lo:400: Request processed in 39us (1839us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945820.516043:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790945820.516054:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790945820.516067:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638529280:12345-0@lo:400: 00000100:00100000:0.0:1790945820.516107:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638529280:12345-0@lo:400: Request processed in 40us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945820.516113:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790945820.516130:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638528768 00000100:00100000:0.0:1790945820.516133:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638528768 00000100:00100000:0.0:1790945820.516155:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1790945820.516161:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087037450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3649:x1877942638528768:12345-0@lo:400: 00000100:00100000:0.0:1790945820.516221:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087037450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3649:x1877942638528768:12345-0@lo:400: Request processed in 60us (1372us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945820.516226:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1790945820.516255:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638529664 00000100:00100000:0.0:1790945820.516259:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638529664 00000100:00100000:0.0:1790945820.516282:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638530176 00000100:00100000:0.0:1790945820.516286:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638530176 00000100:00100000:0.0:1790945820.516301:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638529792 00000100:00100000:0.0:1790945820.516304:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638529792 00000100:00100000:0.0:1790945820.516319:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790945820.516326:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638529664:12345-0@lo:400: 00000100:00100000:0.0:1790945820.516356:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638529664:12345-0@lo:400: Request processed in 30us (1618us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945820.516362:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790945820.516373:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790945820.516378:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638530176:12345-0@lo:400: 00000100:00100000:0.0:1790945820.516417:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638530176:12345-0@lo:400: Request processed in 39us (1643us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945820.516423:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790945820.520659:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4db2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638528896:12345-0@lo:400: Request processed in 46us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945820.520676:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790945820.520747:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790945820.520765:0:8436:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638529792:12345-0@lo:400: 00000100:00100000:2.0:1790945820.520861:0:8436:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638529792:12345-0@lo:400: Request processed in 105us (5919us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945820.520868:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790945820.520920:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40accd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638528896:0@lo:400: 00000100:00100000:2.0:1790945820.520935:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1877942638529408:0@lo:400: 00000100:00100000:2.0:1790945820.520947:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1877942638529920:0@lo:400: 00000100:00100000:2.0:1790945820.520989:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40accd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638528768:0@lo:400: 00000100:00100000:2.0:1790945820.521000:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638529280:0@lo:400: 00010000:00080000:2.0:1790945820.521013:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcb14e00 x1877942638529792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945820.521024:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638529792:0@lo:400: 00000100:00100000:2.0:1790945820.521037:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638529152:0@lo:400: 00010000:00080000:2.0:1790945820.521047:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcb17800 x1877942638529664/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945820.521056:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638529664:0@lo:400: 00010000:00080000:2.0:1790945820.521068:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcb17b80 x1877942638530176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945820.521093:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638530176:0@lo:400: 00000100:00080000:2.0:1790945820.521151:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790945820.521157:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790945820.521160:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790945820.521163:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790945820.521205:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40accd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638529024:0@lo:400: 00000100:00100000:1.0:1790945820.521313:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638528640 00000100:00100000:1.0:1790945820.521320:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638528640 00000100:00100000:1.0:1790945820.521378:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790945820.521397:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4cec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638528640:12345-0@lo:13: 00002000:00000024:1.0:1790945820.521421:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790945820.521474:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4cec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638528640:12345-0@lo:13: Request processed in 90us (7609us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945820.521481:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790945820.521829:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638530304:0@lo:13: 00000100:00100000:3.0:1790945820.521871:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1790945820.521903:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcbbc380 x1877942638528640/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945836 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945820.521918:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638528640:0@lo:13: 00000100:00100000:3.0:1790945820.521944:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638530304 00000100:00100000:3.0:1790945820.521947:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638530304 00000100:00100000:3.0:1790945820.521969:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790945820.521975:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638530304:12345-0@lo:13: 00002000:00000024:3.0:1790945820.521985:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790945820.522015:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638530304:12345-0@lo:13: Request processed in 40us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945820.522022:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1790945820.522046:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcbb2300 x1877942638530304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945836 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945820.522057:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638530304:0@lo:13: 00000100:00080000:2.0:1790945820.522814:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:2.0:1790945821.029626:0:6500:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0cadc7a5-c0ba-4320-984f-d871ffb3a3ef 00000001:00100000:0.0:1790945821.046085:0:7452:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 0cadc7a5-c0ba-4320-984f-d871ffb3a3ef 00010000:00010000:1.0:1790945821.154722:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945821.252581:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945821.252619:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945821.252647:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945821.252676:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945821.252702:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945821.252733:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616461312 00000100:00100000:3.0:1790945821.252743:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616461312 00000100:00100000:3.0:1790945821.252792:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 197 00000100:00100000:3.0:1790945821.252802:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087034050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:2401:x1877942616461312:12345-192.168.204.20@tcp:400: 00000100:00100000:3.0:1790945821.252874:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087034050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:2401:x1877942616461312:12345-192.168.204.20@tcp:400: Request processed in 73us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945821.252891:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 197 00000100:00100000:3.0:1790945821.252926:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616461440 00000100:00100000:3.0:1790945821.252930:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616461440 00000100:00100000:3.0:1790945821.252966:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616461568 00000100:00100000:3.0:1790945821.252969:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616461568 00000100:00100000:3.0:1790945821.252993:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 51 00000100:00100000:3.0:1790945821.253000:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2402:x1877942616461440:12345-192.168.204.20@tcp:400: 00000100:00100000:3.0:1790945821.253029:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2402:x1877942616461440:12345-192.168.204.20@tcp:400: Request processed in 30us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945821.253036:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 51 00000100:00100000:3.0:1790945821.253048:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 52 00000100:00100000:3.0:1790945821.253054:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2401:x1877942616461568:12345-192.168.204.20@tcp:400: 00000100:00100000:3.0:1790945821.253078:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2401:x1877942616461568:12345-192.168.204.20@tcp:400: Request processed in 25us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945821.253085:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 52 00000100:00100000:3.0:1790945821.253105:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616461696 00000100:00100000:3.0:1790945821.253109:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616461696 00000100:00100000:3.0:1790945821.253133:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616461824 00000100:00100000:3.0:1790945821.253136:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616461824 00000100:00100000:3.0:1790945821.253155:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:3.0:1790945821.253161:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2402:x1877942616461696:12345-192.168.204.20@tcp:400: 00000100:00100000:3.0:1790945821.253358:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2402:x1877942616461696:12345-192.168.204.20@tcp:400: Request processed in 196us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945821.253365:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:3.0:1790945821.253389:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 14 00000100:00100000:3.0:1790945821.253396:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2401:x1877942616461824:12345-192.168.204.20@tcp:400: 00000100:00100000:3.0:1790945821.253430:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2401:x1877942616461824:12345-192.168.204.20@tcp:400: Request processed in 35us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945821.253437:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 14 00000100:00080000:3.0:1790945821.253574:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790945821.253579:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790945821.253581:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790945821.253583:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1790945821.387778:0:10186:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1790945822.053718:0:8429:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0cadc7a5-c0ba-4320-984f-d871ffb3a3ef 00010000:00010000:2.0:1790945822.175362:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945822.561282:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638530432:0@lo:13: 00000100:00100000:0.0:1790945822.561360:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945822.561436:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638530432 00000100:00100000:0.0:1790945822.561444:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638530432 00000100:00100000:0.0:1790945822.561497:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790945822.561507:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638530432:12345-0@lo:13: 00002000:00000024:0.0:1790945822.561536:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790945822.561589:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638530432:12345-0@lo:13: Request processed in 82us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945822.561596:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1790945822.561616:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790945822.561645:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcb14700 x1877942638530432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945838 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945822.561660:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638530432:0@lo:13: 00000100:00100000:1.0:1790945822.562476:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638530560:0@lo:13: 00000100:00100000:1.0:1790945822.562518:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945822.562597:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638530560 00000100:00100000:2.0:1790945822.562603:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638530560 00000100:00100000:2.0:1790945822.562645:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790945822.562654:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638530560:12345-0@lo:13: 00002000:00000024:2.0:1790945822.562670:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790945822.562708:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638530560:12345-0@lo:13: Request processed in 56us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945822.562714:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1790945822.562766:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790945822.562791:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40b4db3800 x1877942638530560/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945838 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945822.562808:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638530560:0@lo:13: 00010000:00010000:1.0:1790945823.200056:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945824.099347:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790945824.099374:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638530688:0@lo:41: 00000100:00100000:1.0:1790945824.099450:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945824.099578:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638530688 00000100:00100000:0.0:1790945824.099587:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638530688 00000100:00100000:0.0:1790945824.099650:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790945824.099661:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638530688:12345-0@lo:41: 00000004:00000024:0.0:1790945824.099702:0:6526:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1790945824.099756:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638530688:12345-0@lo:41: Request processed in 97us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945824.099762:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790945824.099849:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638530688:0@lo:41: 00010000:00010000:2.0:1790945824.224407:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945824.607656:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638530816:0@lo:41: 00000100:00100000:1.0:1790945824.607744:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945824.607931:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638530816 00000100:00100000:0.0:1790945824.607941:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638530816 00000100:00100000:0.0:1790945824.608008:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790945824.608018:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638530816:12345-0@lo:41: 00000004:00000024:0.0:1790945824.608054:0:6526:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790945824.608122:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638530816:12345-0@lo:41: Request processed in 105us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945824.608131:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790945824.608608:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638530816:0@lo:41: 00000020:00000080:0.0:1790945825.035066:0:10333:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd3e99bd20 20000000:00000080:0.0:1790945825.035084:0:10333:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d40bfe64400 uarg=0000000000000000 20000000:01000000:0.0:1790945825.035134:0:10333:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1790945825.035136:0:10333:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1790945825.035139:0:10333:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1790945825.035144:0:10333:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1790945825.035150:0:10333:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1790945825.035285:0:10333:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1790945825.035288:0:10333:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1790945825.036112:0:10334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:1.0:1790945825.036417:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:1.0:1790945825.036441:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:1.0:1790945825.036453:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:1.0:1790945825.036463:0:10333:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1790945825.036465:0:10333:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1790945825.036958:0:10335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:0.0:1790945825.037288:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:0.0:1790945825.037326:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:0.0:1790945825.037355:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:0.0:1790945825.037368:0:10333:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1790945825.037370:0:10333:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1790945825.037855:0:10336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:0.0:1790945825.038007:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:0.0:1790945825.038030:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:0.0:1790945825.038044:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:0.0:1790945825.038052:0:10333:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1790945825.038054:0:10333:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1790945825.039010:0:10337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:0.0:1790945825.039334:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:0.0:1790945825.039436:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:0.0:1790945825.039453:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:0.0:1790945825.039463:0:10333:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1790945825.039466:0:10333:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1790945825.044042:0:10338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:1.0:1790945825.044545:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:1.0:1790945825.044571:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:1.0:1790945825.044586:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 10000000:01000000:1.0:1790945825.044599:0:10333:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1790945825.044617:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d40c21d6c00/0xd9f4181e0d27d14c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945825.044635:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40c21d6400/0xd9f4181e0d27cfe7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27cfe0 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945825.044642:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40baef1600/0xd9f4181e0d27d011 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d00a expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945825.044648:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40c21d7400/0xd9f4181e0d27d050 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d049 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945825.044654:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40baef0c00/0xd9f4181e0d27d05e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d057 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945825.044677:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40baef0200/0xd9f4181e0d27d06c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d065 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945825.044683:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40baef0000/0xd9f4181e0d27d088 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d081 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945825.044689:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d4086a4da00/0xd9f4181e0d27d0b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d0ab expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945825.044695:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40813fea00/0xd9f4181e0d27d0ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d0c7 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945825.044766:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d4086a4c800/0xd9f4181e0d27d0f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d0f1 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945825.044775:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40baef1800/0xd9f4181e0d27d106 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330992 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945825.044781:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d4086a4c400/0xd9f4181e0d27d10d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330999 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945825.044788:0:10333:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d40c21d6c00/0xd9f4181e0d27d14c lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945825.044824:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d4086a4c400/0xd9f4181e0d27d10d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330999 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945825.044837:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d4086a4c400/0xd9f4181e0d27d10d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330999 expref: 9 pid: 6516 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945825.044862:0:10333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1877942638530944:192.168.204.20@tcp:104: 00010000:00010000:1.0:1790945825.045000:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40baef1800/0xd9f4181e0d27d106 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330992 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945825.045009:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40baef1800/0xd9f4181e0d27d106 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330992 expref: 9 pid: 6515 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945825.045018:0:10333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1877942638531072:192.168.204.20@tcp:104: 00010000:00010000:1.0:1790945825.045048:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d4086a4c800/0xd9f4181e0d27d0f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27d0f1 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945825.045056:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d4086a4c800/0xd9f4181e0d27d0f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27d0f1 expref: 23 pid: 6516 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945825.045065:0:10333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1877942638531200:0@lo:104: 00000100:00100000:1.0:1790945825.045101:0:10333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790945825.045139:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40813fea00/0xd9f4181e0d27d0ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27d0c7 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945825.045147:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40813fea00/0xd9f4181e0d27d0ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27d0c7 expref: 23 pid: 6516 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945825.045155:0:10333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1877942638531328:0@lo:104: 00000100:00100000:1.0:1790945825.045205:0:10333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945825.047587:0:6504:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638531200 00000100:00100000:2.0:1790945825.047603:0:6504:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638531200 00000100:00100000:2.0:1790945825.047652:0:6504:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638531328 00000100:00100000:2.0:1790945825.047655:0:6504:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638531328 00000100:00100000:2.0:1790945825.047672:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790945825.047682:0:6504:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbbd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+4:10333:x1877942638531200:12345-0@lo:104: 00010000:00010000:2.0:1790945825.047728:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27d0f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27d0f8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945825.047824:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790945825.047830:0:6504:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbbd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+4:10333:x1877942638531200:12345-0@lo:104: Request processed in 151us (2729us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945825.047838:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790945825.047859:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790945825.047865:0:6504:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbbca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+3:10333:x1877942638531328:12345-0@lo:104: 00010000:00010000:2.0:1790945825.047874:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d600/0xd9f4181e0d27d0c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27d0ce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945825.047909:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790945825.047914:0:6504:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbbca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+3:10333:x1877942638531328:12345-0@lo:104: Request processed in 50us (2709us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945825.047919:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:2.0:1790945825.047938:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790945825.047944:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27d0f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27d0f8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945825.047951:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef1000 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:2.0:1790945825.047956:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27d0f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27d0f8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945825.047964:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27d0f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27d0f8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790945825.047972:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27d0f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27d0f8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945825.047985:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790945825.048032:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27d0f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d0f8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945825.048040:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790945825.048060:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27d0f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d0f8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945825.048066:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27d0f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d0f8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945825.048084:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790945825.048088:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d600/0xd9f4181e0d27d0c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27d0ce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945825.048093:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4086a4d600 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:2.0:1790945825.048096:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d600/0xd9f4181e0d27d0c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27d0ce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945825.048103:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d600/0xd9f4181e0d27d0c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27d0ce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790945825.048110:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d600/0xd9f4181e0d27d0c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27d0ce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945825.048115:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790945825.048126:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d600/0xd9f4181e0d27d0c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d0ce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945825.048131:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790945825.048143:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d600/0xd9f4181e0d27d0c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d0ce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945825.048150:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d600/0xd9f4181e0d27d0c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d0ce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945825.048159:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945825.048161:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945825.048163:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945825.048193:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945825.048206:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4db1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8841fcfb-fb47-4307-92c2-97500c1c82bd:3648:1877942638531584:0@lo:103: 00000100:00100000:2.0:1790945825.048248:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945825.048277:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790945825.048283:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4db0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8841fcfb-fb47-4307-92c2-97500c1c82bd:3648:1877942638531456:0@lo:103: 00000100:00100000:2.0:1790945825.048319:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945825.048358:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638531584 00000100:00100000:2.0:1790945825.048363:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638531584 00010000:00010000:2.0:1790945825.048383:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40813fea00/0xd9f4181e0d27d0ce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27d0c7 expref: 24 pid: 6516 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945825.048401:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638531456 00000100:00100000:2.0:1790945825.048404:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638531456 00010000:00010000:2.0:1790945825.048414:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d4086a4c800/0xd9f4181e0d27d0f8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27d0f1 expref: 25 pid: 6516 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945825.048433:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790945825.048440:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4096cbec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+25:3648:x1877942638531584:12345-0@lo:103: 00010000:00010000:2.0:1790945825.048450:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945825.048455:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40813fea00/0xd9f4181e0d27d0ce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27d0c7 expref: 25 pid: 6516 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945825.048476:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40813fea00/0xd9f4181e0d27d0ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27d0c7 expref: 25 pid: 6516 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945825.048493:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945825.048522:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4096cbec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+25:3648:x1877942638531584:12345-0@lo:103: Request processed in 83us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945825.048529:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790945825.048570:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790945825.048576:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4db0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3648:x1877942638531456:12345-0@lo:103: 00010000:00010000:2.0:1790945825.048583:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945825.048587:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d4086a4c800/0xd9f4181e0d27d0f8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27d0f1 expref: 24 pid: 6516 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945825.048595:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d4086a4c800/0xd9f4181e0d27d0f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27d0f1 expref: 24 pid: 6516 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945825.048610:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945825.048633:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4db0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3648:x1877942638531456:12345-0@lo:103: Request processed in 57us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945825.048639:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790945825.048680:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4db0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8841fcfb-fb47-4307-92c2-97500c1c82bd:3648:1877942638531456:0@lo:103: 00000100:00100000:2.0:1790945825.048690:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4db1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8841fcfb-fb47-4307-92c2-97500c1c82bd:3648:1877942638531584:0@lo:103: 00010000:00010000:1.0:1790945825.048970:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d4086a4da00/0xd9f4181e0d27d0b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27d0ab expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945825.048982:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d4086a4da00/0xd9f4181e0d27d0b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27d0ab expref: 23 pid: 6516 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945825.049001:0:10333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1877942638531712:0@lo:104: 00000100:00100000:1.0:1790945825.049032:0:10333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790945825.049069:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40baef0000/0xd9f4181e0d27d088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27d081 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945825.049078:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40baef0000/0xd9f4181e0d27d088 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27d081 expref: 23 pid: 6516 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945825.049087:0:10333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1877942638531840:0@lo:104: 00000100:00100000:1.0:1790945825.049109:0:10333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790945825.049126:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40baef0200/0xd9f4181e0d27d06c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27d065 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945825.049133:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40baef0200/0xd9f4181e0d27d06c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27d065 expref: 23 pid: 6515 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945825.049140:0:10333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1877942638531968:0@lo:104: 00010000:00010000:1.0:1790945825.049199:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40baef0c00/0xd9f4181e0d27d05e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27d057 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945825.049207:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40baef0c00/0xd9f4181e0d27d05e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27d057 expref: 23 pid: 6514 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945825.049215:0:10333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbe680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1877942638532096:0@lo:104: 00010000:00010000:1.0:1790945825.049243:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40c21d7400/0xd9f4181e0d27d050 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27d049 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945825.049251:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40c21d7400/0xd9f4181e0d27d050 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27d049 expref: 23 pid: 6514 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945825.049267:0:10333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1877942638532224:0@lo:104: 00010000:00010000:1.0:1790945825.049309:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40baef1600/0xd9f4181e0d27d011 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27d00a expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945825.049318:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40baef1600/0xd9f4181e0d27d011 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27d00a expref: 23 pid: 6516 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945825.049326:0:10333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbe300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1877942638532352:0@lo:104: 00000100:00100000:0.0:1790945825.049488:0:6505:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1790945825.049507:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945825.049520:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945825.049529:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945825.049557:0:6505:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638531712 00000100:00100000:0.0:1790945825.049563:0:6505:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638531712 00000100:00100000:0.0:1790945825.049588:0:6505:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638531840 00000100:00100000:0.0:1790945825.049591:0:6505:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638531840 00000100:00100000:0.0:1790945825.049601:0:6505:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638531968 00000100:00100000:0.0:1790945825.049603:0:6505:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638531968 00000100:00100000:0.0:1790945825.049613:0:6505:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638532096 00000100:00100000:0.0:1790945825.049615:0:6505:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638532096 00000100:00100000:0.0:1790945825.049623:0:6505:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638532224 00000100:00100000:0.0:1790945825.049625:0:6505:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638532224 00000100:00100000:0.0:1790945825.049637:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790945825.049645:0:6505:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbbed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+7:10333:x1877942638531712:12345-0@lo:104: 00010000:00010000:0.0:1790945825.049655:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27d0ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27d0b2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945825.049696:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790945825.049714:0:6505:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbbed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+7:10333:x1877942638531712:12345-0@lo:104: Request processed in 58us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945825.049721:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790945825.049739:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790945825.049746:0:6505:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcba6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+6:10333:x1877942638531840:12345-0@lo:104: 00010000:00010000:0.0:1790945825.049753:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d40baef1c00/0xd9f4181e0d27d081 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27d088 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945825.049788:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790945825.049792:0:6505:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcba6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+6:10333:x1877942638531840:12345-0@lo:104: Request processed in 49us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945825.049798:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790945825.049827:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790945825.049833:0:6505:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+5:10333:x1877942638531968:12345-0@lo:104: 00010000:00010000:0.0:1790945825.049846:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27d065 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27d06c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945825.049874:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1790945825.049879:0:6505:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+5:10333:x1877942638531968:12345-0@lo:104: Request processed in 47us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945825.049885:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790945825.049899:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790945825.049905:0:6505:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+4:10333:x1877942638532096:12345-0@lo:104: 00010000:00010000:0.0:1790945825.049911:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d40813ff200/0xd9f4181e0d27d057 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27d05e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945825.049936:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1790945825.049940:0:6505:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+4:10333:x1877942638532096:12345-0@lo:104: Request processed in 37us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945825.049946:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790945825.049958:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790945825.049963:0:6505:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+3:10333:x1877942638532224:12345-0@lo:104: 00010000:00010000:0.0:1790945825.049969:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d40813ff800/0xd9f4181e0d27d049 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27d050 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945825.049992:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1790945825.049997:0:6505:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+3:10333:x1877942638532224:12345-0@lo:104: Request processed in 35us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945825.050003:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:0.0:1790945825.050025:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1790945825.050031:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27d0ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27d0b2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945825.050045:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef0800 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:0.0:1790945825.050049:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27d0ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27d0b2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945825.050057:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27d0ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27d0b2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790945825.050064:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27d0ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27d0b2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945825.050070:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790945825.050100:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27d0ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d0b2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945825.050107:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790945825.050130:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27d0ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d0b2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945825.050137:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27d0ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d0b2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945825.050149:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1790945825.050152:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40baef1c00/0xd9f4181e0d27d081 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27d088 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945825.050158:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef1c00 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:0.0:1790945825.050161:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40baef1c00/0xd9f4181e0d27d081 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27d088 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945825.050200:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40baef1c00/0xd9f4181e0d27d081 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27d088 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790945825.050207:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40baef1c00/0xd9f4181e0d27d081 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27d088 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945825.050212:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790945825.050227:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40baef1c00/0xd9f4181e0d27d081 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d088 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945825.050234:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790945825.050240:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40baef1c00/0xd9f4181e0d27d081 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d088 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945825.050247:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40baef1c00/0xd9f4181e0d27d081 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d088 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945825.050258:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790945825.050261:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27d065 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27d06c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945825.050267:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40813ff000 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:0.0:1790945825.050270:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27d065 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27d06c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945825.050277:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27d065 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27d06c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790945825.050283:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27d065 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27d06c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945825.050295:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790945825.050321:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27d065 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d06c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945825.050328:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1790945825.050520:0:10333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945825.050605:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638532608:0@lo:103: 00000100:00100000:3.0:1790945825.050635:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945825.050667:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790945825.050673:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638532480:0@lo:103: 00000100:00100000:3.0:1790945825.050694:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945825.050731:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638532608 00000100:00100000:3.0:1790945825.050736:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638532608 00010000:00010000:3.0:1790945825.050756:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40baef0000/0xd9f4181e0d27d088 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27d081 expref: 24 pid: 6516 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945825.050775:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638532480 00000100:00100000:3.0:1790945825.050778:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638532480 00010000:00010000:3.0:1790945825.050788:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d4086a4da00/0xd9f4181e0d27d0b2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27d0ab expref: 25 pid: 6516 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945825.050805:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790945825.050811:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+25:3650:x1877942638532608:12345-0@lo:103: 00010000:00010000:3.0:1790945825.050819:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945825.050823:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40baef0000/0xd9f4181e0d27d088 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27d081 expref: 25 pid: 6516 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945825.050843:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40baef0000/0xd9f4181e0d27d088 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27d081 expref: 25 pid: 6516 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945825.050856:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945825.050887:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+25:3650:x1877942638532608:12345-0@lo:103: Request processed in 76us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945825.050893:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790945825.050907:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790945825.050913:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3650:x1877942638532480:12345-0@lo:103: 00010000:00010000:3.0:1790945825.050921:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945825.050924:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d4086a4da00/0xd9f4181e0d27d0b2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27d0ab expref: 24 pid: 6516 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945825.050932:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d4086a4da00/0xd9f4181e0d27d0b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27d0ab expref: 24 pid: 6516 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945825.050942:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945825.050961:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3650:x1877942638532480:12345-0@lo:103: Request processed in 48us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945825.050967:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790945825.051002:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638532480:0@lo:103: 00000100:00100000:3.0:1790945825.051011:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638532608:0@lo:103: 00010000:00010000:1.0:1790945825.051214:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40c21d6400/0xd9f4181e0d27cfe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27cfe0 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945825.051224:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40c21d6400/0xd9f4181e0d27cfe7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27cfe0 expref: 23 pid: 6514 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945825.051233:0:10333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1877942638532864:0@lo:104: 00000100:00100000:1.0:1790945825.051255:0:10333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945825.051265:0:10333:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f821f3180 going to sleep for 11 seconds 00010000:00010000:1.0:1790945825.051276:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d4086a4c800/0xd9f4181e0d27d0f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27d0f1 expref: 23 pid: 6516 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945825.051287:0:10333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1877942638531200:0@lo:104: 00010000:00010000:1.0:1790945825.051308:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40813fea00/0xd9f4181e0d27d0ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27d0c7 expref: 22 pid: 6516 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945825.051318:0:10333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1877942638531328:0@lo:104: 00010000:00010000:1.0:1790945825.051328:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d4086a4da00/0xd9f4181e0d27d0b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27d0ab expref: 21 pid: 6516 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945825.051356:0:10333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1877942638531712:0@lo:104: 00010000:00010000:1.0:1790945825.051369:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40baef0000/0xd9f4181e0d27d088 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27d081 expref: 20 pid: 6516 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945825.051376:0:10333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1877942638531840:0@lo:104: 00000100:00100000:1.0:1790945825.051384:0:10333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1877942638531968:0@lo:104: 00000100:00100000:1.0:1790945825.051390:0:10333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbe680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1877942638532096:0@lo:104: 00000100:00100000:1.0:1790945825.051397:0:10333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1877942638532224:0@lo:104: 00000100:00100000:2.0:1790945825.051578:0:6504:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638532352 00000100:00100000:2.0:1790945825.051583:0:6504:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638532352 00000100:00100000:2.0:1790945825.051608:0:6504:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638532864 00000100:00100000:2.0:1790945825.051611:0:6504:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638532864 00000100:00100000:2.0:1790945825.051622:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790945825.051635:0:6504:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+4:10333:x1877942638532352:12345-0@lo:104: 00010000:00010000:2.0:1790945825.051646:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7800/0xd9f4181e0d27d00a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27d011 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945825.051752:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1790945825.051759:0:6504:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+4:10333:x1877942638532352:12345-0@lo:104: Request processed in 125us (1240us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945825.051767:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790945825.051785:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790945825.051791:0:6504:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbbd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+3:10333:x1877942638532864:12345-0@lo:104: 00010000:00010000:2.0:1790945825.051799:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d40baef1400/0xd9f4181e0d27cfe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27cfe7 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945825.051829:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1790945825.051833:0:6504:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbbd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+3:10333:x1877942638532864:12345-0@lo:104: Request processed in 44us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945825.051839:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790945825.052229:0:10333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbe300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1877942638532352:0@lo:104: 00000100:00100000:1.0:1790945825.052237:0:10333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1877942638532864:0@lo:104: 00000100:00100000:1.0:1790945825.052575:0:10333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1877942638530944:192.168.204.20@tcp:104: 00010000:00010000:2.0:1790945825.052790:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1790945825.053079:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27d065 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d06c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945825.053089:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27d065 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d06c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945825.053100:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790945825.053104:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40813ff800/0xd9f4181e0d27d049 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27d050 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945825.053110:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40813ff800 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:0.0:1790945825.053114:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40813ff800/0xd9f4181e0d27d049 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27d050 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945825.053124:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40813ff800/0xd9f4181e0d27d049 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27d050 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790945825.053130:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40813ff800/0xd9f4181e0d27d049 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27d050 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945825.053135:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790945825.053196:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40813ff800/0xd9f4181e0d27d049 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d050 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945825.053203:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790945825.053218:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40813ff800/0xd9f4181e0d27d049 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d050 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945825.053224:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40813ff800/0xd9f4181e0d27d049 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d050 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945825.053233:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790945825.053236:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7800/0xd9f4181e0d27d00a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27d011 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945825.053242:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d7800 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:0.0:1790945825.053244:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7800/0xd9f4181e0d27d00a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27d011 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945825.053251:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7800/0xd9f4181e0d27d00a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27d011 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790945825.053257:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7800/0xd9f4181e0d27d00a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27d011 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945825.053262:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790945825.053275:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7800/0xd9f4181e0d27d00a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d011 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945825.053281:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790945825.053293:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7800/0xd9f4181e0d27d00a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d011 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945825.053309:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7800/0xd9f4181e0d27d00a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d011 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945825.053318:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790945825.053326:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40baef1400/0xd9f4181e0d27cfe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27cfe7 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945825.053332:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef1400 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:0.0:1790945825.053335:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40baef1400/0xd9f4181e0d27cfe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27cfe7 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945825.053352:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40baef1400/0xd9f4181e0d27cfe0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27cfe7 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790945825.053358:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40baef1400/0xd9f4181e0d27cfe0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27cfe7 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945825.053363:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790945825.053377:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40baef1400/0xd9f4181e0d27cfe0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cfe7 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945825.053383:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790945825.053388:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40baef1400/0xd9f4181e0d27cfe0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cfe7 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945825.053394:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40baef1400/0xd9f4181e0d27cfe0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cfe7 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945825.053404:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945825.053406:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945825.053407:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945825.053420:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8841fcfb-fb47-4307-92c2-97500c1c82bd:3648:1877942638532992:0@lo:103: 00000100:00100000:0.0:1790945825.053462:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945825.053495:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790945825.053500:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8841fcfb-fb47-4307-92c2-97500c1c82bd:3648:1877942638532736:0@lo:103: 00000100:00100000:0.0:1790945825.053525:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945825.054016:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638533120:0@lo:103: 00000100:00100000:3.0:1790945825.054046:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945825.054076:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790945825.054083:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638533248:0@lo:103: 00000100:00100000:3.0:1790945825.054115:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945825.054148:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638532992 00000100:00100000:3.0:1790945825.054155:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638532992 00010000:00010000:3.0:1790945825.054205:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40c21d7400/0xd9f4181e0d27d050 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27d049 expref: 20 pid: 6514 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945825.054223:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638532736 00000100:00100000:3.0:1790945825.054226:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638532736 00010000:00010000:3.0:1790945825.054236:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40baef0200/0xd9f4181e0d27d06c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27d065 expref: 21 pid: 6515 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945825.054246:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638533120 00000100:00100000:3.0:1790945825.054248:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638533120 00010000:00010000:3.0:1790945825.054256:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40baef1600/0xd9f4181e0d27d011 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27d00a expref: 22 pid: 6516 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945825.054265:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638533248 00000100:00100000:3.0:1790945825.054267:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638533248 00010000:00010000:3.0:1790945825.054276:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40c21d6400/0xd9f4181e0d27cfe7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27cfe0 expref: 23 pid: 6514 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945825.054289:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790945825.054306:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:3648:x1877942638532992:12345-0@lo:103: 00010000:00010000:3.0:1790945825.054319:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945825.054324:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40c21d7400/0xd9f4181e0d27d050 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27d049 expref: 23 pid: 6514 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945825.054333:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40c21d7400/0xd9f4181e0d27d050 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27d049 expref: 23 pid: 6514 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945825.054428:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790945825.054437:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:3648:x1877942638532736:12345-0@lo:103: 00010000:00010000:1.0:1790945825.054446:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945825.054451:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40baef0200/0xd9f4181e0d27d06c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27d065 expref: 23 pid: 6515 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945825.054562:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945825.054629:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:1.0:1790945825.055113:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40baef0200/0xd9f4181e0d27d06c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27d065 expref: 23 pid: 6515 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945825.055130:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40baef0200/0xd9f4181e0d27d06c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27d065 expref: 23 pid: 6515 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945825.055143:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790945825.055381:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945825.055384:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945825.055387:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945825.055502:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40813ff200/0xd9f4181e0d27d057 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27d05e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945825.055511:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40813ff200 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:0.0:1790945825.055515:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40813ff200/0xd9f4181e0d27d057 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27d05e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945825.055523:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40813ff200/0xd9f4181e0d27d057 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27d05e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790945825.055529:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40813ff200/0xd9f4181e0d27d057 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27d05e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945825.055535:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790945825.055577:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40813ff200/0xd9f4181e0d27d057 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d05e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945825.055584:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790945825.055599:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40813ff200/0xd9f4181e0d27d057 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d05e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945825.055606:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40813ff200/0xd9f4181e0d27d057 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d05e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945825.055620:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945825.055621:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945825.055623:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945825.055644:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790945825.055656:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8841fcfb-fb47-4307-92c2-97500c1c82bd:3648:1877942638533376:0@lo:103: 00000100:00100000:0.0:1790945825.055691:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945825.056010:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:3648:x1877942638532736:12345-0@lo:103: Request processed in 1574us (2482us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945825.056026:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790945825.056053:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616461952 00000100:00100000:1.0:1790945825.056060:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616461952 00010000:00010000:1.0:1790945825.056083:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d4086a4c400/0xd9f4181e0d27d10d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330999 expref: 10 pid: 6516 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945825.056097:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616462080 00000100:00100000:1.0:1790945825.056100:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616462080 00010000:00010000:1.0:1790945825.056110:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40baef1800/0xd9f4181e0d27d106 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330992 expref: 11 pid: 6515 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945825.056120:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638533376 00000100:00100000:1.0:1790945825.056122:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638533376 00010000:00010000:1.0:1790945825.056132:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40baef0c00/0xd9f4181e0d27d05e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27d057 expref: 22 pid: 6514 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945825.056143:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790945825.056149:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:3649:x1877942638533120:12345-0@lo:103: 00010000:00010000:1.0:1790945825.056159:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945825.056164:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40baef1600/0xd9f4181e0d27d011 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27d00a expref: 22 pid: 6516 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945825.056231:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40baef1600/0xd9f4181e0d27d011 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27d00a expref: 22 pid: 6516 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945825.056242:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40baef1600/0xd9f4181e0d27d011 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27d00a expref: 22 pid: 6516 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945825.056253:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945825.056443:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8841fcfb-fb47-4307-92c2-97500c1c82bd:3648:1877942638532736:0@lo:103: 00000100:00100000:1.0:1790945825.056541:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:3649:x1877942638533120:12345-0@lo:103: Request processed in 391us (2493us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945825.056568:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790945825.056583:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790945825.056589:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4096cbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8841fcfb-fb47-4307-92c2-97500c1c82bd+20:3649:x1877942638533248:12345-0@lo:103: 00010000:00010000:1.0:1790945825.056598:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945825.056602:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40c21d6400/0xd9f4181e0d27cfe7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27cfe0 expref: 20 pid: 6514 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945825.056610:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40c21d6400/0xd9f4181e0d27cfe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27cfe0 expref: 20 pid: 6514 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945825.056620:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40c21d6400/0xd9f4181e0d27cfe7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27cfe0 expref: 20 pid: 6514 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945825.056628:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945825.056652:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4096cbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8841fcfb-fb47-4307-92c2-97500c1c82bd+19:3649:x1877942638533248:12345-0@lo:103: Request processed in 64us (2536us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945825.056658:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790945825.056671:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 32 00000100:00100000:1.0:1790945825.056677:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+11:2404:x1877942616461952:12345-192.168.204.20@tcp:103: 00010000:00010000:1.0:1790945825.056684:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945825.056689:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d4086a4c400/0xd9f4181e0d27d10d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330999 expref: 11 pid: 6516 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945825.056698:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d4086a4c400/0xd9f4181e0d27d10d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330999 expref: 11 pid: 6516 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945825.056778:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d4086a4c400/0xd9f4181e0d27d10d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330999 expref: 11 pid: 6516 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945825.056796:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945825.056843:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:2404:x1877942616461952:12345-192.168.204.20@tcp:103: Request processed in 167us (2297us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945825.056850:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 32 00000100:00100000:1.0:1790945825.056863:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 33 00000100:00100000:1.0:1790945825.056869:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+9:2404:x1877942616462080:12345-192.168.204.20@tcp:103: 00010000:00010000:1.0:1790945825.056877:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945825.056882:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40baef1800/0xd9f4181e0d27d106 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330992 expref: 9 pid: 6515 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945825.056891:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40baef1800/0xd9f4181e0d27d106 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330992 expref: 9 pid: 6515 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945825.056900:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945825.056917:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+9:2404:x1877942616462080:12345-192.168.204.20@tcp:103: Request processed in 48us (2288us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945825.056923:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 33 00000100:00100000:1.0:1790945825.057001:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790945825.057011:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:3648:x1877942638533376:12345-0@lo:103: 00010000:00010000:1.0:1790945825.057019:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945825.057023:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40baef0c00/0xd9f4181e0d27d05e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27d057 expref: 18 pid: 6514 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945825.057032:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40baef0c00/0xd9f4181e0d27d05e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27d057 expref: 18 pid: 6514 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945825.057041:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40baef0c00/0xd9f4181e0d27d05e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27d057 expref: 18 pid: 6514 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945825.057057:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945825.057084:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:3648:x1877942638533376:12345-0@lo:103: Request processed in 75us (1392us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945825.057089:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:1.0:1790945825.057127:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40baef1800/0xd9f4181e0d27d106 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330992 expref: 8 pid: 6515 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945825.057137:0:10333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1877942638531072:192.168.204.20@tcp:104: 00010000:00010000:1.0:1790945825.057198:0:10333:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d40c21d6c00/0xd9f4181e0d27d14c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945825.057631:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40c21d7400/0xd9f4181e0d27d050 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27d049 expref: 16 pid: 6514 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945825.057653:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d40c21d6c00/0xd9f4181e0d27d14c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945825.057662:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40c21d6c00/0xd9f4181e0d27d14c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945825.057678:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d40c21d6c00/0xd9f4181e0d27d14c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945825.057684:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d40c21d6c00/0xd9f4181e0d27d14c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945825.057691:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d40c21d6c00/0xd9f4181e0d27d14c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945825.057698:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d40c21d6c00/0xd9f4181e0d27d14c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945825.057716:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d6c00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:3.0:1790945825.057720:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d40c21d6c00/0xd9f4181e0d27d14c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945825.057729:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d40c21d6c00/0xd9f4181e0d27d14c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945825.057748:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d40c21d6c00/0xd9f4181e0d27d14c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945825.057757:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945825.057792:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:3648:x1877942638532992:12345-0@lo:103: Request processed in 3495us (4328us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945825.057806:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790945825.058110:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8841fcfb-fb47-4307-92c2-97500c1c82bd:3648:1877942638533376:0@lo:103: 00000100:00100000:0.0:1790945825.058121:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8841fcfb-fb47-4307-92c2-97500c1c82bd:3648:1877942638532992:0@lo:103: 00010000:00010000:1.0:1790945825.058645:0:10333:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d40c21d6c00/0xd9f4181e0d27d14c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945825.058655:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d40c21d6c00/0xd9f4181e0d27d14c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945825.058661:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40c21d6c00/0xd9f4181e0d27d14c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945825.065549:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638533120:0@lo:103: 00000100:00100000:2.0:1790945825.065580:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638533248:0@lo:103: 00010000:00010000:0.0:1790945825.251242:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945825.631604:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8841fcfb-fb47-4307-92c2-97500c1c82bd:3648:1877942638533504:0@lo:400: 00000100:00100000:2.0:1790945825.631677:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945825.631737:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638534016:0@lo:400: 00000100:00100000:2.0:1790945825.631771:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945825.631793:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638534528:0@lo:400: 00000100:00100000:2.0:1790945825.631827:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945825.631843:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638535040:0@lo:400: 00000100:00100000:2.0:1790945825.631860:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945825.631879:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1790945825.631884:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1877942638533888:0@lo:400: 00000100:00100000:2.0:1790945825.631905:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945825.631918:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638534400:0@lo:400: 00000100:00100000:2.0:1790945825.631934:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945825.631945:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638534912:0@lo:400: 00000100:00100000:2.0:1790945825.631959:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945825.631984:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638534016 00000100:00100000:2.0:1790945825.631990:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638534016 00000100:00100000:2.0:1790945825.632032:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790945825.632039:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4db1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638534016:12345-0@lo:400: 00000100:00100000:2.0:1790945825.632089:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4db1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638534016:12345-0@lo:400: Request processed in 50us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945825.632095:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790945825.632133:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638534016:0@lo:400: 00000100:00100000:0.0:1790945825.632284:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638533504 00000100:00100000:0.0:1790945825.632298:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638533504 00000100:00100000:0.0:1790945825.632333:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1790945825.632340:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087034450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:3648:x1877942638533504:12345-0@lo:400: 00000100:00100000:0.0:1790945825.632384:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087034450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:3648:x1877942638533504:12345-0@lo:400: Request processed in 46us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945825.632390:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1790945825.632551:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8841fcfb-fb47-4307-92c2-97500c1c82bd:3648:1877942638533504:0@lo:400: 00000100:00100000:3.0:1790945825.633004:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877942638533632:0@lo:400: 00000100:00100000:3.0:1790945825.633044:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945825.633127:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1877942638534144:0@lo:400: 00000100:00100000:3.0:1790945825.633152:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945825.633312:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638534528 00000100:00100000:1.0:1790945825.633317:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638534528 00000100:00100000:1.0:1790945825.633355:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638535040 00000100:00100000:1.0:1790945825.633359:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638535040 00000100:00100000:1.0:1790945825.633371:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638534400 00000100:00100000:1.0:1790945825.633374:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638534400 00000100:00100000:1.0:1790945825.633387:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638534912 00000100:00100000:1.0:1790945825.633389:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638534912 00000100:00100000:1.0:1790945825.633418:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790945825.633424:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4db0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638534528:12345-0@lo:400: 00000100:00100000:1.0:1790945825.633465:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4db0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638534528:12345-0@lo:400: Request processed in 42us (1637us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945825.633471:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790945825.633483:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790945825.633488:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4db3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638535040:12345-0@lo:400: 00000100:00100000:1.0:1790945825.633512:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4db3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638535040:12345-0@lo:400: Request processed in 24us (1651us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945825.633517:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790945825.633528:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790945825.633534:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4db1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638534400:12345-0@lo:400: 00000100:00100000:1.0:1790945825.633560:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4db1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638534400:12345-0@lo:400: Request processed in 27us (1625us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945825.633566:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790945825.633577:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790945825.633582:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4db1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638534912:12345-0@lo:400: 00000100:00100000:1.0:1790945825.633609:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4db1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638534912:12345-0@lo:400: Request processed in 27us (1648us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945825.633614:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1790945825.633633:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790945825.633636:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790945825.633658:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcb17b80 x1877942638534400/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945825.633671:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638534400:0@lo:400: 00010000:00080000:1.0:1790945825.633681:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcb3b100 x1877942638534912/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945825.633695:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638534912:0@lo:400: 00010000:00080000:1.0:1790945825.633707:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f825a5180 x1877942638534528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945825.633714:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638534528:0@lo:400: 00010000:00080000:1.0:1790945825.633723:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcb3a300 x1877942638535040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945825.633730:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638535040:0@lo:400: 00000100:00100000:1.0:1790945825.633766:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638533760:0@lo:400: 00000100:00100000:1.0:1790945825.633793:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945825.633815:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1877942638534272:0@lo:400: 00000100:00100000:1.0:1790945825.633839:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638533760 00000100:00100000:1.0:1790945825.633842:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638533760 00000100:00100000:1.0:1790945825.633870:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790945825.633876:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638533760:12345-0@lo:400: 00000100:00100000:1.0:1790945825.633927:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638533760:12345-0@lo:400: Request processed in 50us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945825.633933:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790945825.640770:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1877942638534656:0@lo:400: 00000100:00100000:3.0:1790945825.640844:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945825.641009:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638533888 00000100:00100000:2.0:1790945825.641019:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638533888 00000100:00100000:2.0:1790945825.641073:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638533632 00000100:00100000:2.0:1790945825.641090:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638533632 00000100:00100000:2.0:1790945825.641105:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638534144 00000100:00100000:2.0:1790945825.641108:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638534144 00000100:00100000:2.0:1790945825.641134:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790945825.641158:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4db3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1877942638533888:12345-0@lo:400: 00000100:00100000:2.0:1790945825.641236:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4db3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1877942638533888:12345-0@lo:400: Request processed in 80us (9329us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945825.641242:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790945825.641273:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790945825.641279:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877942638533632:12345-0@lo:400: 00000100:00100000:2.0:1790945825.641319:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877942638533632:12345-0@lo:400: Request processed in 39us (8274us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945825.641325:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790945825.641337:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790945825.641343:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877942638534144:12345-0@lo:400: 00000100:00100000:2.0:1790945825.641372:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877942638534144:12345-0@lo:400: Request processed in 29us (8218us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945825.641377:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1790945825.641397:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790945825.641433:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1877942638533888:0@lo:400: 00000100:00100000:3.0:1790945825.651412:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638535168:0@lo:13: 00000100:00100000:3.0:1790945825.651508:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945825.651584:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877942638533632:0@lo:400: 00000100:00100000:3.0:1790945825.651598:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1877942638534144:0@lo:400: 00000100:00100000:3.0:1790945825.651651:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638535168 00000100:00100000:3.0:1790945825.651658:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638535168 00000100:00100000:3.0:1790945825.651706:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790945825.651714:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638535168:12345-0@lo:13: 00002000:00000024:3.0:1790945825.651744:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790945825.651788:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638535168:12345-0@lo:13: Request processed in 74us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945825.651796:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790945825.651839:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945825.651866:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1877942638534784:0@lo:400: 00000100:00100000:3.0:1790945825.651920:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945825.651933:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638535296:0@lo:13: 00000100:00100000:3.0:1790945825.651953:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945825.651992:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638533760:0@lo:400: 00000100:00100000:3.0:1790945825.652009:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638535296 00000100:00100000:3.0:1790945825.652012:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638535296 00000100:00100000:3.0:1790945825.652031:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790945825.652036:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638535296:12345-0@lo:13: 00002000:00000024:3.0:1790945825.652046:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790945825.652071:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638535296:12345-0@lo:13: Request processed in 35us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945825.652077:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790945825.652096:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638534656 00000100:00100000:3.0:1790945825.652101:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638534656 00000100:00100000:3.0:1790945825.652129:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638534272 00000100:00100000:3.0:1790945825.652131:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638534272 00000100:00100000:3.0:1790945825.652142:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638534784 00000100:00100000:3.0:1790945825.652144:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638534784 00000100:00100000:3.0:1790945825.652155:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790945825.652161:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1877942638534656:12345-0@lo:400: 00000100:00100000:3.0:1790945825.652214:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1877942638534656:12345-0@lo:400: Request processed in 53us (11371us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945825.652220:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790945825.652231:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790945825.652236:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1877942638534272:12345-0@lo:400: 00000100:00100000:2.0:1790945825.652895:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790945825.652908:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877942638534784:12345-0@lo:400: 00000100:00080000:1.0:1790945825.653130:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790945825.653135:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790945825.653161:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcbbdf80 x1877942638535296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945841 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945825.653193:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638535296:0@lo:13: 00010000:00080000:1.0:1790945825.653226:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcb3a680 x1877942638535168/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945841 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945825.653252:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638535168:0@lo:13: 00000100:00100000:1.0:1790945825.653282:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1877942638534656:0@lo:400: 00000100:00100000:2.0:1790945825.654589:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877942638534784:12345-0@lo:400: Request processed in 1678us (2659us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945825.654604:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:1.0:1790945825.654712:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcb38000 x1877942638534784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945825.654726:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1877942638534784:0@lo:400: 00000100:00100000:3.0:1790945825.654964:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1877942638534272:12345-0@lo:400: Request processed in 2725us (3122us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945825.654972:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1790945825.655037:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcb17800 x1877942638534272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945825.655047:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1877942638534272:0@lo:400: 00000100:00100000:3.0:1790945826.050026:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945826.050207:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616462208 00000100:00100000:0.0:1790945826.050219:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616462208 00000100:00100000:0.0:1790945826.050301:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 199 00000100:00100000:0.0:1790945826.050312:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087035850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+8:6173:x1877942616462208:12345-192.168.204.20@tcp:101: 00010000:00010000:0.0:1790945826.050332:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945826.050366:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d4086a4c400/0xd9f4181e0d27d153 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330a09 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945826.050395:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d4086a4c400/0xd9f4181e0d27d153 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a09 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945826.050406:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d4086a4c400/0xd9f4181e0d27d153 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a09 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945826.050433:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4086a4c400, rc 0) 00000100:00100000:0.0:1790945826.050497:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087035850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+9:6173:x1877942616462208:12345-192.168.204.20@tcp:101: Request processed in 186us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945826.050504:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 199 00000100:00100000:0.0:1790945826.057299:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945826.057419:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616462336 00000100:00100000:2.0:1790945826.057430:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616462336 00000100:00100000:2.0:1790945826.057485:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 200 00000100:00100000:2.0:1790945826.057495:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+9:6173:x1877942616462336:12345-192.168.204.20@tcp:501: 00000100:00100000:2.0:1790945826.057680:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+9:6173:x1877942616462336:12345-192.168.204.20@tcp:501: Request processed in 185us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945826.057688:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 200 00000100:00100000:3.0:1790945826.061645:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945826.061865:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616462464 00000100:00100000:2.0:1790945826.061875:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616462464 00000100:00100000:2.0:1790945826.062059:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 201 00000100:00100000:2.0:1790945826.062068:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+9:6173:x1877942616462464:12345-192.168.204.20@tcp:503: 00000100:00100000:2.0:1790945826.063409:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+9:6173:x1877942616462464:12345-192.168.204.20@tcp:503: Request processed in 1334us (1824us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945826.063424:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 201 00000100:00100000:3.0:1790945826.067473:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945826.068088:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616462592 00000100:00100000:0.0:1790945826.068100:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616462592 00000100:00100000:0.0:1790945826.068163:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 202 00000100:00100000:0.0:1790945826.068197:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087033050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+9:6648:x1877942616462592:12345-192.168.204.20@tcp:502: 00000100:00100000:0.0:1790945826.068358:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087033050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+9:6648:x1877942616462592:12345-192.168.204.20@tcp:502: Request processed in 162us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945826.068367:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 202 00000100:00100000:0.0:1790945826.083594:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945826.084671:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616462720 00000100:00100000:2.0:1790945826.084685:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616462720 00000100:00100000:2.0:1790945826.084750:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 203 00000100:00100000:2.0:1790945826.084868:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+9:6648:x1877942616462720:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790945826.085437:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+9:6648:x1877942616462720:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 487us (1662us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945826.085449:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 203 00000100:00100000:1.0:1790945826.090780:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945826.097110:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616462848 00000100:00100000:3.0:1790945826.097139:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616462848 00000100:00100000:3.0:1790945826.097251:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 204 00000100:00100000:3.0:1790945826.097262:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+9:6173:x1877942616462848:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790945826.097289:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945826.097310:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40baef0400/0xd9f4181e0d27d15a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330a10 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945826.097341:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40baef0400/0xd9f4181e0d27d15a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a10 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945826.097353:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40baef0400/0xd9f4181e0d27d15a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a10 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945826.097363:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40baef0400, rc 0) 00000100:00100000:3.0:1790945826.097439:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:6173:x1877942616462848:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 178us (6680us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945826.097446:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 204 00000100:00100000:3.0:1790945826.103366:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945826.103944:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616462976 00000100:00100000:2.0:1790945826.103955:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616462976 00000100:00100000:2.0:1790945826.104010:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 205 00000100:00100000:2.0:1790945826.104020:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:6173:x1877942616462976:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790945826.104154:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:6173:x1877942616462976:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 135us (799us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790945826.104162:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 205 00010000:00010000:2.0:1790945826.271689:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945826.372653:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945826.372697:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945826.372727:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945826.372758:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945826.372793:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616463360 00000100:00100000:0.0:1790945826.372803:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616463360 00000100:00100000:0.0:1790945826.372858:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616463488 00000100:00100000:0.0:1790945826.372861:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616463488 00000100:00100000:0.0:1790945826.372889:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:0.0:1790945826.372900:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2402:x1877942616463360:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790945826.372971:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2402:x1877942616463360:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 73us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945826.372997:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:0.0:1790945826.373015:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 20 00000100:00100000:0.0:1790945826.373021:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2402:x1877942616463488:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790945826.373046:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2402:x1877942616463488:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 25us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945826.373053:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 20 00000100:00080000:1.0:1790945826.373376:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790945826.373381:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790945826.373394:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616463104 00000100:00100000:1.0:1790945826.373398:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616463104 00000100:00100000:1.0:1790945826.373447:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616463232 00000100:00100000:1.0:1790945826.373451:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616463232 00000100:00100000:1.0:1790945826.373472:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 59 00000100:00100000:1.0:1790945826.373479:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2402:x1877942616463104:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945826.373514:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2402:x1877942616463104:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 36us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945826.373520:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 59 00000100:00100000:1.0:1790945826.373534:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 60 00000100:00100000:1.0:1790945826.373540:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2402:x1877942616463232:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945826.373561:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2402:x1877942616463232:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 22us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945826.373575:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 60 00000100:00080000:0.0:1790945826.373899:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790945826.373903:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:2.0:1790945826.528042:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1790945826.528051:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d3f8248e800 from 48 10000000:01000000:2.0:1790945826.528057:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790945826.528117:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4080030800/0xd9f4181e0d27d161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945826.528129:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d4080030800/0xd9f4181e0d27d161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945826.528140:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d4080030800/0xd9f4181e0d27d161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945826.528193:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4db1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638535424:0@lo:101: 00000100:00100000:2.0:1790945826.528266:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945826.528326:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bcac83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945826.530115:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638535424 00000100:00100000:3.0:1790945826.530131:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638535424 00000100:00100000:3.0:1790945826.530221:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1790945826.530232:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087031050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+15:6519:x1877942638535424:12345-0@lo:101: 00010000:00010000:3.0:1790945826.530248:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945826.530277:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40baef1e00/0xd9f4181e0d27d168 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27d161 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945826.530309:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40baef1e00/0xd9f4181e0d27d168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27d161 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945826.530335:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40baef1e00/0xd9f4181e0d27d168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d161 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945826.530344:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40baef1e00, rc 0) 00000100:00100000:3.0:1790945826.530422:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087031050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:6519:x1877942638535424:12345-0@lo:101: Request processed in 191us (2155us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945826.530429:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1790945826.530497:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4db1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638535424:0@lo:101: 00010000:00010000:3.0:1790945826.530517:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d4080030800/0xd9f4181e0d27d161 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d168 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945826.530527:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d4080030800/0xd9f4181e0d27d161 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d168 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945826.530605:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638535552:0@lo:501: 00000100:00100000:3.0:1790945826.530637:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945826.530667:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4092bb36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945826.530680:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638535552 00000100:00100000:3.0:1790945826.530685:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638535552 00000100:00100000:3.0:1790945826.530708:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1790945826.530714:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:6519:x1877942638535552:12345-0@lo:501: 00000100:00100000:3.0:1790945826.530836:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:6519:x1877942638535552:12345-0@lo:501: Request processed in 122us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945826.530843:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1790945826.530874:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638535552:0@lo:501: 00000100:00100000:3.0:1790945826.530901:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638535680:0@lo:503: 00000100:00100000:3.0:1790945826.530945:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945826.530956:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4092bb36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945826.530966:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638535680 00000100:00100000:3.0:1790945826.530969:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638535680 00000100:00100000:3.0:1790945826.530986:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1790945826.530991:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087032450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:6519:x1877942638535680:12345-0@lo:503: 00000100:00100000:3.0:1790945826.531078:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087032450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:6519:x1877942638535680:12345-0@lo:503: Request processed in 86us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945826.531085:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1790945826.531124:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638535680:0@lo:503: 00000100:00100000:3.0:1790945826.531334:0:10356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbb2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10356:1877942638535808:0@lo:502: 00000100:00100000:3.0:1790945826.531367:0:10356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945826.531385:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638535808 00000100:00100000:3.0:1790945826.531389:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638535808 00000100:00100000:3.0:1790945826.531410:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1790945826.531416:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:10356:x1877942638535808:12345-0@lo:502: 00000100:00100000:3.0:1790945826.531487:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:10356:x1877942638535808:12345-0@lo:502: Request processed in 70us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945826.531493:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1790945826.531527:0:10356:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40925b6300 going to sleep for 11 seconds 00000100:00100000:3.0:1790945826.531538:0:10356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbb2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10356:1877942638535808:0@lo:502: 00000100:00100000:3.0:1790945826.531568:0:10356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbb2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10356:1877942638535936:0@lo:502: 00000100:00100000:3.0:1790945826.531595:0:10356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945826.531613:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638535936 00000100:00100000:3.0:1790945826.531617:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638535936 00000100:00100000:3.0:1790945826.531635:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1790945826.531646:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:10356:x1877942638535936:12345-0@lo:502: 00000100:00100000:3.0:1790945826.531695:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:10356:x1877942638535936:12345-0@lo:502: Request processed in 49us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945826.531701:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1790945826.531727:0:10356:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40925b6300 going to sleep for 11 seconds 00000100:00100000:3.0:1790945826.531737:0:10356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbb2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10356:1877942638535936:0@lo:502: 00000040:00080000:3.0:1790945826.531754:0:10356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1790945826.531802:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1790945826.531818:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790945826.531826:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4080030800/0xd9f4181e0d27d161 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d168 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945826.531836:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d4080030800/0xd9f4181e0d27d161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d168 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790945826.531845:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1790945826.531848:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1790945826.531850:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1790945826.531869:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef0600/0xd9f4181e0d27d16f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945826.531877:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40baef0600/0xd9f4181e0d27d16f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945826.531885:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40baef0600/0xd9f4181e0d27d16f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945826.531896:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638536064:0@lo:101: 00000100:00100000:3.0:1790945826.531922:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945826.531943:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40925b6300 going to sleep for 11 seconds 00000100:00100000:3.0:1790945826.531961:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638536064 00000100:00100000:3.0:1790945826.531965:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638536064 00000100:00100000:3.0:1790945826.531985:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1790945826.531991:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+16:6519:x1877942638536064:12345-0@lo:101: 00010000:00010000:3.0:1790945826.531999:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945826.532010:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40baef1800/0xd9f4181e0d27d176 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27d16f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945826.532027:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40baef1800/0xd9f4181e0d27d176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27d16f expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945826.532037:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40baef1800/0xd9f4181e0d27d176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d16f expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945826.532044:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40baef1800, rc 0) 00000100:00100000:3.0:1790945826.532072:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:6519:x1877942638536064:12345-0@lo:101: Request processed in 81us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945826.532077:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1790945826.532106:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638536064:0@lo:101: 00010000:00010000:3.0:1790945826.532117:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40baef0600/0xd9f4181e0d27d16f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d176 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945826.532124:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40baef0600/0xd9f4181e0d27d16f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d176 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945826.532161:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638536192:0@lo:501: 00000100:00100000:3.0:1790945826.532215:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945826.532234:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40925b6300 going to sleep for 11 seconds 00000100:00100000:3.0:1790945826.532250:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638536192 00000100:00100000:3.0:1790945826.532253:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638536192 00000100:00100000:3.0:1790945826.532287:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1790945826.532294:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087031850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:6519:x1877942638536192:12345-0@lo:501: 00000100:00100000:3.0:1790945826.532381:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087031850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:6519:x1877942638536192:12345-0@lo:501: Request processed in 87us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945826.532387:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1790945826.532416:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638536192:0@lo:501: 00000100:00100000:3.0:1790945826.532437:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638536320:0@lo:503: 00000100:00100000:3.0:1790945826.532468:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945826.532480:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40925b6300 going to sleep for 11 seconds 00000100:00100000:3.0:1790945826.532490:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638536320 00000100:00100000:3.0:1790945826.532493:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638536320 00000100:00100000:2.0:1790945826.532533:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1790945826.532541:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:6519:x1877942638536320:12345-0@lo:503: 00000100:00100000:2.0:1790945826.532618:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:6519:x1877942638536320:12345-0@lo:503: Request processed in 78us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945826.534755:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638536320:0@lo:503: 00000100:00100000:2.0:1790945826.538286:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1790945826.554046:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbb2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10357:1877942638536448:0@lo:502: 00000100:00100000:2.0:1790945826.554201:0:10357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945826.554241:0:10357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bcac83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945826.557263:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638536448 00000100:00100000:3.0:1790945826.557291:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638536448 00000100:00100000:3.0:1790945826.557372:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1790945826.557386:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:10357:x1877942638536448:12345-0@lo:502: 00000100:00100000:3.0:1790945826.557575:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:10357:x1877942638536448:12345-0@lo:502: Request processed in 191us (3373us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945826.557583:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1790945826.557992:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbb2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10357:1877942638536448:0@lo:502: 00000020:01000000:2.0:1790945826.558029:0:10357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790945826.558041:0:10357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945826.558044:0:10357:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790945826.558049:0:10357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1790945826.558092:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4db2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10357:1877942638536576:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790945826.558165:0:10357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945826.558214:0:10357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d409103cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1790945826.560258:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638536576 00000100:00100000:3.0:1790945826.560284:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638536576 00000100:00100000:3.0:1790945826.560356:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1790945826.560367:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087033c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:10357:x1877942638536576:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790945826.560533:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087033c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:10357:x1877942638536576:12345-0@lo:502:llog_process_th.0 Request processed in 168us (2367us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945826.560548:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1790945826.562976:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4db2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10357:1877942638536576:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790945826.563029:0:10357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790945826.563039:0:10357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945826.563042:0:10357:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790945826.563046:0:10357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:3.0:1790945826.563205:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1790945826.563231:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1790945826.563243:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef0600/0xd9f4181e0d27d16f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d176 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945826.563255:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40baef0600/0xd9f4181e0d27d16f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d176 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945826.563401:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1790945826.563404:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d40bc9be000 from 48 10000000:01000000:2.0:1790945826.563408:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790945826.563441:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4080030400/0xd9f4181e0d27d17d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945826.563450:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d4080030400/0xd9f4181e0d27d17d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945826.563459:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d4080030400/0xd9f4181e0d27d17d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945826.563481:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4db2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638536704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790945826.563542:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945826.563573:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d409103cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1790945826.563753:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638536704 00000100:00100000:0.0:1790945826.563786:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638536704 00000100:00100000:0.0:1790945826.563831:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1790945826.563866:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af617450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+17:6519:x1877942638536704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790945826.563880:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945826.563894:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d4086a4c800/0xd9f4181e0d27d184 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27d17d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945826.563919:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d4086a4c800/0xd9f4181e0d27d184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27d17d expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945826.563930:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d4086a4c800/0xd9f4181e0d27d184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d17d expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945826.563938:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4086a4c800, rc 0) 00000100:00100000:0.0:1790945826.563984:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af617450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:6519:x1877942638536704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945826.563991:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1790945826.564063:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4db2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638536704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790945826.564076:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d4080030400/0xd9f4181e0d27d17d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d184 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945826.564086:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d4080030400/0xd9f4181e0d27d17d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d184 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945826.564194:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4db2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638536832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790945826.564221:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945826.564238:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d409103cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1790945826.565826:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638536832 00000100:00100000:3.0:1790945826.565841:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638536832 00000100:00100000:3.0:1790945826.565902:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1790945826.565912:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af614050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:6519:x1877942638536832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790945826.566081:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af614050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:6519:x1877942638536832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 171us (1859us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945826.566089:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1790945826.566235:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4db2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638536832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790945826.566308:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb38700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638536960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790945826.566356:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945826.566384:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f82612c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790945826.566393:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638536960 00000100:00100000:3.0:1790945826.566398:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638536960 00000100:00100000:3.0:1790945826.566429:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1790945826.566437:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af614450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:6519:x1877942638536960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790945826.566577:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af614450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:6519:x1877942638536960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945826.566584:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1790945826.566656:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb38700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638536960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790945826.566994:0:10358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4db0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10358:1877942638537088:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790945826.567033:0:10358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945826.567072:0:10358:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d409103c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790945826.567124:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638537088 00000100:00100000:0.0:1790945826.567129:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638537088 00000100:00100000:0.0:1790945826.567193:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1790945826.567201:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af615850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:10358:x1877942638537088:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790945826.567303:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af615850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:10358:x1877942638537088:12345-0@lo:502:llog_process_th.0 Request processed in 102us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945826.567310:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1790945826.567467:0:10358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4db0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10358:1877942638537088:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790945826.567510:0:10358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4db0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10358:1877942638537216:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790945826.567546:0:10358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945826.567575:0:10358:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d409103c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945826.568021:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638537216 00000100:00100000:3.0:1790945826.568026:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638537216 00000100:00100000:3.0:1790945826.568066:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1790945826.568073:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af614c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:10358:x1877942638537216:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790945826.568187:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af614c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:10358:x1877942638537216:12345-0@lo:502:llog_process_th.0 Request processed in 113us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945826.568194:0:10358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4db0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10358:1877942638537216:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790945826.568202:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000040:00080000:2.0:1790945826.568217:0:10358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1790945826.568380:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1790945826.568403:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790945826.568412:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4080030400/0xd9f4181e0d27d17d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d184 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945826.568424:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d4080030400/0xd9f4181e0d27d17d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d184 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790945826.568433:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1790945826.568436:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1790945826.568439:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1790945826.568467:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef0c00/0xd9f4181e0d27d18b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945826.568475:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40baef0c00/0xd9f4181e0d27d18b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945826.568485:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40baef0c00/0xd9f4181e0d27d18b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945826.568498:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbb0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638537344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790945826.568528:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945826.568559:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40925b69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790945826.568799:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638537344 00000100:00100000:1.0:1790945826.568805:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638537344 00000100:00100000:1.0:1790945826.568842:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1790945826.568850:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af616c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+18:6519:x1877942638537344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790945826.568871:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945826.568884:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40c21d7600/0xd9f4181e0d27d192 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27d18b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945826.569106:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40c21d7600/0xd9f4181e0d27d192 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27d18b expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945826.569122:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40c21d7600/0xd9f4181e0d27d192 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d18b expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945826.569132:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40c21d7600, rc 0) 00000100:00100000:1.0:1790945826.569202:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af616c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+19:6519:x1877942638537344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 352us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945826.569209:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1790945826.569248:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbb0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638537344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790945826.569262:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40baef0c00/0xd9f4181e0d27d18b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d192 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945826.569283:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40baef0c00/0xd9f4181e0d27d18b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d192 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945826.569339:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638537472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790945826.570464:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945826.570639:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f821f3180 going to sleep for 11 seconds 00000100:00100000:3.0:1790945826.575371:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638537472 00000100:00100000:3.0:1790945826.575389:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638537472 00000100:00100000:3.0:1790945826.575466:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1790945826.575477:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af617c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+19:6519:x1877942638537472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790945826.575674:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af617c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+19:6519:x1877942638537472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 199us (5214us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945826.575698:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1790945826.575820:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638537472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790945826.575887:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638537600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790945826.575946:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945826.575984:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f821f3180 going to sleep for 11 seconds 00000100:00100000:3.0:1790945826.576145:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638537600 00000100:00100000:3.0:1790945826.576150:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638537600 00000100:00100000:3.0:1790945826.576210:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1790945826.576218:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af615450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+19:6519:x1877942638537600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790945826.576318:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af615450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+19:6519:x1877942638537600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945826.576327:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1790945826.576461:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638537600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790945826.576849:0:10360:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10360:1877942638537728:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790945826.576915:0:10360:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945826.576944:0:10360:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f821f3300 going to sleep for 11 seconds 00000100:00100000:3.0:1790945826.576985:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638537728 00000100:00100000:3.0:1790945826.576990:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638537728 00000100:00100000:3.0:1790945826.577031:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1790945826.577038:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af615c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+19:10360:x1877942638537728:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790945826.577125:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af615c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+19:10360:x1877942638537728:12345-0@lo:502:llog_process_th.0 Request processed in 86us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945826.577132:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1790945826.577414:0:10360:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10360:1877942638537728:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790945826.577439:0:10360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790945826.577446:0:10360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790945826.577449:0:10360:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790945826.577453:0:10360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1790945826.577474:0:10360:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10360:1877942638537856:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790945826.577506:0:10360:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945826.577533:0:10360:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f821f3300 going to sleep for 11 seconds 00000100:00100000:3.0:1790945826.577574:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638537856 00000100:00100000:3.0:1790945826.577579:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638537856 00000100:00100000:3.0:1790945826.577610:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1790945826.577616:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af617050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+19:10360:x1877942638537856:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790945826.577680:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af617050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+19:10360:x1877942638537856:12345-0@lo:502:llog_process_th.0 Request processed in 63us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945826.577686:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1790945826.577752:0:10360:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10360:1877942638537856:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790945826.577767:0:10360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790945826.577771:0:10360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790945826.577772:0:10360:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790945826.577776:0:10360:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:3.0:1790945826.578128:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1790945826.578148:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1790945826.578158:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef0c00/0xd9f4181e0d27d18b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d192 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945826.578202:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40baef0c00/0xd9f4181e0d27d18b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d192 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790945826.578214:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1790945826.578216:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d40bacd0800 from 48 10000000:01000000:3.0:1790945826.578219:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790945826.578245:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef1600/0xd9f4181e0d27d199 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945826.578254:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40baef1600/0xd9f4181e0d27d199 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945826.578263:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40baef1600/0xd9f4181e0d27d199 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945826.578289:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbb1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638537984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790945826.578318:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945826.578333:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40baeab3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945826.578344:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638537984 00000100:00100000:3.0:1790945826.578348:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638537984 00000100:00100000:3.0:1790945826.578374:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1790945826.578381:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af614850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+19:6519:x1877942638537984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790945826.578391:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945826.578403:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40baef0200/0xd9f4181e0d27d1a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27d199 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945826.578426:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40baef0200/0xd9f4181e0d27d1a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27d199 expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945826.578448:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40baef0200/0xd9f4181e0d27d1a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d199 expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945826.578458:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40baef0200, rc 0) 00000100:00100000:3.0:1790945826.578498:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af614850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+20:6519:x1877942638537984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945826.578504:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1790945826.579240:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbb1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638537984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790945826.579260:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40baef1600/0xd9f4181e0d27d199 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d1a0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945826.579281:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40baef1600/0xd9f4181e0d27d199 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d1a0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945826.579356:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb38700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638538112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790945826.579391:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945826.579432:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f82612900 going to sleep for 11 seconds 00000100:00100000:1.0:1790945826.579435:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638538112 00000100:00100000:1.0:1790945826.579441:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638538112 00000100:00100000:1.0:1790945826.579488:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1790945826.579495:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af616050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+20:6519:x1877942638538112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790945826.579625:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af616050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+20:6519:x1877942638538112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 131us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945826.579632:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1790945826.579696:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb38700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638538112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790945826.579726:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbb2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638538240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790945826.579765:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945826.579790:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40917c1480 going to sleep for 11 seconds 00000100:00100000:1.0:1790945826.579834:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638538240 00000100:00100000:1.0:1790945826.579838:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638538240 00000100:00100000:1.0:1790945826.581793:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1790945826.581807:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af616850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+20:6519:x1877942638538240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790945826.581951:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af616850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+20:6519:x1877942638538240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (2184us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945826.581959:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1790945826.583151:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbb2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638538240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790945826.585521:0:10361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10361:1877942638538368:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790945826.585613:0:10361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945826.585664:0:10361:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f821f3780 going to sleep for 11 seconds 00000100:00100000:2.0:1790945826.585733:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638538368 00000100:00100000:2.0:1790945826.585740:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638538368 00000100:00100000:2.0:1790945826.585785:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1790945826.585792:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af615050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+20:10361:x1877942638538368:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790945826.585929:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af615050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+20:10361:x1877942638538368:12345-0@lo:502:llog_process_th.0 Request processed in 136us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945826.585942:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1790945826.586047:0:10361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10361:1877942638538368:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790945826.586091:0:10361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10361:1877942638538496:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790945826.586123:0:10361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945826.586148:0:10361:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f821f3780 going to sleep for 11 seconds 00000100:00100000:2.0:1790945826.586195:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638538496 00000100:00100000:2.0:1790945826.586206:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638538496 00000100:00100000:2.0:1790945826.586233:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1790945826.586240:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af617850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+20:10361:x1877942638538496:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790945826.586332:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af617850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+20:10361:x1877942638538496:12345-0@lo:502:llog_process_th.0 Request processed in 92us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945826.586339:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1790945826.586385:0:10361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10361:1877942638538496:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1790945826.586404:0:10361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1790945826.586683:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1790945826.586707:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790945826.586721:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef1600/0xd9f4181e0d27d199 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d1a0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945826.586733:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40baef1600/0xd9f4181e0d27d199 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d1a0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945826.586743:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1790945826.586746:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:2.0:1790945826.586748:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1790945826.586770:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4080031e00/0xd9f4181e0d27d1a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945826.586777:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d4080031e00/0xd9f4181e0d27d1a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945826.586786:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d4080031e00/0xd9f4181e0d27d1a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945826.586799:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4db0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638538624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790945826.586824:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945826.586852:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40925b60c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790945826.587073:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638538624 00000100:00100000:1.0:1790945826.587078:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638538624 00000100:00100000:1.0:1790945826.587122:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1790945826.587129:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af616450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+20:6519:x1877942638538624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790945826.587139:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945826.587151:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40c21d6400/0xd9f4181e0d27d1ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27d1a7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945826.587196:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40c21d6400/0xd9f4181e0d27d1ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27d1a7 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945826.587206:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40c21d6400/0xd9f4181e0d27d1ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d1a7 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945826.587215:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40c21d6400, rc 0) 00000100:00100000:1.0:1790945826.588847:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af616450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:6519:x1877942638538624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1712us (2015us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945826.588870:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1790945826.592248:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4db0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638538624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790945826.592288:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d4080031e00/0xd9f4181e0d27d1a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d1ae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945826.592373:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d4080031e00/0xd9f4181e0d27d1a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d1ae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945826.592474:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4db0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638538752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790945826.592532:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945826.592577:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40925b60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945826.593476:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638538752 00000100:00100000:3.0:1790945826.593485:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638538752 00000100:00100000:3.0:1790945826.593537:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1790945826.593546:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:6519:x1877942638538752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790945826.593695:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:6519:x1877942638538752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 149us (1162us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945826.593703:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1790945826.594010:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4db0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638538752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790945826.594057:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb3bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638538880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790945826.594101:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945826.594141:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f82612300 going to sleep for 11 seconds 00000100:00100000:1.0:1790945826.594213:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638538880 00000100:00100000:1.0:1790945826.594218:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638538880 00000100:00100000:1.0:1790945826.594241:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1790945826.594248:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:6519:x1877942638538880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790945826.594340:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:6519:x1877942638538880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945826.594347:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1790945826.594484:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb3bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638538880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790945826.594754:0:10363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb3bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10363:1877942638539008:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790945826.594785:0:10363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945826.594810:0:10363:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f82612900 going to sleep for 11 seconds 00000100:00100000:1.0:1790945826.594846:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638539008 00000100:00100000:1.0:1790945826.594850:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638539008 00000100:00100000:1.0:1790945826.594968:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1790945826.594976:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:10363:x1877942638539008:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790945826.595063:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:10363:x1877942638539008:12345-0@lo:502:llog_process_th.0 Request processed in 87us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945826.595075:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1790945826.595343:0:10363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb3bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10363:1877942638539008:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790945826.595366:0:10363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790945826.595376:0:10363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945826.595379:0:10363:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1790945826.595385:0:10363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1790945826.595407:0:10363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb3bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10363:1877942638539136:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790945826.595442:0:10363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945826.595459:0:10363:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f82612900 going to sleep for 11 seconds 00000100:00100000:1.0:1790945826.595519:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638539136 00000100:00100000:1.0:1790945826.595523:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638539136 00000100:00100000:1.0:1790945826.595588:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1790945826.595595:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:10363:x1877942638539136:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790945826.595670:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:10363:x1877942638539136:12345-0@lo:502:llog_process_th.0 Request processed in 75us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945826.595677:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1790945826.602193:0:10363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb3bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10363:1877942638539136:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790945826.602246:0:10363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790945826.602258:0:10363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945826.602261:0:10363:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1790945826.602278:0:10363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:1.0:1790945826.602501:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:1.0:1790945826.602532:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1790945826.602543:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4080031e00/0xd9f4181e0d27d1a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d1ae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945826.602555:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d4080031e00/0xd9f4181e0d27d1a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d1ae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945826.602565:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1790945826.602568:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d4087223000 from 48 10000000:01000000:1.0:1790945826.602571:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790945826.602607:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6c00/0xd9f4181e0d27d1b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945826.602615:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6c00/0xd9f4181e0d27d1b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945826.602624:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6c00/0xd9f4181e0d27d1b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945826.602646:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638539264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790945826.602720:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945826.602764:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f821f3540 going to sleep for 11 seconds 00000100:00100000:3.0:1790945826.604314:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638539264 00000100:00100000:3.0:1790945826.604328:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638539264 00000100:00100000:3.0:1790945826.604417:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1790945826.604428:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:6519:x1877942638539264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790945826.604447:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945826.604463:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40baef0000/0xd9f4181e0d27d1bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27d1b5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945826.604516:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40baef0000/0xd9f4181e0d27d1bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27d1b5 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945826.604527:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40baef0000/0xd9f4181e0d27d1bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d1b5 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945826.604535:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40baef0000, rc 0) 00000100:00100000:3.0:1790945826.604611:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:6519:x1877942638539264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (1891us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945826.604618:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1790945826.605837:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638539264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790945826.605864:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6c00/0xd9f4181e0d27d1b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d1bc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945826.605876:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6c00/0xd9f4181e0d27d1b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d1bc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945826.605977:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbb0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638539392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790945826.606031:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945826.606084:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4088c76f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790945826.606084:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638539392 00000100:00100000:0.0:1790945826.606093:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638539392 00000100:00100000:0.0:1790945826.606137:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1790945826.606146:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:6519:x1877942638539392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790945826.613497:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:6519:x1877942638539392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 7340us (7454us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945826.613514:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1790945826.613543:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbb0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638539392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790945826.613746:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbb0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638539520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790945826.613831:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945826.614233:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4088c76f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790945826.614251:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638539520 00000100:00100000:0.0:1790945826.614275:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638539520 00000100:00100000:0.0:1790945826.614330:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1790945826.614338:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:6519:x1877942638539520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790945826.614578:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:6519:x1877942638539520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 239us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945826.614585:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1790945826.614640:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbb0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638539520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790945826.615436:0:10364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbb0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10364:1877942638539648:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790945826.616689:0:10364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945826.616791:0:10364:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4088c76840 going to sleep for 11 seconds 00000100:00100000:0.0:1790945826.618131:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638539648 00000100:00100000:0.0:1790945826.618146:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638539648 00000100:00100000:3.0:1790945826.618301:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1790945826.618315:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:10364:x1877942638539648:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790945826.618491:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:10364:x1877942638539648:12345-0@lo:502:llog_process_th.0 Request processed in 179us (1808us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945826.618500:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1790945826.618785:0:10364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbb0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10364:1877942638539648:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790945826.619017:0:10364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb3bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10364:1877942638539776:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790945826.619062:0:10364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945826.619102:0:10364:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f82612cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945826.619160:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638539776 00000100:00100000:3.0:1790945826.619191:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638539776 00000100:00100000:3.0:1790945826.619223:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1790945826.619231:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:10364:x1877942638539776:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790945826.619327:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:10364:x1877942638539776:12345-0@lo:502:llog_process_th.0 Request processed in 96us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945826.619334:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1790945826.619344:0:10364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb3bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10364:1877942638539776:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1790945826.619363:0:10364:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1790945826.621857:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1790945826.621897:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790945826.622064:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6c00/0xd9f4181e0d27d1b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d1bc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945826.622087:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6c00/0xd9f4181e0d27d1b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d1bc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945826.622277:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1790945826.622281:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:2.0:1790945826.622284:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1790945826.622384:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4080030c00/0xd9f4181e0d27d1c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945826.622394:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d4080030c00/0xd9f4181e0d27d1c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945826.622404:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d4080030c00/0xd9f4181e0d27d1c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945826.622443:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4db1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638539904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790945826.622503:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945826.622551:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40925b6540 going to sleep for 11 seconds 00000100:00100000:3.0:1790945826.622628:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638539904 00000100:00100000:3.0:1790945826.622637:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638539904 00000100:00100000:3.0:1790945826.622688:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1790945826.622696:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:6519:x1877942638539904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790945826.622709:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945826.622722:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40baef1400/0xd9f4181e0d27d1ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27d1c3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945826.622748:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40baef1400/0xd9f4181e0d27d1ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27d1c3 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945826.622773:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40baef1400/0xd9f4181e0d27d1ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d1c3 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945826.622782:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40baef1400, rc 0) 00000100:00100000:3.0:1790945826.622835:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:6519:x1877942638539904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945826.622842:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1790945826.623048:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4db1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638539904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790945826.623065:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d4080030c00/0xd9f4181e0d27d1c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d1ca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945826.623076:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d4080030c00/0xd9f4181e0d27d1c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d1ca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945826.623136:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb3b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638540032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790945826.623165:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945826.623214:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f82612300 going to sleep for 11 seconds 00000100:00100000:3.0:1790945826.623349:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638540032 00000100:00100000:3.0:1790945826.623354:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638540032 00000100:00100000:3.0:1790945826.623386:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1790945826.623393:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:6519:x1877942638540032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790945826.623510:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:6519:x1877942638540032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945826.623518:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1790945826.623615:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb3b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638540032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790945826.623642:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb3b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638540160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790945826.623682:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945826.623707:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f82612300 going to sleep for 11 seconds 00000100:00100000:2.0:1790945826.624371:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638540160 00000100:00100000:2.0:1790945826.624378:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638540160 00000100:00100000:2.0:1790945826.624417:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1790945826.624425:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:6519:x1877942638540160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790945826.624534:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:6519:x1877942638540160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945826.624542:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1790945826.624557:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb3b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638540160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790945826.628048:0:10365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4db2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10365:1877942638540288:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790945826.628332:0:10365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945826.628413:0:10365:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40925b60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945826.628449:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638540288 00000100:00100000:3.0:1790945826.628456:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638540288 00000100:00100000:3.0:1790945826.629667:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1790945826.629685:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:10365:x1877942638540288:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790945826.630067:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:10365:x1877942638540288:12345-0@lo:502:llog_process_th.0 Request processed in 380us (1725us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945826.630075:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1790945826.630300:0:10365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4db2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10365:1877942638540288:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790945826.630333:0:10365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790945826.630341:0:10365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945826.630343:0:10365:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790945826.630348:0:10365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1790945826.630377:0:10365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4db2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10365:1877942638540416:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790945826.630414:0:10365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945826.630498:0:10365:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d409103cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1790945826.630676:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638540416 00000100:00100000:3.0:1790945826.630682:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638540416 00000100:00100000:3.0:1790945826.630728:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1790945826.630735:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:10365:x1877942638540416:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790945826.630852:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:10365:x1877942638540416:12345-0@lo:502:llog_process_th.0 Request processed in 117us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945826.630859:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1790945826.631161:0:10365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4db2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10365:1877942638540416:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790945826.631213:0:10365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790945826.631219:0:10365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945826.631225:0:10365:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790945826.631230:0:10365:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1790945826.631760:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:1.0:1790945826.631792:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1790945826.631804:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4080030c00/0xd9f4181e0d27d1c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d1ca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945826.631816:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d4080030c00/0xd9f4181e0d27d1c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d1ca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945826.631828:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1790945826.631831:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9d40af68cd40 from 1 10000000:01000000:1.0:1790945826.631834:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790945826.631867:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7400/0xd9f4181e0d27d1d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945826.631876:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7400/0xd9f4181e0d27d1d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945826.631885:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7400/0xd9f4181e0d27d1d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945826.631902:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638540544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790945826.631943:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945826.631985:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f821f3900 going to sleep for 11 seconds 00000100:00100000:0.0:1790945826.632125:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638540544 00000100:00100000:0.0:1790945826.632132:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638540544 00000100:00100000:0.0:1790945826.632294:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1790945826.632303:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:6519:x1877942638540544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790945826.632316:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945826.632328:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d4086a4d800/0xd9f4181e0d27d1d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27d1d1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945826.632350:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d4086a4d800/0xd9f4181e0d27d1d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27d1d1 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945826.632359:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d4086a4d800/0xd9f4181e0d27d1d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d1d1 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945826.632367:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4086a4d800, rc 0) 00000100:00100000:0.0:1790945826.632449:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:6519:x1877942638540544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945826.632456:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1790945826.634806:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638540544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790945826.634853:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7400/0xd9f4181e0d27d1d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d1d8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945826.634863:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7400/0xd9f4181e0d27d1d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d1d8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945826.634949:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638540672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790945826.635002:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945826.635113:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f821f3900 going to sleep for 11 seconds 00000100:00100000:0.0:1790945826.635382:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638540672 00000100:00100000:0.0:1790945826.635390:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638540672 00000100:00100000:1.0:1790945826.635793:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1790945826.635803:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:6519:x1877942638540672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790945826.635942:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:6519:x1877942638540672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (939us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790945826.635950:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1790945826.636014:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638540672:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1790945826.636049:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1790945826.636056:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7400/0xd9f4181e0d27d1d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d1d8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945826.636068:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7400/0xd9f4181e0d27d1d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d1d8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1790945827.146618:0:10395:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffda635f40 20000000:00000080:3.0:1790945827.146635:0:10395:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d3f81bd4800 uarg=0000000000000000 20000000:01000000:3.0:1790945827.146680:0:10395:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1790945827.146685:0:10395:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1790945827.146690:0:10395:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1790945827.147874:0:10396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1790945827.148053:0:10395:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1790945827.157771:0:10395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1790945827.157804:0:10395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1790945827.157821:0:10395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1790945827.157837:0:10395:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790945827.157857:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d40baef1c00/0xd9f4181e0d27d1df lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945827.157876:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40c21d6600/0xd9f4181e0d27ce7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ce74 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945827.157884:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40c21d7000/0xd9f4181e0d27ce89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ce82 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945827.157891:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d4086a4dc00/0xd9f4181e0d27cedd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ced6 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945827.157913:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27d003 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27cffc expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945827.157922:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40c21d7c00/0xd9f4181e0d27d11b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223309d1 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945827.157951:0:10395:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d40baef1c00/0xd9f4181e0d27d1df lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945827.157995:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40c21d7c00/0xd9f4181e0d27d11b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223309d1 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945827.158013:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40c21d7c00/0xd9f4181e0d27d11b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223309d1 expref: 9 pid: 6515 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945827.158030:0:10395:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbb3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1877942638540800:192.168.204.20@tcp:104: 00010000:00010000:3.0:1790945827.158149:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27d003 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27cffc expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945827.158158:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27d003 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27cffc expref: 23 pid: 6514 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945827.158189:0:10395:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbb0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1877942638540928:0@lo:104: 00000100:00100000:3.0:1790945827.158247:0:10395:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790945827.158294:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d4086a4dc00/0xd9f4181e0d27cedd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27ced6 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945827.158302:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d4086a4dc00/0xd9f4181e0d27cedd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27ced6 expref: 23 pid: 6516 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945827.158310:0:10395:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbb1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1877942638541056:0@lo:104: 00000100:00100000:3.0:1790945827.158334:0:10395:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790945827.158367:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40c21d7000/0xd9f4181e0d27ce89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27ce82 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945827.158385:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40c21d7000/0xd9f4181e0d27ce89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27ce82 expref: 23 pid: 6516 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945827.158386:0:6505:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1790945827.158394:0:10395:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbb0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1877942638541184:0@lo:104: 00000100:00100000:1.0:1790945827.158400:0:6505:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638540928 00000100:00100000:1.0:1790945827.158407:0:6505:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638540928 00000100:00100000:3.0:1790945827.158415:0:10395:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945827.158442:0:6505:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638541056 00010000:00010000:3.0:1790945827.158445:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40c21d6600/0xd9f4181e0d27ce7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27ce74 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945827.158445:0:6505:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638541056 00010000:00010000:3.0:1790945827.158454:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40c21d6600/0xd9f4181e0d27ce7b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27ce74 expref: 23 pid: 6515 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945827.158454:0:6505:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638541184 00000100:00100000:1.0:1790945827.158456:0:6505:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638541184 00000100:00100000:3.0:1790945827.158463:0:10395:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83645880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1877942638541312:0@lo:104: 00000100:00100000:1.0:1790945827.158467:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790945827.158476:0:6505:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+5:10395:x1877942638540928:12345-0@lo:104: 00000100:00100000:3.0:1790945827.158481:0:10395:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790945827.158487:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d40baef0a00/0xd9f4181e0d27cffc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27d003 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945827.158491:0:10395:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bb141900 going to sleep for 11 seconds 00010000:00010000:1.0:1790945827.158545:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790945827.158552:0:6505:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+5:10395:x1877942638540928:12345-0@lo:104: Request processed in 77us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945827.158564:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790945827.158581:0:6505:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638541312 00000100:00100000:1.0:1790945827.158584:0:6505:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638541312 00000100:00100000:1.0:1790945827.158596:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790945827.158600:0:6505:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bfe64850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+5:10395:x1877942638541056:12345-0@lo:104: 00010000:00010000:1.0:1790945827.158607:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6000/0xd9f4181e0d27ced6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27cedd expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.158640:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790945827.158645:0:6505:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bfe64850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+5:10395:x1877942638541056:12345-0@lo:104: Request processed in 45us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945827.158652:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790945827.158682:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790945827.158688:0:6505:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+4:10395:x1877942638541184:12345-0@lo:104: 00010000:00010000:1.0:1790945827.158695:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6a00/0xd9f4181e0d27ce82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27ce89 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.158736:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1790945827.158742:0:6505:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+4:10395:x1877942638541184:12345-0@lo:104: Request processed in 54us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945827.158748:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790945827.158760:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790945827.158765:0:6505:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83646a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+3:10395:x1877942638541312:12345-0@lo:104: 00010000:00010000:1.0:1790945827.158773:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d000/0xd9f4181e0d27ce74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27ce7b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.158811:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1790945827.158821:0:6505:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83646a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+3:10395:x1877942638541312:12345-0@lo:104: Request processed in 56us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945827.158827:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1790945827.158847:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1790945827.158853:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40baef0a00/0xd9f4181e0d27cffc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27d003 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.158859:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef0a00 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:1.0:1790945827.158863:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40baef0a00/0xd9f4181e0d27cffc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27d003 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.158872:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40baef0a00/0xd9f4181e0d27cffc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27d003 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790945827.158879:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40baef0a00/0xd9f4181e0d27cffc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27d003 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945827.158886:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790945827.158910:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40baef0a00/0xd9f4181e0d27cffc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d003 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.158917:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790945827.158936:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40baef0a00/0xd9f4181e0d27cffc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d003 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.158943:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40baef0a00/0xd9f4181e0d27cffc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d003 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.158957:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790945827.158961:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6000/0xd9f4181e0d27ced6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27cedd expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.158975:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d6000 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:1.0:1790945827.158977:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6000/0xd9f4181e0d27ced6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27cedd expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.158983:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6000/0xd9f4181e0d27ced6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27cedd expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790945827.158989:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6000/0xd9f4181e0d27ced6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27cedd expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945827.158993:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790945827.159007:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6000/0xd9f4181e0d27ced6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cedd expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.159012:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790945827.159019:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6000/0xd9f4181e0d27ced6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cedd expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.159025:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6000/0xd9f4181e0d27ced6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27cedd expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.159034:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790945827.159036:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6a00/0xd9f4181e0d27ce82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27ce89 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.159042:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d6a00 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:1.0:1790945827.159044:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6a00/0xd9f4181e0d27ce82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27ce89 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945827.159060:0:10395:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbb0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1877942638540928:0@lo:104: 00010000:00010000:1.0:1790945827.159060:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6a00/0xd9f4181e0d27ce82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27ce89 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790945827.159066:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6a00/0xd9f4181e0d27ce82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27ce89 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945827.159069:0:10395:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbb1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1877942638541056:0@lo:104: 10000000:01000000:1.0:1790945827.159073:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1790945827.159075:0:10395:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbb0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1877942638541184:0@lo:104: 00000100:00100000:3.0:1790945827.159081:0:10395:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83645880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1877942638541312:0@lo:104: 00010000:00010000:1.0:1790945827.159085:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6a00/0xd9f4181e0d27ce82 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ce89 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.159091:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790945827.159123:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6a00/0xd9f4181e0d27ce82 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ce89 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.159130:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6a00/0xd9f4181e0d27ce82 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ce89 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.159138:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790945827.159141:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d000/0xd9f4181e0d27ce74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27ce7b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.159505:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4086a4d000 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:1.0:1790945827.159509:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d000/0xd9f4181e0d27ce74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27ce7b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.159517:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d000/0xd9f4181e0d27ce74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27ce7b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790945827.159523:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d000/0xd9f4181e0d27ce74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27ce7b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945827.159536:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790945827.159552:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d000/0xd9f4181e0d27ce74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ce7b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.159559:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790945827.159565:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d000/0xd9f4181e0d27ce74 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ce7b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.159572:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d000/0xd9f4181e0d27ce74 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ce7b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.159586:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945827.159588:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945827.159590:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945827.159597:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945827.159608:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638541440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790945827.159643:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790945827.159653:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945827.159663:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8841fcfb-fb47-4307-92c2-97500c1c82bd:3648:1877942638541568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790945827.159677:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638541824:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790945827.159690:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945827.159906:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638541440 00000100:00100000:1.0:1790945827.159912:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638541440 00010000:00010000:1.0:1790945827.159937:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27d003 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27cffc expref: 24 pid: 6514 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945827.159962:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638541568 00000100:00100000:1.0:1790945827.159965:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638541568 00010000:00010000:1.0:1790945827.159976:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d4086a4dc00/0xd9f4181e0d27cedd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27ced6 expref: 25 pid: 6516 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945827.159993:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790945827.160005:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8841fcfb-fb47-4307-92c2-97500c1c82bd+25:3647:x1877942638541440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790945827.160016:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945827.160021:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27d003 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27cffc expref: 25 pid: 6514 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.160030:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27d003 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27cffc expref: 25 pid: 6514 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.160042:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27d003 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27cffc expref: 25 pid: 6514 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.160054:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945827.160120:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790945827.160128:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4db2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3648:x1877942638541568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790945827.160136:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945827.160141:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d4086a4dc00/0xd9f4181e0d27cedd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27ced6 expref: 24 pid: 6516 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945827.160150:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d4086a4dc00/0xd9f4181e0d27cedd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27ced6 expref: 24 pid: 6516 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945827.160160:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d4086a4dc00/0xd9f4181e0d27cedd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27ced6 expref: 24 pid: 6516 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945827.160190:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945827.160288:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:3647:x1877942638541440:12345-0@lo:103:ldlm_bl.0 Request processed in 283us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945827.160295:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790945827.160309:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638541696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790945827.160333:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638541440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790945827.160339:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945827.160957:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638541696 00000100:00100000:1.0:1790945827.160964:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638541696 00010000:00010000:1.0:1790945827.160984:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40c21d7000/0xd9f4181e0d27ce89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27ce82 expref: 23 pid: 6516 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945827.161005:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790945827.161012:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83644a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:3649:x1877942638541696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790945827.161020:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945827.161024:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40c21d7000/0xd9f4181e0d27ce89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27ce82 expref: 23 pid: 6516 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.161032:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40c21d7000/0xd9f4181e0d27ce89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27ce82 expref: 23 pid: 6516 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.161053:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40c21d7000/0xd9f4181e0d27ce89 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27ce82 expref: 23 pid: 6516 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.161064:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945827.161104:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83644a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:3649:x1877942638541696:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945827.161110:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790945827.161141:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638541696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790945827.163401:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945827.164441:0:10395:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbb3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1877942638540800:192.168.204.20@tcp:104: 00010000:00010000:3.0:1790945827.164476:0:10395:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d40baef1c00/0xd9f4181e0d27d1df lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945827.164949:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4db2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:3648:x1877942638541568:12345-0@lo:103:ldlm_bl.0 Request processed in 4820us (5256us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945827.164962:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790945827.164991:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638541824 00000100:00100000:2.0:1790945827.164997:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638541824 00010000:00010000:2.0:1790945827.165024:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40c21d6600/0xd9f4181e0d27ce7b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27ce74 expref: 21 pid: 6515 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945827.165098:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8841fcfb-fb47-4307-92c2-97500c1c82bd:3648:1877942638541568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790945827.166866:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790945827.166891:0:7471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4096cbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:3650:x1877942638541824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790945827.166920:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945827.166929:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40c21d6600/0xd9f4181e0d27ce7b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27ce74 expref: 21 pid: 6515 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.166943:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40c21d6600/0xd9f4181e0d27ce7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27ce74 expref: 21 pid: 6515 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.166962:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40c21d6600/0xd9f4181e0d27ce7b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27ce74 expref: 21 pid: 6515 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.166979:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945827.167613:0:7471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4096cbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8841fcfb-fb47-4307-92c2-97500c1c82bd+20:3650:x1877942638541824:12345-0@lo:103:ldlm_bl.0 Request processed in 732us (4216us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945827.167623:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790945827.168244:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638541824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790945827.168512:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945827.169670:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616463616 00000100:00100000:1.0:1790945827.169683:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616463616 00010000:00010000:1.0:1790945827.169868:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40c21d7c00/0xd9f4181e0d27d11b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223309d1 expref: 10 pid: 6515 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945827.169931:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 39 00000100:00100000:1.0:1790945827.169942:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:2404:x1877942616463616:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790945827.169959:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945827.169965:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40c21d7c00/0xd9f4181e0d27d11b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223309d1 expref: 10 pid: 6515 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.169977:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40c21d7c00/0xd9f4181e0d27d11b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223309d1 expref: 10 pid: 6515 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.169995:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40c21d7c00/0xd9f4181e0d27d11b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223309d1 expref: 10 pid: 6515 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.170013:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d40baef1c00/0xd9f4181e0d27d1df lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.170021:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40baef1c00/0xd9f4181e0d27d1df lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.170035:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d40baef1c00/0xd9f4181e0d27d1df lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.170042:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d40baef1c00/0xd9f4181e0d27d1df lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.170049:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d40baef1c00/0xd9f4181e0d27d1df lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.170056:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d40baef1c00/0xd9f4181e0d27d1df lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.170073:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef1c00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:1.0:1790945827.170077:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d40baef1c00/0xd9f4181e0d27d1df lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.170084:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d40baef1c00/0xd9f4181e0d27d1df lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.170100:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d40baef1c00/0xd9f4181e0d27d1df lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.170110:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945827.170189:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+9:2404:x1877942616463616:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 226us (1656us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945827.170198:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 39 00010000:00010000:2.0:1790945827.174429:0:10395:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d40baef1c00/0xd9f4181e0d27d1df lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945827.174485:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d40baef1c00/0xd9f4181e0d27d1df lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945827.174493:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40baef1c00/0xd9f4181e0d27d1df lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.295970:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945827.561988:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945827.562330:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616463744 00000100:00100000:1.0:1790945827.562344:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616463744 00000100:00100000:1.0:1790945827.562411:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 248 00000100:00100000:1.0:1790945827.562422:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408397d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+9:6173:x1877942616463744:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790945827.562440:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945827.562461:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40c21d7c00/0xd9f4181e0d27d1e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330a17 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.562491:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40c21d7c00/0xd9f4181e0d27d1e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a17 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.562501:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40c21d7c00/0xd9f4181e0d27d1e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a17 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945827.562528:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40c21d7c00, rc 0) 00000100:00100000:1.0:1790945827.562593:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408397d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:6173:x1877942616463744:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 173us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945827.562600:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 248 00000100:00100000:1.0:1790945827.579631:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945827.583499:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616463872 00000100:00100000:2.0:1790945827.583519:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616463872 00000100:00100000:2.0:1790945827.583607:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 249 00000100:00100000:2.0:1790945827.583620:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408397fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:6173:x1877942616463872:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790945827.583824:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408397fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:6173:x1877942616463872:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 206us (4203us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945827.583832:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 249 00000100:00100000:3.0:1790945827.591736:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945827.591815:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616464000 00000100:00100000:1.0:1790945827.591825:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616464000 00000100:00100000:1.0:1790945827.591878:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 250 00000100:00100000:1.0:1790945827.591887:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408397e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:6173:x1877942616464000:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790945827.592030:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408397e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:6173:x1877942616464000:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 Request processed in 144us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945827.592038:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 250 00000100:00100000:3.0:1790945827.598102:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945827.599360:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616464128 00000100:00100000:1.0:1790945827.599373:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616464128 00000100:00100000:1.0:1790945827.599466:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 251 00000100:00100000:1.0:1790945827.599476:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a72fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:6705:x1877942616464128:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790945827.599645:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a72fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:6705:x1877942616464128:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 170us (1554us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945827.599654:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 251 00000100:00100000:2.0:1790945827.604654:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945827.604742:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616464256 00000100:00100000:1.0:1790945827.604754:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616464256 00000100:00100000:1.0:1790945827.604861:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 252 00000100:00100000:1.0:1790945827.604873:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a72fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:6705:x1877942616464256:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790945827.605042:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a72fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:6705:x1877942616464256:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 170us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945827.605060:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 252 00000100:00100000:1.0:1790945827.679352:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638541952:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790945827.679410:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638542080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790945827.679421:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945827.679447:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945827.679541:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638541952 00000100:00100000:3.0:1790945827.679549:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638541952 00000100:00100000:3.0:1790945827.679602:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638542080 00000100:00100000:3.0:1790945827.679605:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638542080 00000100:00100000:3.0:1790945827.679625:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790945827.679633:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638541952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790945827.679662:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790945827.679703:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638541952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945827.679710:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790945827.679727:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790945827.679733:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638542080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790945827.679742:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790945827.679771:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638542080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945827.679777:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1790945827.679813:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcb39f80 x1877942638542080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945843 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945827.679831:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638542080:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790945827.679961:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790945827.681242:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcbbe680 x1877942638541952/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945843 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945827.681274:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638541952:0@lo:13:osp-pre-0-1.0 10000000:01000000:0.0:1790945827.936142:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790945827.936152:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d3f8248e800 from 4 10000000:01000000:0.0:1790945827.936158:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790945827.936262:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4086a4dc00/0xd9f4181e0d27d1ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945827.936276:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d4086a4dc00/0xd9f4181e0d27d1ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945827.936288:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d4086a4dc00/0xd9f4181e0d27d1ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945827.936320:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb39880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638542208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790945827.936406:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945827.936469:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40baeab3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945827.936712:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638542208 00000100:00100000:3.0:1790945827.936721:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638542208 00000100:00100000:3.0:1790945827.936782:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1790945827.936791:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a71e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+20:6519:x1877942638542208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790945827.936805:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945827.936828:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40baef0800/0xd9f4181e0d27d1f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27d1ed expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945827.936852:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40baef0800/0xd9f4181e0d27d1f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27d1ed expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945827.936863:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40baef0800/0xd9f4181e0d27d1f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d1ed expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945827.936871:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40baef0800, rc 0) 00000100:00100000:3.0:1790945827.936915:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a71e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:6519:x1877942638542208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945827.936922:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1790945827.937490:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb39880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638542208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790945827.937508:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d4086a4dc00/0xd9f4181e0d27d1ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d1f4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945827.937518:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d4086a4dc00/0xd9f4181e0d27d1ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d1f4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945827.937595:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb39880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638542336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790945827.937628:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945827.937660:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40baeab3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945827.938867:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638542336 00000100:00100000:3.0:1790945827.938890:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638542336 00000100:00100000:3.0:1790945827.938943:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1790945827.938953:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a71e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:6519:x1877942638542336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790945827.939099:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a71e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:6519:x1877942638542336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 148us (1470us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945827.939107:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1790945827.939150:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb39880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638542336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790945827.939228:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83645880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638542464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790945827.939280:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945827.939306:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bb141780 going to sleep for 11 seconds 00000100:00100000:3.0:1790945827.939318:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638542464 00000100:00100000:3.0:1790945827.939323:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638542464 00000100:00100000:3.0:1790945827.939347:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1790945827.939352:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a71e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:6519:x1877942638542464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790945827.939433:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a71e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:6519:x1877942638542464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945827.939440:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1790945827.939481:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83645880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638542464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790945827.939661:0:10421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83645880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10421:1877942638542592:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790945827.939694:0:10421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945827.939712:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638542592 00000100:00100000:3.0:1790945827.939715:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638542592 00000100:00100000:3.0:1790945827.939736:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1790945827.939742:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087036850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:10421:x1877942638542592:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790945827.939806:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087036850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:10421:x1877942638542592:12345-0@lo:502:llog_process_th.0 Request processed in 63us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945827.939812:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1790945827.939840:0:10421:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bb1410c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945827.939852:0:10421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83645880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10421:1877942638542592:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790945827.939871:0:10421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790945827.939880:0:10421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945827.939883:0:10421:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1790945827.939889:0:10421:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d3f8248e800 00000020:00000080:3.0:1790945827.939892:0:10421:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790945827.952746:0:10421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb3aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10421:1877942638542720:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790945827.952836:0:10421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945827.952896:0:10421:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40baeab3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945827.955231:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638542720 00000100:00100000:3.0:1790945827.955255:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638542720 00000100:00100000:3.0:1790945827.955304:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1790945827.955313:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087035050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:10421:x1877942638542720:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790945827.955459:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087035050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:10421:x1877942638542720:12345-0@lo:502:llog_process_th.0 Request processed in 146us (2623us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945827.955472:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1790945827.958468:0:10421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb3aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10421:1877942638542720:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790945827.958519:0:10421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790945827.958527:0:10421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945827.958530:0:10421:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1790945827.958534:0:10421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1790945827.967547:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1790945827.967590:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790945827.967603:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4086a4dc00/0xd9f4181e0d27d1ed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d1f4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945827.967616:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d4086a4dc00/0xd9f4181e0d27d1ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d1f4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945827.967627:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790945827.967631:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d40bc9be000 from 4 10000000:01000000:2.0:1790945827.967634:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790945827.967676:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4080031400/0xd9f4181e0d27d1fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945827.967697:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d4080031400/0xd9f4181e0d27d1fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945827.967716:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d4080031400/0xd9f4181e0d27d1fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945827.967769:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4db0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638542848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790945827.967847:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945827.967904:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40925b60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790945827.970010:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638542848 00000100:00100000:0.0:1790945827.970027:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638542848 00000100:00100000:0.0:1790945827.970091:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1790945827.970101:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087037850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:6519:x1877942638542848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790945827.970118:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945827.970138:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d4086a4d000/0xd9f4181e0d27d202 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27d1fb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945827.970164:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d4086a4d000/0xd9f4181e0d27d202 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27d1fb expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945827.970191:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d4086a4d000/0xd9f4181e0d27d202 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d1fb expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945827.970199:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4086a4d000, rc 0) 00000100:00100000:0.0:1790945827.970314:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087037850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:6519:x1877942638542848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 214us (2467us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945827.970321:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1790945827.976186:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4db0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638542848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790945827.976228:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d4080031400/0xd9f4181e0d27d1fb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d202 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945827.976250:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d4080031400/0xd9f4181e0d27d1fb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d202 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945827.976339:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4db0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638542976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790945827.976407:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945827.976457:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40925b60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945827.976806:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638542976 00000100:00100000:3.0:1790945827.976813:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638542976 00000100:00100000:3.0:1790945827.976866:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1790945827.976875:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087036450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:6519:x1877942638542976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790945827.977418:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087036450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:6519:x1877942638542976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 544us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945827.977427:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1790945827.977472:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4db0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638542976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790945827.977509:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83645880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638543104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790945827.977556:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945827.977612:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bb141d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790945827.985853:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638543104 00000100:00100000:2.0:1790945827.985872:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638543104 00000100:00100000:2.0:1790945827.986725:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1790945827.986736:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087037450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:6519:x1877942638543104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790945827.986914:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087037450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:6519:x1877942638543104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 180us (9356us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945827.986922:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1790945827.987026:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83645880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638543104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790945827.990264:0:10424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbe680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10424:1877942638543232:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790945827.990442:0:10424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945827.990515:0:10424:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f821f3540 going to sleep for 11 seconds 00000100:00100000:1.0:1790945827.990552:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638543232 00000100:00100000:1.0:1790945827.990560:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638543232 00000100:00100000:1.0:1790945827.990643:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1790945827.990654:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087034050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:10424:x1877942638543232:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790945827.990885:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087034050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:10424:x1877942638543232:12345-0@lo:502:llog_process_th.0 Request processed in 233us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945827.990893:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1790945827.992080:0:10424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbe680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10424:1877942638543232:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790945827.992120:0:10424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790945827.992128:0:10424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945827.992131:0:10424:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1790945827.992136:0:10424:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d40bc9be000 00000020:00000080:2.0:1790945827.992139:0:10424:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790945827.992274:0:10424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4db3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10424:1877942638543360:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790945827.992339:0:10424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945827.992373:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638543360 00000100:00100000:2.0:1790945827.992380:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638543360 00000100:00100000:2.0:1790945827.992426:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1790945827.992435:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087034450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:10424:x1877942638543360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790945827.992546:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087034450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:10424:x1877942638543360:12345-0@lo:502:llog_process_th.0 Request processed in 113us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945827.992555:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1790945827.992601:0:10424:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4092bb3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790945827.992615:0:10424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4db3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10424:1877942638543360:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790945827.992634:0:10424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790945827.992638:0:10424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945827.992640:0:10424:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1790945827.992643:0:10424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1790945827.992705:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1790945827.992724:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790945827.992734:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4080031400/0xd9f4181e0d27d1fb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d202 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945827.992756:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d4080031400/0xd9f4181e0d27d1fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d202 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945827.992767:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790945827.992769:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d40bacd0800 from 4 10000000:01000000:2.0:1790945827.992772:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790945827.996526:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4080030a00/0xd9f4181e0d27d209 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945827.996545:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d4080030a00/0xd9f4181e0d27d209 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945827.996557:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d4080030a00/0xd9f4181e0d27d209 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945827.996581:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4db3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638543488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790945827.996652:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945827.996699:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bc8acd80 going to sleep for 11 seconds 00000100:00100000:3.0:1790945827.997344:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638543488 00000100:00100000:3.0:1790945827.997354:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638543488 00000100:00100000:3.0:1790945827.997403:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1790945827.997412:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087035850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:6519:x1877942638543488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790945827.997426:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945827.997440:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40baef1000/0xd9f4181e0d27d210 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27d209 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945827.997465:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40baef1000/0xd9f4181e0d27d210 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27d209 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945827.997477:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40baef1000/0xd9f4181e0d27d210 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d209 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945827.997500:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40baef1000, rc 0) 00000100:00100000:3.0:1790945827.997558:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087035850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:6519:x1877942638543488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945827.997565:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1790945827.997614:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4db3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638543488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790945827.997629:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d4080030a00/0xd9f4181e0d27d209 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d210 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945827.997638:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d4080030a00/0xd9f4181e0d27d209 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d210 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945827.997719:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83645880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638543616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790945827.997745:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945827.997767:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bb141b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790945828.003207:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638543616 00000100:00100000:1.0:1790945828.003220:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638543616 00000100:00100000:1.0:1790945828.003290:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1790945828.003301:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:6519:x1877942638543616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790945828.003483:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:6519:x1877942638543616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 185us (5737us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945828.003491:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1790945828.003796:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83645880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638543616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790945828.003853:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83645880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638543744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790945828.003972:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945828.004129:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bb141b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790945828.005275:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638543744 00000100:00100000:1.0:1790945828.005285:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638543744 00000100:00100000:1.0:1790945828.005337:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1790945828.005357:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:6519:x1877942638543744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790945828.005489:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:6519:x1877942638543744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (1515us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945828.005503:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1790945828.008777:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83645880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638543744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790945828.012415:0:10425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb3aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10425:1877942638543872:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790945828.012509:0:10425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945828.012572:0:10425:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f826120c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945828.013755:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638543872 00000100:00100000:3.0:1790945828.013767:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638543872 00000100:00100000:3.0:1790945828.013813:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1790945828.013822:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087033050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:10425:x1877942638543872:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790945828.013979:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087033050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:10425:x1877942638543872:12345-0@lo:502:llog_process_th.0 Request processed in 157us (1470us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945828.013992:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1790945828.016161:0:10425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb3aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10425:1877942638543872:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790945828.016317:0:10425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790945828.016329:0:10425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945828.016332:0:10425:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790945828.016340:0:10425:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d40bacd0800 00000020:00000080:0.0:1790945828.016343:0:10425:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790945828.018785:0:10425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb3aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10425:1877942638544000:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790945828.018868:0:10425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945828.019417:0:10425:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f826120c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790945828.019721:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638544000 00000100:00100000:1.0:1790945828.019730:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638544000 00000100:00100000:1.0:1790945828.019780:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1790945828.019789:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:10425:x1877942638544000:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790945828.020191:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:10425:x1877942638544000:12345-0@lo:502:llog_process_th.0 Request processed in 401us (1320us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945828.020199:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1790945828.022516:0:10425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb3aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10425:1877942638544000:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790945828.022744:0:10425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790945828.022752:0:10425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945828.022755:0:10425:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1790945828.022760:0:10425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1790945828.023449:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1790945828.023478:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790945828.023490:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4080030a00/0xd9f4181e0d27d209 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d210 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945828.023501:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d4080030a00/0xd9f4181e0d27d209 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d210 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790945828.023512:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790945828.023515:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d4087223000 from 4 10000000:01000000:3.0:1790945828.023518:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790945828.023570:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef1c00/0xd9f4181e0d27d217 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945828.023578:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40baef1c00/0xd9f4181e0d27d217 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945828.023587:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40baef1c00/0xd9f4181e0d27d217 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945828.025362:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83645880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638544128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790945828.025456:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945828.025503:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bb141780 going to sleep for 11 seconds 00000100:00100000:1.0:1790945828.025820:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638544128 00000100:00100000:1.0:1790945828.025905:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638544128 00000100:00100000:1.0:1790945828.025979:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1790945828.025990:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:6519:x1877942638544128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790945828.026005:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945828.026021:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40c21d7000/0xd9f4181e0d27d21e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27d217 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945828.026046:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40c21d7000/0xd9f4181e0d27d21e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27d217 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945828.026056:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40c21d7000/0xd9f4181e0d27d21e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d217 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945828.026065:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40c21d7000, rc 0) 00000100:00100000:1.0:1790945828.026111:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:6519:x1877942638544128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945828.026124:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1790945828.026250:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83645880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638544128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790945828.026270:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40baef1c00/0xd9f4181e0d27d217 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d21e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945828.026279:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40baef1c00/0xd9f4181e0d27d217 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d21e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945828.026355:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638544256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790945828.026383:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945828.026414:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f821f3540 going to sleep for 11 seconds 00000100:00100000:0.0:1790945828.028351:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638544256 00000100:00100000:0.0:1790945828.028365:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638544256 00000100:00100000:0.0:1790945828.028419:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1790945828.028430:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:6519:x1877942638544256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790945828.028609:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:6519:x1877942638544256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 181us (2224us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945828.028618:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1790945828.028790:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638544256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790945828.028840:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638544384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790945828.028888:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945828.028921:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f821f3540 going to sleep for 11 seconds 00000100:00100000:1.0:1790945828.028938:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638544384 00000100:00100000:1.0:1790945828.028942:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638544384 00000100:00100000:1.0:1790945828.028962:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1790945828.028969:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087031050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:6519:x1877942638544384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790945828.029055:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087031050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:6519:x1877942638544384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945828.029061:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1790945828.029105:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638544384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790945828.034556:0:10428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4db3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10428:1877942638544512:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790945828.034651:0:10428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945828.034694:0:10428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bc8accc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790945828.034897:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638544512 00000100:00100000:1.0:1790945828.034911:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638544512 00000100:00100000:1.0:1790945828.034969:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1790945828.034987:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:10428:x1877942638544512:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790945828.035097:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:10428:x1877942638544512:12345-0@lo:502:llog_process_th.0 Request processed in 111us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945828.035104:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1790945828.037726:0:10428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4db3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10428:1877942638544512:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790945828.037771:0:10428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790945828.037795:0:10428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945828.037798:0:10428:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1790945828.037806:0:10428:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d4087223000 00000020:00000080:2.0:1790945828.037809:0:10428:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790945828.039388:0:10428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4db3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10428:1877942638544640:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790945828.039472:0:10428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945828.039521:0:10428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bc8accc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790945828.041076:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638544640 00000100:00100000:2.0:1790945828.041090:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638544640 00000100:00100000:2.0:1790945828.041144:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1790945828.041154:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087032450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:10428:x1877942638544640:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790945828.041328:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087032450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:10428:x1877942638544640:12345-0@lo:502:llog_process_th.0 Request processed in 174us (1856us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945828.041335:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1790945828.041398:0:10428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4db3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:10428:1877942638544640:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790945828.041428:0:10428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790945828.041435:0:10428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945828.041437:0:10428:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1790945828.041441:0:10428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1790945828.041506:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1790945828.041530:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790945828.041539:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef1c00/0xd9f4181e0d27d217 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d21e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945828.041551:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40baef1c00/0xd9f4181e0d27d217 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d21e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945828.325115:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945829.229079:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790945829.229101:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83645500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638544768:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790945829.229208:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945829.229536:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638544768 00000100:00100000:1.0:1790945829.229546:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638544768 00000100:00100000:1.0:1790945829.229609:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790945829.229619:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83646d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638544768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790945829.229656:0:6526:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1790945829.229713:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83646d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638544768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945829.229721:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790945829.229766:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83645500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638544768:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1790945829.353432:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945829.727441:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83644000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638544896:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790945829.727514:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945829.727585:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638544896 00000100:00100000:2.0:1790945829.727594:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638544896 00000100:00100000:2.0:1790945829.727649:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790945829.727658:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638544896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790945829.727694:0:6526:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790945829.727808:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638544896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 150us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945829.727817:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790945829.727890:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83644000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638544896:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1790945830.367608:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945830.751658:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877942638545152:0@lo:400:kworker.0 00000100:00100000:2.0:1790945830.751740:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945830.751807:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4db2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1877942638545664:0@lo:400:kworker.0 00000100:00100000:2.0:1790945830.751829:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945830.751862:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1877942638546176:0@lo:400:kworker.0 00000100:00100000:2.0:1790945830.751882:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945830.751906:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1790945830.751912:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4db3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8841fcfb-fb47-4307-92c2-97500c1c82bd:3648:1877942638545024:0@lo:400:kworker.0 00000100:00100000:2.0:1790945830.751938:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945830.751957:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638545536:0@lo:400:kworker.0 00000100:00100000:2.0:1790945830.751980:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945830.751996:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638546048:0@lo:400:kworker.0 00000100:00100000:2.0:1790945830.752017:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945830.752033:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638546560:0@lo:400:kworker.0 00000100:00100000:2.0:1790945830.752051:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945830.752076:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4db2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638545280:0@lo:400:kworker.0 00000100:00100000:2.0:1790945830.752097:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945830.752113:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4db1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1877942638545792:0@lo:400:kworker.0 00000100:00100000:2.0:1790945830.752132:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945830.752147:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1877942638546304:0@lo:400:kworker.0 00000100:00100000:2.0:1790945830.752163:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945830.752208:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1790945830.752213:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4db1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638545408:0@lo:400:kworker.0 00000100:00100000:2.0:1790945830.752233:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945830.752242:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4db0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638545920:0@lo:400:kworker.0 00000100:00100000:2.0:1790945830.752257:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945830.752273:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638546432:0@lo:400:kworker.0 00000100:00100000:2.0:1790945830.752292:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945830.752320:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790945830.752327:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638545152 00000100:00100000:1.0:1790945830.752329:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638546688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790945830.752336:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638545152 00000100:00100000:1.0:1790945830.752355:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945830.752371:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638545664 00000100:00100000:2.0:1790945830.752374:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638545664 00000100:00100000:1.0:1790945830.752385:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638546176 00000100:00100000:1.0:1790945830.752389:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638546176 00000100:00100000:2.0:1790945830.752395:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638545792 00000100:00100000:2.0:1790945830.752398:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638545792 00000100:00100000:1.0:1790945830.752405:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638546304 00000100:00100000:1.0:1790945830.752407:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638546304 00000100:00100000:2.0:1790945830.752408:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638545408 00000100:00100000:2.0:1790945830.752410:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638545408 00000100:00100000:1.0:1790945830.752422:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790945830.752430:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790945830.752430:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1877942638545152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945830.752435:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1877942638545664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945830.752478:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1877942638545664:12345-0@lo:400:kworker.0 Request processed in 42us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945830.752478:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1877942638545152:12345-0@lo:400:kworker.0 Request processed in 48us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945830.752485:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790945830.752908:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638546688 00000100:00100000:3.0:1790945830.752919:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638546688 00000100:00100000:3.0:1790945830.752947:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790945830.752954:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638546688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790945830.752973:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790945830.753014:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638546688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945830.753021:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790945830.753248:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790945830.753266:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790945830.753273:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1877942638546176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945830.753305:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1877942638546176:12345-0@lo:400:kworker.0 Request processed in 34us (1422us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945830.753311:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790945830.753324:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790945830.753329:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877942638545792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945830.753359:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877942638545792:12345-0@lo:400:kworker.0 Request processed in 30us (1226us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945830.753365:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790945830.753378:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790945830.753384:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877942638546304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945830.753410:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877942638546304:12345-0@lo:400:kworker.0 Request processed in 27us (1246us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945830.753425:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790945830.753437:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790945830.753442:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638545408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945830.753481:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638545536 00000100:00100000:3.0:1790945830.753486:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638545536 00000100:00100000:3.0:1790945830.753587:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638545280 00000100:00100000:3.0:1790945830.753590:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638545280 00000100:00100000:3.0:1790945830.753606:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790945830.753612:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638545536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945830.753964:0:8436:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638546048 00000100:00100000:0.0:1790945830.753969:0:8436:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638546048 00000100:00100000:0.0:1790945830.753996:0:8436:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638546560 00000100:00100000:0.0:1790945830.753999:0:8436:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638546560 00000100:00100000:0.0:1790945830.754009:0:8436:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638545920 00000100:00100000:0.0:1790945830.754011:0:8436:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638545920 00000100:00100000:0.0:1790945830.754021:0:8436:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638546432 00000100:00100000:0.0:1790945830.754023:0:8436:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638546432 00000100:00100000:0.0:1790945830.754035:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790945830.754041:0:8436:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638546048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945830.754141:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790945830.754152:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638546560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945830.754570:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638545536:12345-0@lo:400:kworker.0 Request processed in 956us (2588us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945830.754580:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790945830.754598:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790945830.754605:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638545280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945830.754638:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638545280:12345-0@lo:400:kworker.0 Request processed in 34us (2540us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945830.754644:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790945830.754664:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790945830.754671:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638545920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945830.754699:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638545920:12345-0@lo:400:kworker.0 Request processed in 29us (2440us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945830.754704:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790945830.754716:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790945830.754732:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4cef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638546432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945830.754760:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4cef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638546432:12345-0@lo:400:kworker.0 Request processed in 29us (2468us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945830.754766:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790945830.754931:0:8436:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638546048:12345-0@lo:400:kworker.0 Request processed in 888us (2911us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945830.754938:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790945830.754958:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638545024 00000100:00100000:0.0:1790945830.754963:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638545024 00000100:00100000:0.0:1790945830.754995:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1790945830.755002:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3648:x1877942638545024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945830.755034:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3648:x1877942638545024:12345-0@lo:400:kworker.0 Request processed in 33us (3095us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945830.755040:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00010000:00080000:0.0:1790945830.755103:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcbbc380 x1877942638546688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945846 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945830.755127:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638546688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790945830.755156:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790945830.755200:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638546816:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790945830.755234:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945830.755512:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638546816 00000100:00100000:3.0:1790945830.755518:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638546816 00000100:00100000:3.0:1790945830.755552:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790945830.755559:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638546816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790945830.755573:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790945830.755612:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638546816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945830.755619:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1790945830.755645:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcb3aa00 x1877942638546816/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945846 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945830.755659:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638546816:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790945830.756286:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4db3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8841fcfb-fb47-4307-92c2-97500c1c82bd:3648:1877942638545024:0@lo:400:kworker.0 00000100:00100000:0.0:1790945830.756439:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638545536:0@lo:400:kworker.0 00010000:00080000:0.0:1790945830.756459:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40b4db3800 x1877942638546048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945830.756467:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638546048:0@lo:400:kworker.0 00000100:00100000:0.0:1790945830.756479:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877942638545152:0@lo:400:kworker.0 00000100:00100000:0.0:1790945830.756489:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4db2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1877942638545664:0@lo:400:kworker.0 00000100:00100000:0.0:1790945830.756502:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1877942638546176:0@lo:400:kworker.0 00000100:00100000:2.0:1790945830.760909:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638545408:12345-0@lo:400:kworker.0 Request processed in 7454us (8661us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945830.760926:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1790945830.761002:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790945830.761009:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790945830.761012:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790945830.761015:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790945830.763498:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638546560:12345-0@lo:400:kworker.0 Request processed in 9337us (11432us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945830.763516:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1790945830.763665:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcb14700 x1877942638546560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945830.763684:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638546560:0@lo:400:kworker.0 00000100:00100000:2.0:1790945830.763844:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4db1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638545408:0@lo:400:kworker.0 00010000:00080000:2.0:1790945830.763859:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40b4db0700 x1877942638545920/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945830.763869:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4db0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638545920:0@lo:400:kworker.0 00010000:00080000:2.0:1790945830.763882:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcb15180 x1877942638546432/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945830.763890:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638546432:0@lo:400:kworker.0 00000100:00100000:2.0:1790945830.763901:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4db2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638545280:0@lo:400:kworker.0 00010000:00080000:2.0:1790945830.763913:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40b4db1880 x1877942638545792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945830.763921:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4db1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1877942638545792:0@lo:400:kworker.0 00010000:00080000:2.0:1790945830.763931:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcb14e00 x1877942638546304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945830.763938:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1877942638546304:0@lo:400:kworker.0 00010000:00010000:1.0:1790945831.392639:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945831.493162:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945831.493246:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945831.493274:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945831.493287:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616464512 00000100:00100000:3.0:1790945831.493299:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616464512 00000100:00100000:0.0:1790945831.493302:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945831.493336:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945831.493363:0:8436:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616464768 00000100:00100000:3.0:1790945831.493367:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616464640 00000100:00100000:0.0:1790945831.493369:0:8436:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616464768 00000100:00100000:3.0:1790945831.493373:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616464640 00000100:00100000:3.0:1790945831.493410:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 67 00000100:00100000:0.0:1790945831.493414:0:8436:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616464896 00000100:00100000:0.0:1790945831.493419:0:8436:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616464896 00000100:00100000:3.0:1790945831.493421:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2404:x1877942616464512:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790945831.493462:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 25 00000100:00100000:0.0:1790945831.493473:0:8436:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2404:x1877942616464768:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790945831.493506:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2404:x1877942616464512:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 86us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945831.493514:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 67 00000100:00100000:0.0:1790945831.493522:0:8436:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2404:x1877942616464768:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 49us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945831.493532:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 25 00000100:00100000:3.0:1790945831.493538:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 68 00000100:00100000:3.0:1790945831.493548:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2403:x1877942616464640:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790945831.493553:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 26 00000100:00100000:0.0:1790945831.493565:0:8436:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2403:x1877942616464896:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790945831.493590:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2403:x1877942616464640:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 42us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945831.493598:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 68 00000100:00100000:0.0:1790945831.493604:0:8436:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2403:x1877942616464896:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 39us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945831.493614:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 26 00000100:00080000:3.0:1790945831.493630:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790945831.493635:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790945831.493638:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790945831.493640:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790945831.493710:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616464384 00000100:00100000:1.0:1790945831.493717:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616464384 00000100:00100000:1.0:1790945831.493758:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 274 00000100:00100000:1.0:1790945831.493766:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:2403:x1877942616464384:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945831.493814:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:2403:x1877942616464384:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 48us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945831.493820:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 274 00010000:00010000:1.0:1790945832.415357:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945832.799345:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638546944:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790945832.799416:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945832.799489:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638546944 00000100:00100000:1.0:1790945832.799496:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638546944 00000100:00100000:1.0:1790945832.799553:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790945832.799563:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638546944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790945832.799591:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790945832.799637:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638546944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945832.799644:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1790945832.799663:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790945832.799691:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcbbd500 x1877942638546944/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945848 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945832.799708:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638546944:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790945832.802005:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790945832.802024:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638547072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790945832.802093:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945832.802141:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638547072 00000100:00100000:1.0:1790945832.802183:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638547072 00000100:00100000:1.0:1790945832.802232:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790945832.802240:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638547072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790945832.802260:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790945832.802298:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638547072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945832.802305:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1790945832.802334:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790945832.802358:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcbbd500 x1877942638547072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945848 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945832.802375:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638547072:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1790945833.171978:0:10695:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1790945833.449320:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945834.335324:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790945834.335357:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638547200:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790945834.335430:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945834.335499:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638547200 00000100:00100000:1.0:1790945834.335507:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638547200 00000100:00100000:1.0:1790945834.335553:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790945834.335562:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638547200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790945834.335597:0:6526:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1790945834.335643:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638547200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945834.335651:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790945834.335691:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638547200:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1790945834.465393:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945834.848214:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83647100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638547328:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790945834.848295:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945834.851144:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638547328 00000100:00100000:0.0:1790945834.851159:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638547328 00000100:00100000:0.0:1790945834.851253:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790945834.851265:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638547328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790945834.851301:0:6526:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790945834.861489:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638547328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 10211us (13178us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945834.861505:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790945834.864485:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83647100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638547328:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1790945835.488549:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945835.872993:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4cedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638547456:0@lo:400:kworker.0 00000100:00100000:2.0:1790945835.873101:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945835.873156:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638547968:0@lo:400:kworker.0 00000100:00100000:2.0:1790945835.876975:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945835.877034:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40accd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638548480:0@lo:400:kworker.0 00000100:00100000:2.0:1790945835.877080:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945835.877115:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638548992:0@lo:400:kworker.0 00000100:00100000:2.0:1790945835.877139:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945835.877188:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1790945835.877196:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877942638547840:0@lo:400:kworker.0 00000100:00100000:2.0:1790945835.877221:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945835.877240:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40accd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638548352:0@lo:400:kworker.0 00000100:00100000:2.0:1790945835.877261:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945835.877279:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638548864:0@lo:400:kworker.0 00000100:00100000:2.0:1790945835.877298:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945835.877332:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4cedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638547584:0@lo:400:kworker.0 00000100:00100000:2.0:1790945835.877356:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945835.877376:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1877942638548096:0@lo:400:kworker.0 00000100:00100000:2.0:1790945835.877397:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945835.877416:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1877942638548608:0@lo:400:kworker.0 00000100:00100000:2.0:1790945835.877435:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945835.877454:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1790945835.877460:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4ced500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638547712:0@lo:400:kworker.0 00000100:00100000:2.0:1790945835.877479:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945835.877497:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40accd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1877942638548224:0@lo:400:kworker.0 00000100:00100000:2.0:1790945835.877532:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945835.877543:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1877942638548736:0@lo:400:kworker.0 00000100:00100000:2.0:1790945835.877561:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945835.877708:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638547456 00000100:00100000:2.0:1790945835.877718:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638547456 00000100:00100000:2.0:1790945835.877777:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1790945835.877787:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3650:x1877942638547456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945835.877851:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3650:x1877942638547456:12345-0@lo:400:kworker.0 Request processed in 65us (4751us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945835.877858:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1790945835.877900:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638548480 00000100:00100000:2.0:1790945835.877903:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638548480 00000100:00100000:2.0:1790945835.877935:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638548992 00000100:00100000:2.0:1790945835.877938:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638548992 00000100:00100000:2.0:1790945835.877951:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638548352 00000100:00100000:2.0:1790945835.877953:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638548352 00000100:00100000:2.0:1790945835.877964:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638548864 00000100:00100000:2.0:1790945835.877966:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638548864 00000100:00100000:2.0:1790945835.877978:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790945835.877984:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638548480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945835.878014:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638548480:12345-0@lo:400:kworker.0 Request processed in 31us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945835.878019:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790945835.878031:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790945835.878036:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638548992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945835.878218:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638548992:12345-0@lo:400:kworker.0 Request processed in 181us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945835.878235:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790945835.878250:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790945835.878255:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638548352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945835.878284:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638548352:12345-0@lo:400:kworker.0 Request processed in 29us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945835.878289:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790945835.878301:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790945835.878306:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638548864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945835.878329:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638548864:12345-0@lo:400:kworker.0 Request processed in 24us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945835.878334:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790945835.878355:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638547840 00000100:00100000:2.0:1790945835.878359:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638547840 00000100:00100000:2.0:1790945835.878376:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638547584 00000100:00100000:2.0:1790945835.878378:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638547584 00000100:00100000:2.0:1790945835.878386:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638548096 00000100:00100000:2.0:1790945835.878388:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638548096 00000100:00100000:2.0:1790945835.878398:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638548608 00000100:00100000:2.0:1790945835.878400:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638548608 00000100:00100000:2.0:1790945835.878409:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638548224 00000100:00100000:2.0:1790945835.878411:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638548224 00000100:00100000:2.0:1790945835.878420:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638548736 00000100:00100000:2.0:1790945835.878423:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638548736 00000100:00100000:2.0:1790945835.878432:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790945835.878438:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877942638547840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945835.878467:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877942638547840:12345-0@lo:400:kworker.0 Request processed in 29us (1245us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945835.878472:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790945835.878490:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790945835.878495:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638547584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945835.878528:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638547584:12345-0@lo:400:kworker.0 Request processed in 32us (1170us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945835.878533:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790945835.878544:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790945835.878550:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1877942638548096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945835.878652:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1877942638548096:12345-0@lo:400:kworker.0 Request processed in 101us (1252us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945835.878658:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790945835.878671:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790945835.878677:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1877942638548608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945835.878704:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1877942638548608:12345-0@lo:400:kworker.0 Request processed in 28us (1268us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945835.878709:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790945835.878781:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790945835.878790:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1877942638548224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945835.878818:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1877942638548224:12345-0@lo:400:kworker.0 Request processed in 30us (1286us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945835.878824:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790945835.878836:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790945835.878841:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1877942638548736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945835.878866:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1877942638548736:12345-0@lo:400:kworker.0 Request processed in 26us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945835.878871:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790945835.878915:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638547968 00000100:00100000:2.0:1790945835.878919:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638547968 00000100:00100000:2.0:1790945835.878941:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638547712 00000100:00100000:2.0:1790945835.878944:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638547712 00000100:00100000:2.0:1790945835.878955:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790945835.878960:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638547968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945835.878993:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638547968:12345-0@lo:400:kworker.0 Request processed in 33us (2028us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945835.878999:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790945835.879012:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790945835.879017:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638547712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945835.879043:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638547712:12345-0@lo:400:kworker.0 Request processed in 26us (1563us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945835.879049:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1790945835.879263:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790945835.879268:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790945835.879271:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790945835.879273:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790945835.879307:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4ced500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638547712:0@lo:400:kworker.0 00010000:00080000:2.0:1790945835.879320:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40accd2680 x1877942638548224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945835.879331:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40accd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1877942638548224:0@lo:400:kworker.0 00010000:00080000:2.0:1790945835.879341:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f8265e300 x1877942638548736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945835.879350:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1877942638548736:0@lo:400:kworker.0 00000100:00100000:2.0:1790945835.879360:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4cedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638547584:0@lo:400:kworker.0 00000100:00100000:2.0:1790945835.879382:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1877942638548096:0@lo:400:kworker.0 00000100:00100000:2.0:1790945835.879391:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1877942638548608:0@lo:400:kworker.0 00000100:00100000:2.0:1790945835.879458:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877942638547840:0@lo:400:kworker.0 00010000:00080000:2.0:1790945835.879471:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40accd2300 x1877942638548352/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945835.879480:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40accd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638548352:0@lo:400:kworker.0 00010000:00080000:2.0:1790945835.879492:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f8265e680 x1877942638548864/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945835.879500:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638548864:0@lo:400:kworker.0 00000100:00100000:2.0:1790945835.879512:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4cedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638547456:0@lo:400:kworker.0 00000100:00100000:2.0:1790945835.879522:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638547968:0@lo:400:kworker.0 00010000:00080000:2.0:1790945835.879533:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40accd0e00 x1877942638548480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945835.879541:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40accd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638548480:0@lo:400:kworker.0 00010000:00080000:2.0:1790945835.879552:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f8265c380 x1877942638548992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945835.879559:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638548992:0@lo:400:kworker.0 00000100:00100000:1.0:1790945835.879967:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638549120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790945835.880013:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945835.880798:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638549120 00000100:00100000:0.0:1790945835.880807:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638549120 00000100:00100000:0.0:1790945835.880876:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790945835.880885:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638549120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790945835.880915:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790945835.880969:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638549120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945835.880976:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1790945835.881025:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcb3bb80 x1877942638549120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945851 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945835.881041:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638549120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790945835.881849:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790945835.881861:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638549248:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790945835.881907:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945835.881938:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638549248 00000100:00100000:0.0:1790945835.881943:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638549248 00000100:00100000:0.0:1790945835.881970:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790945835.881977:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638549248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790945835.881992:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790945835.882020:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638549248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945835.882025:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1790945835.882802:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcb3bb80 x1877942638549248/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945851 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945835.882824:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638549248:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1790945836.515061:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945836.610340:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945836.610376:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945836.610408:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945836.610429:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945836.610452:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945836.610481:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616465408 00000100:00100000:3.0:1790945836.610491:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616465408 00000100:00100000:3.0:1790945836.610557:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616465536 00000100:00100000:3.0:1790945836.610561:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616465536 00000100:00100000:3.0:1790945836.610588:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 31 00000100:00100000:3.0:1790945836.610600:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83646680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2403:x1877942616465408:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790945836.610689:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83646680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2403:x1877942616465408:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 91us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945836.610697:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 31 00000100:00100000:3.0:1790945836.610714:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 32 00000100:00100000:3.0:1790945836.610720:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83647800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2403:x1877942616465536:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790945836.610743:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83647800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2403:x1877942616465536:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 23us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945836.610749:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 32 00000100:00100000:3.0:1790945836.610780:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616465024 00000100:00100000:3.0:1790945836.610783:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616465024 00000100:00100000:3.0:1790945836.610809:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 276 00000100:00100000:3.0:1790945836.610815:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087031850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:2403:x1877942616465024:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790945836.610841:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087031850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:2403:x1877942616465024:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 26us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945836.610846:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 276 00000100:00100000:3.0:1790945836.610875:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616465152 00000100:00100000:3.0:1790945836.610879:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616465152 00000100:00100000:3.0:1790945836.610905:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616465280 00000100:00100000:3.0:1790945836.610909:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616465280 00000100:00100000:3.0:1790945836.610929:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 75 00000100:00100000:3.0:1790945836.610935:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2403:x1877942616465152:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790945836.610962:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2403:x1877942616465152:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 28us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945836.610968:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 75 00000100:00100000:3.0:1790945836.610980:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 76 00000100:00100000:3.0:1790945836.610986:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83644380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2403:x1877942616465280:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790945836.611010:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83644380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2403:x1877942616465280:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 24us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945836.611015:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 76 00000100:00080000:3.0:1790945836.611035:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790945836.611039:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790945836.611041:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790945836.611044:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790945837.541361:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945837.923106:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790945837.923143:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638549376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790945837.923263:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945837.923333:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638549376 00000100:00100000:1.0:1790945837.923341:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638549376 00000100:00100000:1.0:1790945837.923406:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790945837.923416:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638549376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790945837.923444:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790945837.923500:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638549376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945837.923509:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1790945837.923548:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcbbc380 x1877942638549376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945853 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945837.923566:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638549376:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790945837.923993:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790945837.926863:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790945837.926912:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638549504:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790945837.926989:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945837.934277:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638549504 00000100:00100000:1.0:1790945837.934292:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638549504 00000100:00100000:1.0:1790945837.934376:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790945837.934386:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638549504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790945837.934413:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790945837.934511:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638549504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 126us (7522us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945837.934518:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1790945837.934559:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcb3bb80 x1877942638549504/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945853 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945837.934578:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638549504:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1790945837.934717:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1790945838.396518:0:10939:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing yml_node 00010000:00010000:1.0:1790945838.560624:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945839.455548:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790945839.455571:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638549632:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790945839.455694:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945839.455762:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638549632 00000100:00100000:1.0:1790945839.455770:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638549632 00000100:00100000:1.0:1790945839.455819:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790945839.455829:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638549632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790945839.455865:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1790945839.455934:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638549632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945839.455942:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790945839.455985:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638549632:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1790945839.583638:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945839.968421:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790945839.984121:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83644e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638549760:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790945839.984215:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945839.985547:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638549760 00000100:00100000:0.0:1790945839.985575:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638549760 00000100:00100000:0.0:1790945839.985784:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790945839.985796:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638549760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790945839.985886:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790945839.988352:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638549760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2551us (4129us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945839.988366:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790945839.988488:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83644e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638549760:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1790945840.609740:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945840.991642:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638549888:0@lo:400:kworker.0 00000100:00100000:2.0:1790945840.991650:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790945840.991684:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638550144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790945840.991734:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945840.991750:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945840.991823:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638550144 00000100:00100000:2.0:1790945840.991834:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638550144 00000100:00100000:2.0:1790945840.991895:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790945840.991906:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638550144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790945840.991936:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790945840.991976:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638550144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945840.991997:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1790945840.992024:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790945840.992051:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638550016:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790945840.992079:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945840.992103:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790945840.992110:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638550400:0@lo:400:kworker.0 00000100:00100000:2.0:1790945840.992139:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945840.992190:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638550400 00000100:00100000:2.0:1790945840.992194:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638550400 00000100:00100000:0.0:1790945840.992214:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790945840.992224:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790945840.992224:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638550272:0@lo:400:kworker.0 00000100:00100000:2.0:1790945840.992231:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638550400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945840.992258:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945840.992269:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638550400:12345-0@lo:400:kworker.0 Request processed in 39us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945840.992276:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638549888 00000100:00100000:2.0:1790945840.992276:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790945840.992283:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638549888 00000100:00100000:2.0:1790945840.992314:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638550400:0@lo:400:kworker.0 00000100:00100000:2.0:1790945840.992340:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638550016 00000100:00100000:2.0:1790945840.992344:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638550016 00010000:00080000:0.0:1790945840.992346:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f8265c380 x1877942638550144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945856 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945840.992367:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1790945840.992375:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790945840.992379:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3649:x1877942638549888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945840.992385:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638550144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790945840.992393:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638550016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790945840.992405:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790945840.992428:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3649:x1877942638549888:12345-0@lo:400:kworker.0 Request processed in 53us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945840.992435:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1790945840.992449:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638550016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945840.992456:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1790945840.992476:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790945840.992480:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638550272 00000100:00100000:3.0:1790945840.992485:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638550272 00010000:00080000:2.0:1790945840.992496:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcb3ad80 x1877942638550016/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945856 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945840.992511:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638550016:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790945840.992518:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1790945840.992527:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638550272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945840.992552:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638549888:0@lo:400:kworker.0 00000100:00100000:3.0:1790945840.992571:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638550272:12345-0@lo:400:kworker.0 Request processed in 44us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945840.992578:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790945840.992599:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638550272:0@lo:400:kworker.0 00000100:00100000:2.0:1790945840.992763:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790945840.992774:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638550528:0@lo:400:kworker.0 00000100:00100000:2.0:1790945840.992825:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945840.992838:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1877942638550784:0@lo:400:kworker.0 00000100:00100000:2.0:1790945840.992850:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1877942638550912:0@lo:400:kworker.0 00000100:00100000:1.0:1790945840.992876:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945840.992909:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1877942638551296:0@lo:400:kworker.0 00000100:00100000:2.0:1790945840.992919:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945840.992951:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945840.992956:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1877942638551424:0@lo:400:kworker.0 00000100:00100000:1.0:1790945840.992978:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1790945840.992994:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945840.993001:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638550656:0@lo:400:kworker.0 00000100:00100000:2.0:1790945840.993012:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790945840.993020:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638551040:0@lo:400:kworker.0 00000100:00100000:2.0:1790945840.993044:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945840.993070:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638551040 00000100:00100000:2.0:1790945840.993073:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638551040 00000100:00100000:2.0:1790945840.993107:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790945840.993116:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638551040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945840.993118:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638550528 00000100:00100000:3.0:1790945840.993124:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638550528 00000100:00100000:3.0:1790945840.993149:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638550784 00000100:00100000:3.0:1790945840.993153:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638550784 00000100:00100000:2.0:1790945840.993198:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638551040:12345-0@lo:400:kworker.0 Request processed in 53us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945840.993206:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790945840.993225:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638550912 00000100:00100000:0.0:1790945840.993230:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638550912 00000100:00100000:2.0:1790945840.993232:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638551296 00000100:00100000:2.0:1790945840.993238:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638551296 00000100:00100000:3.0:1790945840.993258:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638551424 00000100:00100000:0.0:1790945840.993263:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790945840.993264:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638551424 00000100:00100000:0.0:1790945840.993276:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638550528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945840.993326:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638550528:12345-0@lo:400:kworker.0 Request processed in 53us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945840.993412:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945840.993431:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638551168:0@lo:400:kworker.0 00000100:00100000:1.0:1790945840.993457:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945840.993482:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638550656 00000100:00100000:1.0:1790945840.993492:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638550656 00000100:00100000:1.0:1790945840.993519:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790945840.993525:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bfef0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638550656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945840.993561:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bfef0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638550656:12345-0@lo:400:kworker.0 Request processed in 37us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945840.993568:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790945840.993596:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638550656:0@lo:400:kworker.0 00000100:00100000:2.0:1790945840.993649:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1790945840.993658:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1877942638550784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945840.993696:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1877942638550784:12345-0@lo:400:kworker.0 Request processed in 41us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945840.993703:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1790945840.993717:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1790945840.993723:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877942638550912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945840.993750:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877942638550912:12345-0@lo:400:kworker.0 Request processed in 28us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945840.993757:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1790945840.993769:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1790945840.993774:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bfef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1877942638551296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945840.993813:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bfef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1877942638551296:12345-0@lo:400:kworker.0 Request processed in 38us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945840.993819:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:2.0:1790945840.993838:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790945840.993841:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790945840.993844:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790945840.993861:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcbb0a80 x1877942638551040/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945840.993871:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638551040:0@lo:400:kworker.0 00010000:00080000:2.0:1790945840.993891:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcbb3100 x1877942638550912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945840.993900:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1877942638550912:0@lo:400:kworker.0 00000100:00100000:2.0:1790945840.993912:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638550528:0@lo:400:kworker.0 00000100:00100000:2.0:1790945840.993948:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638551168 00000100:00100000:2.0:1790945840.993952:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638551168 00000100:00100000:2.0:1790945840.993982:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790945840.994001:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4f2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638551168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945840.994031:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4f2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638551168:12345-0@lo:400:kworker.0 Request processed in 32us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945840.994037:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790945840.994204:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1790945840.994205:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790945840.994255:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcbb1500 x1877942638551168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945840.994267:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638551168:0@lo:400:kworker.0 00000100:00100000:0.0:1790945840.994280:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1877942638550784:0@lo:400:kworker.0 00000100:00100000:0.0:1790945840.994302:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1877942638551296:0@lo:400:kworker.0 00000100:00100000:3.0:1790945840.994308:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1790945840.994320:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877942638551424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945840.994435:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877942638551424:12345-0@lo:400:kworker.0 Request processed in 119us (1450us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945840.994442:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:2.0:1790945840.994615:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcbb2d80 x1877942638551424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945840.994645:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1877942638551424:0@lo:400:kworker.0 00010000:00010000:1.0:1790945841.631559:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945841.735245:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945841.735406:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945841.735462:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945841.735541:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616465920 00000100:00100000:1.0:1790945841.735553:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616465920 00000100:00100000:1.0:1790945841.735618:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616465792 00000100:00100000:1.0:1790945841.735622:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616465792 00000100:00100000:1.0:1790945841.735649:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 83 00000100:00100000:1.0:1790945841.735659:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83645180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2403:x1877942616465920:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945841.735732:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83645180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2403:x1877942616465920:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 74us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945841.735740:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 83 00000100:00100000:1.0:1790945841.735757:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 84 00000100:00100000:1.0:1790945841.735764:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83644700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2403:x1877942616465792:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945841.735789:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83644700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2403:x1877942616465792:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 26us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945841.735795:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 84 00000100:00080000:3.0:1790945841.735995:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790945841.735999:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790945841.736520:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616465664 00000100:00100000:2.0:1790945841.736636:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616465664 00000100:00100000:2.0:1790945841.736729:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 278 00000100:00100000:2.0:1790945841.736738:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:2403:x1877942616465664:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790945841.736793:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:2403:x1877942616465664:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 55us (1559us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945841.736800:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 278 00000100:00100000:3.0:1790945841.738760:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945841.738818:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945841.739422:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616466048 00000100:00100000:0.0:1790945841.739434:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616466048 00000100:00100000:0.0:1790945841.739565:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616466176 00000100:00100000:0.0:1790945841.739569:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616466176 00000100:00100000:1.0:1790945841.739637:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 18 00000100:00100000:1.0:1790945841.739648:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83647b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2400:x1877942616466048:12345-192.168.204.20@tcp:9:kworker.0 00000020:00000080:1.0:1790945841.739689:0:8435:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27d130 00000100:00080000:1.0:1790945841.739707:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9d3f83704800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790945841.739756:0:8435:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1790945841.739948:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83647b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+2:2400:x1877942616466048:12345-192.168.204.20@tcp:9:kworker.0 Request processed in 302us (1197us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945841.739957:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 18 00010000:00010000:1.0:1790945841.740151:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790945841.740258:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790945841.740263:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790945841.740364:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:0.0:1790945841.740508:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83647480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2400:x1877942616466176:12345-192.168.204.20@tcp:9:kworker.0 00000020:00000080:0.0:1790945841.740608:0:8437:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27d137 00000100:00080000:0.0:1790945841.740618:0:8437:0:(import.c:65:import_set_state_nolock()) ffff9d3f83702800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790945841.740656:0:8437:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1790945841.740883:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83647480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+2:2400:x1877942616466176:12345-192.168.204.20@tcp:9:kworker.0 Request processed in 509us (2062us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945841.740891:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 19 00010000:00010000:3.0:1790945841.740989:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945842.673854:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945843.041522:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638551552:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790945843.041727:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945843.041810:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638551552 00000100:00100000:0.0:1790945843.041819:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638551552 00000100:00100000:0.0:1790945843.043969:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790945843.043994:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638551552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790945843.044028:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790945843.044120:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638551552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 138us (2394us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945843.044128:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1790945843.044160:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790945843.044216:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcb3a300 x1877942638551552/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945859 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945843.044237:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638551552:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790945843.045574:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638551680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790945843.045708:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945843.046709:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638551680 00000100:00100000:2.0:1790945843.046720:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638551680 00000100:00100000:2.0:1790945843.046782:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790945843.046792:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638551680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790945843.046814:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790945843.046872:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638551680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (1164us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945843.046879:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1790945843.049930:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790945843.049990:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40b4d00e00 x1877942638551680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945859 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945843.050014:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638551680:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1790945843.589797:0:11123:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.59.2 00010000:00010000:3.0:1790945843.679803:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945844.576329:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bfef3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638551808:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790945844.576405:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945844.576509:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638551808 00000100:00100000:1.0:1790945844.576518:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638551808 00000100:00100000:1.0:1790945844.576585:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790945844.576595:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638551808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790945844.576632:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1790945844.576679:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638551808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945844.576686:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790945844.577043:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bfef3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638551808:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1790945844.704784:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945845.088047:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83645f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638551936:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790945845.088118:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945845.088271:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638551936 00000100:00100000:2.0:1790945845.088280:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638551936 00000100:00100000:2.0:1790945845.088334:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790945845.088463:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638551936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790945845.088501:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790945845.088556:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638551936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945845.088564:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790945845.088611:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83645f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638551936:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1790945845.729452:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945846.112017:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bfef0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638552064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790945846.112257:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83645c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638552192:0@lo:400:kworker.0 00000100:00100000:3.0:1790945846.112324:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945846.112379:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83644e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638552704:0@lo:400:kworker.0 00000100:00100000:3.0:1790945846.112405:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945846.112423:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83645880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638553216:0@lo:400:kworker.0 00000100:00100000:3.0:1790945846.112443:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945846.112459:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83cd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638553728:0@lo:400:kworker.0 00000100:00100000:3.0:1790945846.112477:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945846.112500:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1790945846.112506:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83645f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638552320:0@lo:400:kworker.0 00000100:00100000:3.0:1790945846.112528:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945846.112547:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83647100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1877942638552832:0@lo:400:kworker.0 00000100:00100000:3.0:1790945846.112566:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945846.112581:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83644a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1877942638553344:0@lo:400:kworker.0 00000100:00100000:3.0:1790945846.112612:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945846.112663:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638552192 00000100:00100000:3.0:1790945846.112671:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638552192 00000100:00100000:3.0:1790945846.112714:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1790945846.112721:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087033c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3647:x1877942638552192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945846.112765:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087033c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3647:x1877942638552192:12345-0@lo:400:kworker.0 Request processed in 44us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945846.112772:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1790945846.112804:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638552704 00000100:00100000:3.0:1790945846.112807:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638552704 00000100:00100000:3.0:1790945846.112832:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790945846.112838:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638552704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945846.112871:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638552704:12345-0@lo:400:kworker.0 Request processed in 34us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945846.112877:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790945846.113740:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945846.113773:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83647800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877942638552576:0@lo:400:kworker.0 00000100:00100000:1.0:1790945846.113797:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945846.113813:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83645500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638553088:0@lo:400:kworker.0 00000100:00100000:1.0:1790945846.113833:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945846.113849:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83cd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638553600:0@lo:400:kworker.0 00000100:00100000:1.0:1790945846.113867:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945846.113896:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1790945846.113904:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83646680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638552448:0@lo:400:kworker.0 00000100:00100000:1.0:1790945846.113942:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945846.113954:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83644000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1877942638552960:0@lo:400:kworker.0 00000100:00100000:1.0:1790945846.113972:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945846.113983:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83cd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1877942638553472:0@lo:400:kworker.0 00000100:00100000:1.0:1790945846.114002:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945846.114488:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638552064 00000100:00100000:2.0:1790945846.114495:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638552064 00000100:00100000:2.0:1790945846.114575:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790945846.114584:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bfef1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638552064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790945846.114624:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790945846.114808:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638552320 00000100:00100000:1.0:1790945846.114812:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638552320 00000100:00100000:1.0:1790945846.114834:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638552832 00000100:00100000:1.0:1790945846.114837:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638552832 00000100:00100000:1.0:1790945846.114849:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638553344 00000100:00100000:1.0:1790945846.114851:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638553344 00000100:00100000:1.0:1790945846.114861:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638552576 00000100:00100000:1.0:1790945846.114863:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638552576 00000100:00100000:1.0:1790945846.114872:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638552960 00000100:00100000:1.0:1790945846.114874:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638552960 00000100:00100000:1.0:1790945846.114895:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638553472 00000100:00100000:1.0:1790945846.114899:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638553472 00000100:00100000:1.0:1790945846.114916:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1790945846.114922:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638552320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945846.114959:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638552320:12345-0@lo:400:kworker.0 Request processed in 37us (2430us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945846.114966:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1790945846.114981:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1790945846.114988:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83cd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1877942638552832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945846.115015:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83cd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1877942638552832:12345-0@lo:400:kworker.0 Request processed in 29us (2448us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945846.115035:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1790945846.115047:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1790945846.115062:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1877942638553344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945846.115093:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1877942638553344:12345-0@lo:400:kworker.0 Request processed in 32us (2480us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945846.115098:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1790945846.115109:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1790945846.115114:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bfef0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877942638552576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945846.115435:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790945846.115445:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bfef1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1877942638552960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945846.115526:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638552448 00000100:00100000:3.0:1790945846.115530:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638552448 00000100:00100000:3.0:1790945846.115553:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790945846.115560:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bfef1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638552448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945846.120407:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bfef1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638552064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5814us (6656us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945846.120442:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790945846.120493:0:10099:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638553216 00000100:00100000:2.0:1790945846.120503:0:10099:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638553216 00000100:00100000:2.0:1790945846.120549:0:10099:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638553728 00000100:00100000:2.0:1790945846.120553:0:10099:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638553728 00000100:00100000:2.0:1790945846.120566:0:10099:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638553088 00000100:00100000:2.0:1790945846.120568:0:10099:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638553088 00000100:00100000:2.0:1790945846.120580:0:10099:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638553600 00000100:00100000:2.0:1790945846.120583:0:10099:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638553600 00000100:00100000:2.0:1790945846.120615:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790945846.120624:0:10099:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638553216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945846.120705:0:10099:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638553216:12345-0@lo:400:kworker.0 Request processed in 82us (8260us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945846.120712:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790945846.120725:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790945846.120731:0:10099:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638553728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945846.120770:0:10099:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638553728:12345-0@lo:400:kworker.0 Request processed in 29us (8281us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945846.120777:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790945846.120789:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790945846.120794:0:10099:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bfef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638553088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945846.120873:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bfef0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877942638552576:12345-0@lo:400:kworker.0 Request processed in 5756us (7072us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945846.120882:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1790945846.120914:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1790945846.120922:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bfef1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877942638553472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945846.120954:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bfef1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877942638553472:12345-0@lo:400:kworker.0 Request processed in 34us (6951us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945846.120960:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1790945846.120988:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790945846.120995:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bfef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638553600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945846.121034:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bfef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638553600:12345-0@lo:400:kworker.0 Request processed in 40us (7165us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945846.121040:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1790945846.121080:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790945846.121084:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790945846.121087:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790945846.121090:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790945846.129336:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bfef1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1877942638552960:12345-0@lo:400:kworker.0 Request processed in 13881us (15350us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945846.129352:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790945846.145634:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bfef1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638552448:12345-0@lo:400:kworker.0 Request processed in 30064us (31680us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945846.145650:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790945846.145706:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bfef2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638553856:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790945846.145780:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945846.145861:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83645f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638552320:0@lo:400:kworker.0 00000100:00100000:3.0:1790945846.145875:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83647100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1877942638552832:0@lo:400:kworker.0 00000100:00100000:3.0:1790945846.145899:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83644a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1877942638553344:0@lo:400:kworker.0 00000100:00100000:3.0:1790945846.145927:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83645c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638552192:0@lo:400:kworker.0 00000100:00100000:3.0:1790945846.145939:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83644e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638552704:0@lo:400:kworker.0 00010000:00080000:3.0:1790945846.145951:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f83645880 x1877942638553216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945846.145962:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83645880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638553216:0@lo:400:kworker.0 00010000:00080000:3.0:1790945846.145972:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f83cd4700 x1877942638553728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945846.145980:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83cd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638553728:0@lo:400:kworker.0 00000100:00100000:3.0:1790945846.146208:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638553856 00000100:00100000:3.0:1790945846.146215:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638553856 00000100:00100000:1.0:1790945846.146348:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83646680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638552448:0@lo:400:kworker.0 00010000:00080000:1.0:1790945846.146370:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f83644000 x1877942638552960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945846.146391:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83644000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1877942638552960:0@lo:400:kworker.0 00010000:00080000:1.0:1790945846.146406:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f83cd4e00 x1877942638553472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945846.146414:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83cd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1877942638553472:0@lo:400:kworker.0 00000100:00100000:1.0:1790945846.146425:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83647800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877942638552576:0@lo:400:kworker.0 00000100:00100000:3.0:1790945846.146459:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790945846.146468:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638553856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790945846.146489:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790945846.146534:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638553856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945846.146540:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1790945846.146567:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bfef2a00 x1877942638553856/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945862 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945846.146582:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bfef2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638553856:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790945846.146774:0:10099:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bfef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638553088:12345-0@lo:400:kworker.0 Request processed in 25977us (32937us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945846.146782:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1790945846.155441:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f83645500 x1877942638553088/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945846.155459:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83645500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638553088:0@lo:400:kworker.0 00010000:00080000:1.0:1790945846.155471:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f83cd5180 x1877942638553600/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945846.155480:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83cd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638553600:0@lo:400:kworker.0 00010000:00080000:1.0:1790945846.155491:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bfef0e00 x1877942638552064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945862 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945846.155506:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bfef0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638552064:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790945846.752620:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945846.863217:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945846.863276:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945846.863305:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945846.863336:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616466432 00000100:00100000:1.0:1790945846.863355:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616466432 00000100:00100000:1.0:1790945846.863450:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616466560 00000100:00100000:1.0:1790945846.863454:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616466560 00000100:00100000:1.0:1790945846.863487:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 91 00000100:00100000:1.0:1790945846.863499:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2403:x1877942616466432:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945846.863678:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2403:x1877942616466432:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 181us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945846.863698:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 91 00000100:00100000:1.0:1790945846.863719:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 92 00000100:00100000:1.0:1790945846.863726:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2403:x1877942616466560:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945846.863754:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2403:x1877942616466560:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 29us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945846.863761:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 92 00000100:00080000:3.0:1790945846.864019:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790945846.864025:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790945846.864205:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616466304 00000100:00100000:2.0:1790945846.864211:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616466304 00000100:00100000:2.0:1790945846.864756:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 280 00000100:00100000:2.0:1790945846.864779:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af617450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:2403:x1877942616466304:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790945846.864837:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af617450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:2403:x1877942616466304:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 66us (1560us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945846.864844:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 280 00000001:02000400:0.0:1790945847.109844:0:11220:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.59.2 00000001:00100000:3.0:1790945847.163272:0:8429:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0cadc7a5-c0ba-4320-984f-d871ffb3a3ef 00000020:00000080:3.0:1790945847.163283:0:8429:0:(genops.c:885:class_export_put()) final put ffff9d3f83705800/0cadc7a5-c0ba-4320-984f-d871ffb3a3ef 00000020:00000080:0.0:1790945847.164295:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f83705800/0cadc7a5-c0ba-4320-984f-d871ffb3a3ef for lustre-OST0000 00000020:00000080:0.0:1790945847.164349:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d3f83704800 for lustre-OST0000 00000001:00100000:0.0:1790945847.167076:0:9515:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0cadc7a5-c0ba-4320-984f-d871ffb3a3ef 00000020:00000080:0.0:1790945847.167085:0:9515:0:(genops.c:885:class_export_put()) final put ffff9d3f83700000/0cadc7a5-c0ba-4320-984f-d871ffb3a3ef 00000020:00000080:2.0:1790945847.167254:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f83700000/0cadc7a5-c0ba-4320-984f-d871ffb3a3ef for lustre-OST0001 00000020:00000080:2.0:1790945847.176528:0:1365:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d3f83702800 for lustre-OST0001 00010000:00010000:0.0:1790945847.775392:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945848.162063:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790945848.162085:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638553984:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790945848.162154:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945848.162241:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638553984 00000100:00100000:0.0:1790945848.162248:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638553984 00000100:00100000:0.0:1790945848.162314:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790945848.162324:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638553984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790945848.162363:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790945848.162640:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638553984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 318us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945848.162649:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1790945848.162672:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790945848.162700:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcb39180 x1877942638553984/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945864 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945848.162718:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638553984:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790945848.163550:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790945848.163564:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638554112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790945848.163606:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945848.163651:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638554112 00000100:00100000:2.0:1790945848.163656:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638554112 00000100:00100000:2.0:1790945848.163695:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790945848.163702:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638554112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790945848.163719:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790945848.163755:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638554112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945848.163762:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1790945848.163783:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790945848.163805:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40b4d03100 x1877942638554112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945864 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945848.163820:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638554112:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790945848.799399:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945849.695709:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790945849.695734:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bfef0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638554240:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790945849.695832:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945849.696111:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638554240 00000100:00100000:1.0:1790945849.696120:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638554240 00000100:00100000:1.0:1790945849.696214:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1790945849.696235:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638554240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790945849.696270:0:6526:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1790945849.696326:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638554240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945849.696333:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1790945849.696377:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bfef0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638554240:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1790945849.823618:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945850.208536:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83cd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638554368:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790945850.208613:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945850.208646:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638554368 00000100:00100000:2.0:1790945850.208661:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638554368 00000100:00100000:2.0:1790945850.208723:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1790945850.208733:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bfef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638554368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790945850.208767:0:6526:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790945850.208901:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bfef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638554368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 169us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945850.208909:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1790945850.208953:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83cd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638554368:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1790945850.388375:0:11318:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.59.2 00010000:00010000:0.0:1790945850.847336:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945851.231536:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bfef0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638554496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790945851.231615:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945851.232590:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bfef1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638554624:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790945851.232629:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945851.232656:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877942638555136:0@lo:400:kworker.0 00000100:00100000:2.0:1790945851.232679:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945851.232687:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877942638554880:0@lo:400:kworker.0 00000100:00100000:2.0:1790945851.232700:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638555648:0@lo:400:kworker.0 00000100:00100000:0.0:1790945851.232713:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945851.232720:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945851.232729:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1877942638555392:0@lo:400:kworker.0 00000100:00100000:2.0:1790945851.232732:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1790945851.232737:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638555008:0@lo:400:kworker.0 00000100:00100000:0.0:1790945851.232746:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945851.232756:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945851.232759:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1877942638555904:0@lo:400:kworker.0 00000100:00100000:2.0:1790945851.232770:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1877942638555520:0@lo:400:kworker.0 00000100:00100000:0.0:1790945851.232776:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945851.232809:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1790945851.232816:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8841fcfb-fb47-4307-92c2-97500c1c82bd:3648:1877942638554752:0@lo:400:kworker.0 00000100:00100000:0.0:1790945851.232842:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945851.232878:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638555136 00000100:00100000:1.0:1790945851.232886:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638555136 00000100:00100000:1.0:1790945851.232921:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638554880 00000100:00100000:1.0:1790945851.232924:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638554880 00000100:00100000:1.0:1790945851.232935:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638555392 00000100:00100000:1.0:1790945851.232951:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638555392 00000100:00100000:1.0:1790945851.232977:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638555904 00000100:00100000:1.0:1790945851.232980:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638555904 00000100:00100000:1.0:1790945851.232995:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790945851.233003:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bad2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877942638555136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945851.233046:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638555264:0@lo:400:kworker.0 00000100:00100000:1.0:1790945851.233054:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bad2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877942638555136:12345-0@lo:400:kworker.0 Request processed in 52us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945851.233060:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790945851.233067:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945851.233077:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790945851.233083:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4db3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1877942638554880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945851.233112:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4db3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1877942638554880:12345-0@lo:400:kworker.0 Request processed in 29us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945851.233117:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790945851.233128:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1790945851.233133:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4db1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1877942638555392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945851.233159:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4db1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1877942638555392:12345-0@lo:400:kworker.0 Request processed in 26us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945851.233165:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1790945851.233194:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1790945851.233200:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4db1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1877942638555904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945851.233235:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638555776:0@lo:400:kworker.0 00000100:00100000:1.0:1790945851.233242:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4db1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1877942638555904:12345-0@lo:400:kworker.0 Request processed in 42us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945851.233247:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1790945851.233257:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945851.233289:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877942638554880:0@lo:400:kworker.0 00000100:00100000:0.0:1790945851.233301:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1877942638555392:0@lo:400:kworker.0 00000100:00100000:2.0:1790945851.233305:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945851.233309:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1877942638555904:0@lo:400:kworker.0 00000100:00100000:2.0:1790945851.233324:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4db0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1877942638556032:0@lo:400:kworker.0 00000100:00100000:2.0:1790945851.233344:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945851.233364:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877942638555136:0@lo:400:kworker.0 00000100:00100000:2.0:1790945851.233386:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638554496 00000100:00100000:2.0:1790945851.233389:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638554496 00000100:00100000:2.0:1790945851.233418:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638554624 00000100:00100000:2.0:1790945851.233433:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638554624 00000100:00100000:2.0:1790945851.233449:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790945851.233455:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638554496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790945851.233482:0:8438:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790945851.233512:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638554496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (1897us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945851.233517:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790945851.233531:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790945851.233536:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bad28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638554624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790945851.233544:0:8438:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790945851.233569:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bad28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638554624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945851.233575:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790945851.233591:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638555520 00000100:00100000:2.0:1790945851.233593:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638555520 00000100:00100000:2.0:1790945851.233607:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638556032 00000100:00100000:2.0:1790945851.233608:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638556032 00000100:00100000:2.0:1790945851.233617:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790945851.233621:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1877942638555520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945851.233645:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1877942638555520:12345-0@lo:400:kworker.0 Request processed in 23us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945851.233650:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790945851.233658:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1790945851.233662:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877942638556032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945851.233679:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877942638556032:12345-0@lo:400:kworker.0 Request processed in 17us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945851.233692:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1790945851.233708:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638555008 00000100:00100000:2.0:1790945851.233714:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638555008 00000100:00100000:2.0:1790945851.233731:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638555264 00000100:00100000:2.0:1790945851.233732:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638555264 00000100:00100000:2.0:1790945851.233741:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790945851.233745:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638555008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945851.233771:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638555008:12345-0@lo:400:kworker.0 Request processed in 26us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945851.233776:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790945851.233795:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1790945851.233800:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4db1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638555264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945851.233827:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4db1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638555264:12345-0@lo:400:kworker.0 Request processed in 27us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945851.233832:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1790945851.233845:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790945851.233848:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790945851.233850:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790945851.233872:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bfef0a80 x1877942638554496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945867 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945851.233886:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bfef0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638554496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790945851.233910:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638555008:0@lo:400:kworker.0 00010000:00080000:2.0:1790945851.233920:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcb14e00 x1877942638555520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945851.233927:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1877942638555520:0@lo:400:kworker.0 00010000:00080000:2.0:1790945851.233946:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40b4db0e00 x1877942638556032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945851.233954:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4db0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1877942638556032:0@lo:400:kworker.0 00010000:00080000:2.0:1790945851.233964:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bfef1500 x1877942638554624/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945867 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945851.233974:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bfef1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638554624:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790945851.234035:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638555264:0@lo:400:kworker.0 00000100:00100000:2.0:1790945851.234058:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638554752 00000100:00100000:2.0:1790945851.234061:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638554752 00000100:00100000:2.0:1790945851.234287:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1790945851.234296:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af614050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3648:x1877942638554752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945851.234338:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af614050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3648:x1877942638554752:12345-0@lo:400:kworker.0 Request processed in 43us (1494us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945851.234344:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1790945851.234373:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8841fcfb-fb47-4307-92c2-97500c1c82bd:3648:1877942638554752:0@lo:400:kworker.0 00000100:00100000:0.0:1790945851.234630:0:8436:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638555648 00000100:00100000:0.0:1790945851.234635:0:8436:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638555648 00000100:00100000:0.0:1790945851.234677:0:8436:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638555776 00000100:00100000:0.0:1790945851.234680:0:8436:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638555776 00000100:00100000:0.0:1790945851.234701:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790945851.234707:0:8436:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40baced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638555648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945851.234746:0:8436:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40baced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638555648:12345-0@lo:400:kworker.0 Request processed in 39us (2025us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945851.234752:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790945851.234763:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790945851.234769:0:8436:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4db2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638555776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945851.234813:0:8436:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4db2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638555776:12345-0@lo:400:kworker.0 Request processed in 44us (1554us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945851.234819:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1790945851.234845:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcb14700 x1877942638555776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945851.234855:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638555776:0@lo:400:kworker.0 00010000:00080000:0.0:1790945851.234878:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcb15180 x1877942638555648/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945851.234886:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638555648:0@lo:400:kworker.0 00000100:00080000:2.0:1790945851.235004:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790945851.871354:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945851.975884:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945851.975979:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616466816 00000100:00100000:1.0:1790945851.975991:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616466816 00000100:00100000:1.0:1790945851.976109:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 99 00000100:00100000:1.0:1790945851.976130:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4db0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2401:x1877942616466816:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945851.976233:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4db0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2401:x1877942616466816:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 106us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945851.976241:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 99 00000100:00080000:3.0:1790945851.977041:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790945851.977828:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945851.977873:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945851.977958:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616466944 00000100:00100000:0.0:1790945851.977966:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616466944 00000100:00100000:0.0:1790945851.978050:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 100 00000100:00100000:0.0:1790945851.978059:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bfef2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2402:x1877942616466944:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790945851.978146:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bfef2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2402:x1877942616466944:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 88us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945851.978154:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 100 00000100:00080000:1.0:1790945851.979959:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790945851.980963:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616466688 00000100:00100000:3.0:1790945851.980977:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616466688 00000100:00100000:3.0:1790945851.981054:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 282 00000100:00100000:3.0:1790945851.981064:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af614450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:2402:x1877942616466688:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790945851.981147:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af614450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:2402:x1877942616466688:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 84us (3324us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945851.981155:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 282 00000001:02000400:0.0:1790945852.280715:0:11366:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Oct 2 08:57:30 EDT 2026 00010000:00010000:3.0:1790945852.895438:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945853.281092:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638556160:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790945853.281183:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945853.281266:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638556160 00000100:00100000:2.0:1790945853.281277:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638556160 00000100:00100000:2.0:1790945853.281333:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790945853.281342:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638556160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790945853.281372:0:8438:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790945853.281434:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638556160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945853.281458:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1790945853.282648:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f833f3800 x1877942638556160/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945869 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945853.282673:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638556160:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1790945853.282917:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790945853.293032:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83cd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638556288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790945853.293101:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945853.293251:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638556288 00000100:00100000:2.0:1790945853.293259:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638556288 00000100:00100000:2.0:1790945853.293321:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790945853.293329:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4db1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638556288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790945853.293352:0:8438:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1790945853.293429:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790945853.296144:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4db1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638556288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2803us (3031us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945853.296160:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1790945853.296831:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f83cd4000 x1877942638556288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945869 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945853.296857:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83cd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638556288:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790945853.921489:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945854.815701:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bfef0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638556416:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790945854.815779:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945854.815951:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638556416 00000100:00100000:1.0:1790945854.815959:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638556416 00000100:00100000:1.0:1790945854.816012:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1790945854.816021:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4db2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638556416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790945854.816053:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1790945854.816103:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4db2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638556416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945854.816110:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1790945854.816481:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bfef0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638556416:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1790945854.946773:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945855.328463:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bfef3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638556544:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790945855.328540:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945855.328647:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638556544 00000100:00100000:1.0:1790945855.328654:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638556544 00000100:00100000:1.0:1790945855.328804:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1790945855.328814:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638556544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790945855.328849:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790945855.328916:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638556544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945855.328924:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1790945855.329444:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bfef3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638556544:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1790945855.969104:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945856.354424:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83cd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638556672:0@lo:400:kworker.0 00000100:00100000:3.0:1790945856.354513:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945856.354584:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83cd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638557184:0@lo:400:kworker.0 00000100:00100000:3.0:1790945856.354612:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945856.354635:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83cd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638557696:0@lo:400:kworker.0 00000100:00100000:3.0:1790945856.354658:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945856.354675:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83646680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638558208:0@lo:400:kworker.0 00000100:00100000:3.0:1790945856.354709:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945856.354752:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1790945856.354775:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83cd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877942638557056:0@lo:400:kworker.0 00000100:00100000:3.0:1790945856.354802:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945856.354820:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83cd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638557568:0@lo:400:kworker.0 00000100:00100000:3.0:1790945856.354843:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945856.354861:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83644000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638558080:0@lo:400:kworker.0 00000100:00100000:3.0:1790945856.354880:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945856.354919:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83cd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638556800:0@lo:400:kworker.0 00000100:00100000:3.0:1790945856.354959:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945856.354980:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83cd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1877942638557312:0@lo:400:kworker.0 00000100:00100000:2.0:1790945856.359638:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638556672 00000100:00100000:2.0:1790945856.359648:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638556672 00000100:00100000:2.0:1790945856.359714:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1790945856.359724:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af615850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3650:x1877942638556672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945856.359814:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af615850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3650:x1877942638556672:12345-0@lo:400:kworker.0 Request processed in 91us (5301us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945856.359822:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1790945856.359882:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83cd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638556672:0@lo:400:kworker.0 00000100:00100000:2.0:1790945856.360657:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638557056 00000100:00100000:2.0:1790945856.360666:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638557056 00000100:00100000:2.0:1790945856.360721:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638556800 00000100:00100000:2.0:1790945856.360732:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638556800 00000100:00100000:2.0:1790945856.360766:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790945856.360775:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877942638557056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945856.360840:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877942638557056:12345-0@lo:400:kworker.0 Request processed in 66us (6036us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945856.360847:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790945856.360862:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1790945856.360868:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638556800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945856.360897:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638556800:12345-0@lo:400:kworker.0 Request processed in 29us (5937us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945856.360902:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1790945856.360922:0:10099:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638557696 00000100:00100000:2.0:1790945856.360926:0:10099:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638557696 00000100:00100000:2.0:1790945856.360954:0:10099:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638558208 00000100:00100000:2.0:1790945856.360957:0:10099:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638558208 00000100:00100000:2.0:1790945856.360969:0:10099:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638557568 00000100:00100000:2.0:1790945856.360971:0:10099:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638557568 00000100:00100000:2.0:1790945856.360983:0:10099:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638558080 00000100:00100000:2.0:1790945856.360985:0:10099:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638558080 00000100:00100000:2.0:1790945856.360999:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790945856.361005:0:10099:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83644e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638557696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945856.361040:0:10099:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83644e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638557696:12345-0@lo:400:kworker.0 Request processed in 35us (6381us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945856.361047:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790945856.361058:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790945856.361065:0:10099:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83645c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638558208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945856.361094:0:10099:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83645c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638558208:12345-0@lo:400:kworker.0 Request processed in 30us (6385us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945856.361110:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790945856.361123:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790945856.361129:0:10099:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83647100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638557568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945856.361161:0:10099:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83647100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638557568:12345-0@lo:400:kworker.0 Request processed in 32us (6317us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945856.361197:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790945856.361210:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790945856.361217:0:10099:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83645f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638558080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945856.361246:0:10099:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83645f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638558080:12345-0@lo:400:kworker.0 Request processed in 31us (6365us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945856.361252:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790945856.361269:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638557184 00000100:00100000:2.0:1790945856.361273:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638557184 00000100:00100000:2.0:1790945856.361302:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790945856.361308:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638557184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945856.361340:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638557184:12345-0@lo:400:kworker.0 Request processed in 32us (6727us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945856.361346:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1790945856.362108:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790945856.362114:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790945856.362308:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945856.362342:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638557312 00000100:00100000:3.0:1790945856.362347:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638557312 00000100:00100000:3.0:1790945856.362383:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1790945856.362391:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1877942638557312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945856.362431:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1877942638557312:12345-0@lo:400:kworker.0 Request processed in 41us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945856.362437:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:3.0:1790945856.362455:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790945856.362486:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83cd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1877942638557312:0@lo:400:kworker.0 00000100:00100000:3.0:1790945856.362497:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83645500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1877942638557824:0@lo:400:kworker.0 00000100:00100000:3.0:1790945856.362520:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945856.362540:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638557824 00000100:00100000:3.0:1790945856.362543:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638557824 00000100:00100000:3.0:1790945856.362566:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1790945856.367179:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1877942638557824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945856.367290:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1877942638557824:12345-0@lo:400:kworker.0 Request processed in 4707us (4767us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945856.367302:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:3.0:1790945856.367415:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790945856.367457:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83645500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1877942638557824:0@lo:400:kworker.0 00000100:00100000:3.0:1790945856.367491:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638558336:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790945856.367530:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945856.367567:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638558336 00000100:00100000:3.0:1790945856.367574:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638558336 00000100:00100000:3.0:1790945856.367613:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790945856.367620:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638558336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790945856.367643:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790945856.367675:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638558336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945856.367680:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1790945856.367720:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f833f0380 x1877942638558336/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945872 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945856.370433:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638558336:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790945856.370489:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83cd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877942638557056:0@lo:400:kworker.0 00010000:00080000:3.0:1790945856.370507:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f83cd5180 x1877942638557568/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945856.370517:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83cd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638557568:0@lo:400:kworker.0 00010000:00080000:3.0:1790945856.370529:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f83644000 x1877942638558080/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945856.370552:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83644000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638558080:0@lo:400:kworker.0 00000100:00100000:3.0:1790945856.370567:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83cd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638557184:0@lo:400:kworker.0 00010000:00080000:3.0:1790945856.370578:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f83cd4e00 x1877942638557696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945856.370586:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83cd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638557696:0@lo:400:kworker.0 00010000:00080000:3.0:1790945856.370599:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f83646680 x1877942638558208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945856.370605:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83646680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638558208:0@lo:400:kworker.0 00000100:00100000:3.0:1790945856.370660:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83cd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638556800:0@lo:400:kworker.0 00000100:00100000:2.0:1790945856.371103:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83cd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638556928:0@lo:400:kworker.0 00000100:00100000:2.0:1790945856.371188:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945856.371228:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638556928 00000100:00100000:2.0:1790945856.371235:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638556928 00000100:00100000:2.0:1790945856.371277:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1790945856.371286:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638556928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945856.371350:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638556928:12345-0@lo:400:kworker.0 Request processed in 65us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945856.371364:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1790945856.371400:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83cd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638556928:0@lo:400:kworker.0 00000100:00100000:2.0:1790945856.371408:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83cd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1877942638557440:0@lo:400:kworker.0 00000100:00100000:2.0:1790945856.371434:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945856.371459:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638557440 00000100:00100000:2.0:1790945856.371463:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638557440 00000100:00100000:2.0:1790945856.371498:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790945856.371505:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83cd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1877942638557440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945856.371535:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83cd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1877942638557440:12345-0@lo:400:kworker.0 Request processed in 31us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945856.371541:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:2.0:1790945856.371558:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1790945856.371577:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f83cd6d80 x1877942638557440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945856.371587:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83cd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1877942638557440:0@lo:400:kworker.0 00000100:00100000:2.0:1790945856.371594:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83647800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1877942638557952:0@lo:400:kworker.0 00000100:00100000:2.0:1790945856.371615:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945856.371638:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638557952 00000100:00100000:2.0:1790945856.371642:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638557952 00000100:00100000:2.0:1790945856.371667:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1790945856.371673:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1877942638557952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945856.371716:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1877942638557952:12345-0@lo:400:kworker.0 Request processed in 42us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945856.371722:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:2.0:1790945856.372840:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1790945856.372874:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f83647800 x1877942638557952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945856.372888:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83647800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1877942638557952:0@lo:400:kworker.0 00000100:00100000:2.0:1790945856.372896:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638558464:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790945856.372938:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945856.373301:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638558464 00000100:00100000:3.0:1790945856.373308:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638558464 00000100:00100000:3.0:1790945856.373426:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790945856.373436:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638558464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790945856.373456:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790945856.373499:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638558464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945856.373506:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1790945856.373584:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f833f2d80 x1877942638558464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945872 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945856.373600:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638558464:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790945856.994632:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945857.091278:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945857.091318:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945857.091353:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945857.091912:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616467328 00000100:00100000:2.0:1790945857.091926:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616467328 00000100:00100000:2.0:1790945857.092695:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616467200 00000100:00100000:2.0:1790945857.092702:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616467200 00000100:00100000:2.0:1790945857.092734:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 107 00000100:00100000:0.0:1790945857.092736:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616467072 00000100:00100000:0.0:1790945857.092740:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616467072 00000100:00100000:2.0:1790945857.092743:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2401:x1877942616467328:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790945857.092769:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 284 00000100:00100000:0.0:1790945857.092776:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af614c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:2401:x1877942616467072:12345-192.168.204.20@tcp:400:kworker.0 00000100:00080000:3.0:1790945857.092893:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790945857.092898:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790945857.092944:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 108 00000100:00100000:3.0:1790945857.092954:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2401:x1877942616467200:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790945857.093213:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2401:x1877942616467328:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 470us (1893us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945857.093221:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 107 00000100:00100000:0.0:1790945857.100802:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af614c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:2401:x1877942616467072:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 7764us (9273us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945857.100820:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 284 00000100:00100000:3.0:1790945857.107489:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2401:x1877942616467200:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 14524us (16120us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945857.107504:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 108 00010000:00010000:3.0:1790945858.022860:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945858.399364:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790945858.399401:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83cd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638558592:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790945858.399477:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945858.399600:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638558592 00000100:00100000:2.0:1790945858.399610:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638558592 00000100:00100000:2.0:1790945858.399697:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790945858.399707:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bfef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638558592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790945858.399740:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790945858.399789:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bfef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638558592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945858.399806:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1790945858.399874:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790945858.399903:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f83cd6d80 x1877942638558592/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945874 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945858.399921:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83cd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638558592:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790945858.403622:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790945858.403675:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638558720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790945858.403748:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945858.403855:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638558720 00000100:00100000:3.0:1790945858.403865:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638558720 00000100:00100000:3.0:1790945858.403927:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790945858.403935:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83cd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638558720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790945858.403958:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790945858.404004:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83cd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638558720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945858.404011:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1790945858.404120:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790945858.404152:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bff70e00 x1877942638558720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945874 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945858.404196:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638558720:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790945859.049689:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945859.939721:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790945859.939745:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bfef3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638558848:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790945859.939817:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945859.940285:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638558848 00000100:00100000:1.0:1790945859.940294:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638558848 00000100:00100000:1.0:1790945859.940353:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1790945859.940364:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638558848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790945859.940401:0:6526:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1790945859.940465:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638558848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945859.940474:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1790945859.940637:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bfef3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638558848:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1790945860.064730:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945860.447419:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790945860.447444:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bfef0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638558976:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790945860.447512:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945860.447569:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638558976 00000100:00100000:1.0:1790945860.447586:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638558976 00000100:00100000:1.0:1790945860.447657:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1790945860.447667:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4db0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638558976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790945860.447700:0:6526:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790945860.447756:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4db0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638558976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945860.447763:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790945860.449521:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bfef0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638558976:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1790945861.094417:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945861.471454:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877942638559232:0@lo:400:kworker.0 00000100:00100000:3.0:1790945861.471525:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945861.471594:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1877942638559744:0@lo:400:kworker.0 00000100:00100000:3.0:1790945861.471619:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945861.471737:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638559104:0@lo:400:kworker.0 00000100:00100000:1.0:1790945861.471774:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945861.471900:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1877942638560256:0@lo:400:kworker.0 00000100:00100000:3.0:1790945861.471926:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945861.471968:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1877942638559488:0@lo:400:kworker.0 00000100:00100000:3.0:1790945861.472013:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945861.472035:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638560000:0@lo:400:kworker.0 00000100:00100000:3.0:1790945861.472061:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945861.472086:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638560512:0@lo:400:kworker.0 00000100:00100000:3.0:1790945861.472121:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945861.472146:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1790945861.472152:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638559360:0@lo:400:kworker.0 00000100:00100000:3.0:1790945861.472200:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945861.473322:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1877942638559872:0@lo:400:kworker.0 00000100:00100000:3.0:1790945861.473363:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945861.479489:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638559104 00000100:00100000:2.0:1790945861.479499:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638559104 00000100:00100000:2.0:1790945861.479628:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1790945861.479650:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af616c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3649:x1877942638559104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945861.479736:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af616c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3649:x1877942638559104:12345-0@lo:400:kworker.0 Request processed in 98us (7960us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945861.479744:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1790945861.479783:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638559232 00000100:00100000:2.0:1790945861.479787:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638559232 00000100:00100000:2.0:1790945861.479809:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638559744 00000100:00100000:2.0:1790945861.479812:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638559744 00000100:00100000:2.0:1790945861.479834:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638560256 00000100:00100000:2.0:1790945861.479837:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638560256 00000100:00100000:2.0:1790945861.479867:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638559488 00000100:00100000:2.0:1790945861.479871:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638559488 00000100:00100000:2.0:1790945861.479881:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638559872 00000100:00100000:2.0:1790945861.479884:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638559872 00000100:00100000:2.0:1790945861.479899:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1790945861.479906:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83646680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877942638559232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945861.479943:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83646680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877942638559232:12345-0@lo:400:kworker.0 Request processed in 37us (8418us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945861.479949:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1790945861.479962:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1790945861.479969:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877942638559744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945861.479998:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877942638559744:12345-0@lo:400:kworker.0 Request processed in 30us (8379us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945861.480004:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1790945861.480016:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1790945861.480021:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877942638560256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945861.480048:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877942638560256:12345-0@lo:400:kworker.0 Request processed in 27us (8121us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945861.480054:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1790945861.480065:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1790945861.480071:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1877942638559488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945861.480101:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1877942638559488:12345-0@lo:400:kworker.0 Request processed in 30us (8087us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945861.480107:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1790945861.480118:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1790945861.480124:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1877942638559872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945861.480163:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1877942638559872:12345-0@lo:400:kworker.0 Request processed in 38us (6798us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945861.480192:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1790945861.480212:0:10099:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638560000 00000100:00100000:2.0:1790945861.480216:0:10099:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638560000 00000100:00100000:1.0:1790945861.480414:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638559104:0@lo:400:kworker.0 00000100:00100000:1.0:1790945861.480433:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638559616:0@lo:400:kworker.0 00000100:00100000:1.0:1790945861.480469:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945861.480497:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638560128:0@lo:400:kworker.0 00000100:00100000:1.0:1790945861.480521:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945861.480542:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83647800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638560640:0@lo:400:kworker.0 00000100:00100000:1.0:1790945861.480564:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945861.480610:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790945861.480616:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83cd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638560768:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790945861.480786:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945861.480824:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638559360 00000100:00100000:1.0:1790945861.480829:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638559360 00000100:00100000:1.0:1790945861.480856:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638559616 00000100:00100000:1.0:1790945861.480859:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638559616 00000100:00100000:1.0:1790945861.480872:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1790945861.480879:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638559360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945861.480929:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638559360:12345-0@lo:400:kworker.0 Request processed in 50us (8728us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945861.480936:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1790945861.480949:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1790945861.480955:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bfef1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638559616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945861.480992:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bfef1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638559616:12345-0@lo:400:kworker.0 Request processed in 31us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945861.480999:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1790945861.481015:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638560512 00000100:00100000:1.0:1790945861.481019:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638560512 00000100:00100000:1.0:1790945861.481043:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638560128 00000100:00100000:1.0:1790945861.481052:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638560128 00000100:00100000:0.0:1790945861.481091:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638560768 00000100:00100000:0.0:1790945861.481095:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638560768 00000100:00100000:0.0:1790945861.481123:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790945861.481130:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bfef3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1877942638560768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790945861.481150:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790945861.481201:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bfef3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1877942638560768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945861.481207:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790945861.481326:0:10099:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638560640 00000100:00100000:2.0:1790945861.481331:0:10099:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638560640 00000100:00100000:2.0:1790945861.481346:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790945861.481353:0:10099:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8301b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638560512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945861.481396:0:10099:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8301b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638560512:12345-0@lo:400:kworker.0 Request processed in 44us (9274us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945861.481403:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790945861.481416:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790945861.481778:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790945861.481788:0:8436:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bfef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638560640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945861.481827:0:8436:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bfef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638560640:12345-0@lo:400:kworker.0 Request processed in 42us (1262us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945861.481833:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1790945861.481873:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bff71880 x1877942638559872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945861.481887:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1877942638559872:0@lo:400:kworker.0 00000100:00100000:3.0:1790945861.481896:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1877942638560384:0@lo:400:kworker.0 00000100:00100000:3.0:1790945861.481924:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945861.481955:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1877942638559488:0@lo:400:kworker.0 00010000:00080000:3.0:1790945861.481966:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bff70e00 x1877942638560512/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945861.481975:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638560512:0@lo:400:kworker.0 00000100:00100000:3.0:1790945861.482002:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638559360:0@lo:400:kworker.0 00000100:00100000:1.0:1790945861.482377:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790945861.482385:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bfef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638560128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945861.482423:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bfef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638560128:12345-0@lo:400:kworker.0 Request processed in 38us (1901us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945861.482429:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1790945861.482466:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f83cd4380 x1877942638560768/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945877 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945861.482482:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83cd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638560768:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790945861.482494:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638559616:0@lo:400:kworker.0 00010000:00080000:1.0:1790945861.482503:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bff70a80 x1877942638560128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945861.482511:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638560128:0@lo:400:kworker.0 00010000:00080000:1.0:1790945861.482520:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f83647800 x1877942638560640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945861.482527:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83647800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638560640:0@lo:400:kworker.0 00000100:00080000:0.0:1790945861.483455:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790945861.483463:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790945861.483467:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790945861.483470:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790945861.483560:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877942638559232:0@lo:400:kworker.0 00000100:00100000:0.0:1790945861.483575:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1877942638559744:0@lo:400:kworker.0 00000100:00100000:0.0:1790945861.483596:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1877942638560256:0@lo:400:kworker.0 00000100:00100000:3.0:1790945861.483716:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790945861.483740:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638560896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790945861.483783:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945861.483903:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638560896 00000100:00100000:0.0:1790945861.483910:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638560896 00000100:00100000:0.0:1790945861.483941:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790945861.483949:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8301aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638560896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790945861.483967:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790945861.484013:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8301aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638560896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945861.484020:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1790945861.484078:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40b4db3800 x1877942638560896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945877 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945861.484093:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638560896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790945861.484734:0:10099:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8301bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638560000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945861.484795:0:10099:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8301bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638560000:12345-0@lo:400:kworker.0 Request processed in 3373us (12733us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945861.484803:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790945861.484835:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638560384 00000100:00100000:2.0:1790945861.484841:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638560384 00000100:00100000:2.0:1790945861.484889:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1790945861.484898:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1877942638560384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945861.484930:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1877942638560384:12345-0@lo:400:kworker.0 Request processed in 35us (3005us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945861.484936:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:1.0:1790945861.488525:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1790945861.489261:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bff72d80 x1877942638560384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945861.489281:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1877942638560384:0@lo:400:kworker.0 00010000:00080000:0.0:1790945861.489313:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bff72a00 x1877942638560000/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945861.489322:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638560000:0@lo:400:kworker.0 00010000:00010000:2.0:1790945862.117226:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945862.219509:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945862.219632:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945862.219665:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945862.219694:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616467584 00000100:00100000:1.0:1790945862.219705:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616467584 00000100:00100000:1.0:1790945862.219756:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616467712 00000100:00100000:1.0:1790945862.219759:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616467712 00000100:00100000:1.0:1790945862.219782:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 115 00000100:00100000:1.0:1790945862.219792:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bfef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2404:x1877942616467584:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945862.219877:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bfef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2404:x1877942616467584:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 86us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945862.219886:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 115 00000100:00100000:1.0:1790945862.219903:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 116 00000100:00100000:1.0:1790945862.219910:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bfef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2404:x1877942616467712:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945862.219932:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bfef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2404:x1877942616467712:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 23us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945862.219939:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 116 00000100:00080000:1.0:1790945862.219958:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790945862.219962:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790945862.220889:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616467456 00000100:00100000:0.0:1790945862.220898:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616467456 00000100:00100000:0.0:1790945862.220940:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 286 00000100:00100000:0.0:1790945862.220948:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af617c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:2404:x1877942616467456:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790945862.220987:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af617c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:2404:x1877942616467456:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 40us (1355us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945862.220994:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 286 00010000:00010000:2.0:1790945863.142678:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945863.521554:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83018a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638561024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790945863.521637:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945863.522095:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638561024 00000100:00100000:0.0:1790945863.522104:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638561024 00000100:00100000:0.0:1790945863.522160:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790945863.522197:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83647800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638561024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790945863.522227:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790945863.527025:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83647800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638561024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4846us (5377us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945863.527042:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790945863.527086:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790945863.527102:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83cd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638561152:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790945863.527183:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790945863.527316:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790945863.531867:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638561152 00000100:00100000:2.0:1790945863.531900:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638561152 00000100:00100000:2.0:1790945863.532031:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790945863.532041:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4db0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638561152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790945863.532070:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790945863.532155:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4db0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638561152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (4989us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945863.532161:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1790945863.532241:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f83cd4000 x1877942638561152/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945879 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1790945863.532242:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f83018a80 x1877942638561024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945879 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945863.532261:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83cd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638561152:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790945863.532265:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83018a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638561024:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790945863.540766:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790945864.176151:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945865.060283:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790945865.060306:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638561280:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790945865.060502:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945865.060619:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638561280 00000100:00100000:3.0:1790945865.060627:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638561280 00000100:00100000:3.0:1790945865.060689:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1790945865.060698:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638561280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790945865.060734:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1790945865.060786:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638561280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945865.060794:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1790945865.061991:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638561280:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1790945865.184398:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945865.589629:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790945865.589660:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638561408:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790945865.589736:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945865.589880:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638561408 00000100:00100000:3.0:1790945865.589889:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638561408 00000100:00100000:3.0:1790945865.589956:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1790945865.589966:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638561408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790945865.590000:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790945865.590051:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638561408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945865.590059:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1790945865.590104:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638561408:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1790945866.211127:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945866.595384:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638561536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790945866.595458:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945866.595696:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638561536 00000100:00100000:2.0:1790945866.595705:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638561536 00000100:00100000:2.0:1790945866.595760:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790945866.595771:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8301ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638561536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790945866.595800:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790945866.595848:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8301ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638561536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945866.595856:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790945866.595887:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83cd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877942638561792:0@lo:400:kworker.0 00000100:00100000:2.0:1790945866.595916:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945866.595933:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1877942638562304:0@lo:400:kworker.0 00000100:00100000:2.0:1790945866.595954:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945866.595968:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1877942638562816:0@lo:400:kworker.0 00000100:00100000:2.0:1790945866.595987:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945866.596014:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1790945866.596019:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83cd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638561664:0@lo:400:kworker.0 00000100:00100000:2.0:1790945866.596048:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945866.596072:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638562176:0@lo:400:kworker.0 00000100:00100000:2.0:1790945866.596096:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945866.596114:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638562688:0@lo:400:kworker.0 00000100:00100000:2.0:1790945866.596237:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945866.596268:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638561664 00000100:00100000:2.0:1790945866.596273:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638561664 00000100:00100000:2.0:1790945866.596300:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1790945866.596307:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af615450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3650:x1877942638561664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945866.596345:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af615450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3650:x1877942638561664:12345-0@lo:400:kworker.0 Request processed in 38us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945866.596351:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1790945866.596378:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638562176 00000100:00100000:2.0:1790945866.596381:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638562176 00000100:00100000:2.0:1790945866.596406:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1790945866.596413:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638562176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945866.596449:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638562176:12345-0@lo:400:kworker.0 Request processed in 37us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945866.596455:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1790945866.596511:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83cd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638561664:0@lo:400:kworker.0 00000100:00100000:2.0:1790945866.596526:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638562176:0@lo:400:kworker.0 00000100:00100000:1.0:1790945866.596552:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638561792 00000100:00100000:2.0:1790945866.596562:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83cd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638561920:0@lo:400:kworker.0 00000100:00100000:1.0:1790945866.596566:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638561792 00000100:00100000:2.0:1790945866.596602:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945866.596606:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638562304 00000100:00100000:1.0:1790945866.596612:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638562304 00000100:00100000:1.0:1790945866.596632:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638562816 00000100:00100000:1.0:1790945866.596635:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638562816 00000100:00100000:2.0:1790945866.596637:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1877942638562432:0@lo:400:kworker.0 00000100:00100000:1.0:1790945866.596660:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1790945866.596667:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945866.596673:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877942638561792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945866.596684:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d408aa8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1877942638562944:0@lo:400:kworker.0 00000100:00100000:2.0:1790945866.596718:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790945866.596778:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790945866.596784:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790945866.596828:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1790945866.596835:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83cd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1877942638562048:0@lo:400:kworker.0 00000100:00100000:2.0:1790945866.596857:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945866.596868:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638562560:0@lo:400:kworker.0 00000100:00100000:2.0:1790945866.596886:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945866.596943:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d408aa8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638563072:0@lo:400:kworker.0 00000100:00100000:2.0:1790945866.596963:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945866.599022:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877942638561792:12345-0@lo:400:kworker.0 Request processed in 2344us (3094us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945866.599038:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1790945866.599073:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638562432 00000100:00100000:1.0:1790945866.599082:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638562432 00000100:00100000:1.0:1790945866.599127:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638562944 00000100:00100000:1.0:1790945866.599130:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638562944 00000100:00100000:1.0:1790945866.599145:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638562048 00000100:00100000:1.0:1790945866.599148:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638562048 00000100:00100000:1.0:1790945866.599164:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1790945866.599193:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877942638562304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945866.599269:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877942638562304:12345-0@lo:400:kworker.0 Request processed in 78us (3314us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945866.599276:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1790945866.599288:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1790945866.599295:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877942638562816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945866.599332:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877942638562816:12345-0@lo:400:kworker.0 Request processed in 39us (3345us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945866.599338:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1790945866.599347:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1790945866.599352:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1877942638562432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945866.599384:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1877942638562432:12345-0@lo:400:kworker.0 Request processed in 33us (2718us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945866.599389:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1790945866.599398:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1790945866.599403:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1877942638562944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945866.599421:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1877942638562944:12345-0@lo:400:kworker.0 Request processed in 19us (2703us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945866.599426:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1790945866.599435:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1790945866.599568:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1877942638562048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945866.599605:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1877942638562048:12345-0@lo:400:kworker.0 Request processed in 164us (2746us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945866.599611:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00010000:00080000:2.0:1790945866.600798:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f81bd3480 x1877942638562432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945866.600819:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1877942638562432:0@lo:400:kworker.0 00010000:00080000:2.0:1790945866.600835:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d408aa8df80 x1877942638562944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945866.600843:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d408aa8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1877942638562944:0@lo:400:kworker.0 00000100:00100000:2.0:1790945866.600878:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83cd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1877942638562048:0@lo:400:kworker.0 00000100:00100000:2.0:1790945866.600908:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638561920 00000100:00100000:2.0:1790945866.600915:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638561920 00000100:00100000:2.0:1790945866.600954:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790945866.600962:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4096d77850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638561920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945866.601023:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4096d77850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638561920:12345-0@lo:400:kworker.0 Request processed in 61us (4421us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945866.601042:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790945866.601450:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83cd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638561920:0@lo:400:kworker.0 00010000:00080000:2.0:1790945866.601479:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f83019500 x1877942638561536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945882 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945866.601509:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638561536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790945866.601587:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638562688 00000100:00100000:3.0:1790945866.601594:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638562688 00000100:00100000:3.0:1790945866.601637:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638562560 00000100:00100000:3.0:1790945866.601640:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638562560 00000100:00100000:3.0:1790945866.601657:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638563072 00000100:00100000:3.0:1790945866.601660:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638563072 00000100:00100000:3.0:1790945866.601675:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790945866.601681:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638562688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945866.601723:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638562688:12345-0@lo:400:kworker.0 Request processed in 43us (5486us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945866.601729:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790945866.601742:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790945866.601749:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638562560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945866.601786:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638562560:12345-0@lo:400:kworker.0 Request processed in 38us (4898us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945866.601793:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790945866.601846:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790945866.601859:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638563072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945866.601908:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638563072:12345-0@lo:400:kworker.0 Request processed in 53us (4942us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945866.601938:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1790945866.601973:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f81bd0700 x1877942638562560/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945866.601984:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638562560:0@lo:400:kworker.0 00010000:00080000:2.0:1790945866.601996:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d408aa8ce00 x1877942638563072/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945866.602003:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d408aa8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638563072:0@lo:400:kworker.0 00000100:00100000:3.0:1790945866.604331:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638563200:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1790945866.604375:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f81bd2d80 x1877942638562688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945866.604394:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638562688:0@lo:400:kworker.0 00000100:00100000:3.0:1790945866.604402:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945866.604419:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83cd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877942638561792:0@lo:400:kworker.0 00000100:00100000:0.0:1790945866.604436:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1877942638562304:0@lo:400:kworker.0 00000100:00100000:0.0:1790945866.604452:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1877942638562816:0@lo:400:kworker.0 00000100:00100000:3.0:1790945866.604470:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638563200 00000100:00100000:3.0:1790945866.604478:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638563200 00000100:00080000:0.0:1790945866.604505:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790945866.604512:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790945866.604517:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790945866.604545:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790945866.604552:0:8438:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1790945866.604558:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8301b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638563200:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790945866.604566:0:8438:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:3.0:1790945866.604585:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790945866.604643:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8301b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638563200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945866.604650:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1790945866.605645:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f83018000 x1877942638563200/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945882 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945866.605666:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638563200:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1790945867.231395:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945867.330992:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945867.331090:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945867.331130:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945867.332720:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616468096 00000100:00100000:3.0:1790945867.332735:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616468096 00000100:00100000:3.0:1790945867.332818:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616467968 00000100:00100000:3.0:1790945867.332822:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616467968 00000100:00100000:3.0:1790945867.332849:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 123 00000100:00100000:3.0:1790945867.332859:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4db3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2402:x1877942616468096:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790945867.332955:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4db3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2402:x1877942616468096:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 96us (1864us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945867.332963:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 123 00000100:00100000:3.0:1790945867.332981:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 124 00000100:00100000:3.0:1790945867.332988:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4db1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2402:x1877942616467968:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790945867.333015:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4db1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2402:x1877942616467968:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 27us (1884us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945867.333020:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 124 00000100:00080000:0.0:1790945867.337349:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790945867.337360:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790945867.341550:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616467840 00000100:00100000:2.0:1790945867.341569:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616467840 00000100:00100000:0.0:1790945867.344697:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 288 00000100:00100000:0.0:1790945867.344714:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af615c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:2402:x1877942616467840:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790945867.344808:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af615c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:2402:x1877942616467840:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 96us (13826us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945867.344832:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 288 00010000:00010000:2.0:1790945868.255445:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945868.639502:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790945868.639525:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638563456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790945868.639595:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945868.639930:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638563328:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790945868.639961:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945868.640113:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638563456 00000100:00100000:3.0:1790945868.640122:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638563456 00000100:00100000:3.0:1790945868.640213:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638563328 00000100:00100000:3.0:1790945868.640217:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638563328 00000100:00100000:3.0:1790945868.640237:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790945868.640245:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638563456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790945868.640274:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790945868.640321:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638563456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945868.640328:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790945868.640345:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790945868.640351:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4db1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638563328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790945868.640375:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790945868.640406:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4db1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638563328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945868.640412:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1790945868.640454:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcbc1880 x1877942638563328/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945884 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945868.640795:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638563328:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1790945868.640890:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bff71c00 x1877942638563456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945884 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945868.640915:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638563456:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790945868.641033:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790945869.280386:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790945869.642703:0:11996:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 08:57:48 (1790945868) === 00000100:00100000:0.0:1790945870.106776:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945870.106955:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616468224 00000100:00100000:2.0:1790945870.106965:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616468224 00000100:00100000:2.0:1790945870.107024:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 289 00000100:00100000:2.0:1790945870.107034:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af617050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:8701:x1877942616468224:12345-192.168.204.20@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790945870.107051:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945870.107079:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3f8363d800/0xd9f4181e0d27d225 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330a1e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945870.107108:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3f8363d800/0xd9f4181e0d27d225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a1e expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945870.107141:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3f8363d800/0xd9f4181e0d27d225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a1e expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945870.107150:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f8363d800, rc 0) 00000100:00100000:2.0:1790945870.107250:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af617050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+11:8701:x1877942616468224:12345-192.168.204.20@tcp:101:mount.lustre.0 Request processed in 217us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945870.107258:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 289 00000100:00100000:1.0:1790945870.111775:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945870.113182:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616468352 00000100:00100000:0.0:1790945870.113194:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616468352 00000100:00100000:0.0:1790945870.113315:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 290 00000100:00100000:0.0:1790945870.113337:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af614850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+11:8701:x1877942616468352:12345-192.168.204.20@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790945870.114427:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af614850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+11:8701:x1877942616468352:12345-192.168.204.20@tcp:501:mount.lustre.0 Request processed in 1077us (2646us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945870.114437:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 290 00000100:00100000:1.0:1790945870.117916:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945870.122379:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616468480 00000100:00100000:2.0:1790945870.122394:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616468480 00000100:00100000:2.0:1790945870.123855:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 291 00000100:00100000:2.0:1790945870.123879:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af616050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+11:8701:x1877942616468480:12345-192.168.204.20@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790945870.124037:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af616050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+11:8701:x1877942616468480:12345-192.168.204.20@tcp:503:mount.lustre.0 Request processed in 168us (6130us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945870.124045:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 291 00000100:00100000:1.0:1790945870.136344:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945870.136550:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616468608 00000100:00100000:2.0:1790945870.136562:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616468608 00000100:00100000:2.0:1790945870.136616:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 292 00000100:00100000:2.0:1790945870.136626:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af616850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+11:8705:x1877942616468608:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790945870.136789:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af616850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+11:8705:x1877942616468608:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 165us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945870.136797:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 292 00000100:00100000:3.0:1790945870.177631:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790945870.177657:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638563584:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790945870.177739:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945870.177827:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638563584 00000100:00100000:3.0:1790945870.177837:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638563584 00000100:00100000:3.0:1790945870.177888:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1790945870.177896:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8301a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638563584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790945870.177929:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1790945870.177975:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8301a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638563584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945870.177982:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1790945870.178027:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638563584:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790945870.203300:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945870.203635:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616468736 00000100:00100000:3.0:1790945870.203646:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616468736 00000100:00100000:3.0:1790945870.203721:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 293 00000100:00100000:3.0:1790945870.203893:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af615050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+11:8705:x1877942616468736:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790945870.204106:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af615050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+11:8705:x1877942616468736:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 375us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945870.204123:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 293 00000100:00100000:1.0:1790945870.213734:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945870.215064:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616468864 00000100:00100000:0.0:1790945870.215077:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616468864 00000100:00100000:0.0:1790945870.215142:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 294 00000100:00100000:0.0:1790945870.215152:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af617850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+11:8705:x1877942616468864:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790945870.215348:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af617850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+11:8705:x1877942616468864:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 197us (1641us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945870.215356:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 294 00000100:00100000:1.0:1790945870.230270:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945870.230956:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616468992 00000100:00100000:2.0:1790945870.230969:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616468992 00000100:00100000:2.0:1790945870.231068:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 295 00000100:00100000:2.0:1790945870.231092:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af616450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+11:8701:x1877942616468992:12345-192.168.204.20@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790945870.231111:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945870.231129:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3f8363c800/0xd9f4181e0d27d22c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330a4f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945870.231162:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3f8363c800/0xd9f4181e0d27d22c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a4f expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945870.231198:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3f8363c800/0xd9f4181e0d27d22c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a4f expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945870.231206:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f8363c800, rc 0) 00000100:00100000:2.0:1790945870.231272:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af616450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+12:8701:x1877942616468992:12345-192.168.204.20@tcp:101:mount.lustre.0 Request processed in 181us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945870.231279:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 295 00000100:00100000:3.0:1790945870.237494:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945870.237644:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616469120 00000100:00100000:2.0:1790945870.237656:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616469120 00000100:00100000:3.0:1790945870.237895:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 296 00000100:00100000:3.0:1790945870.237906:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+12:8701:x1877942616469120:12345-192.168.204.20@tcp:256:mount.lustre.0 20000000:01000000:3.0:1790945870.237930:0:6516:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1790945870.238241:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1790945870.238247:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1790945870.238250:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1790945870.238253:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1790945870.238255:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1790945870.241740:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+12:8701:x1877942616469120:12345-192.168.204.20@tcp:256:mount.lustre.0 Request processed in 3823us (4244us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945870.241756:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 296 00000100:00100000:1.0:1790945870.251233:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945870.251342:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616469248 00000100:00100000:0.0:1790945870.251352:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616469248 00000100:00100000:0.0:1790945870.251486:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 297 00000100:00100000:0.0:1790945870.251497:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+12:8701:x1877942616469248:12345-192.168.204.20@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790945870.251515:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945870.251547:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d4086a4d200/0xd9f4181e0d27d233 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330a56 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945870.251576:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d4086a4d200/0xd9f4181e0d27d233 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a56 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945870.251588:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d4086a4d200/0xd9f4181e0d27d233 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a56 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945870.251596:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4086a4d200, rc 0) 00000100:00100000:0.0:1790945870.251718:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:8701:x1877942616469248:12345-192.168.204.20@tcp:101:mount.lustre.0 Request processed in 222us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945870.251726:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 297 00000100:00100000:1.0:1790945870.256462:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945870.256544:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616469376 00000100:00100000:3.0:1790945870.256555:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616469376 00000100:00100000:3.0:1790945870.256610:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 298 00000100:00100000:3.0:1790945870.256867:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:8701:x1877942616469376:12345-192.168.204.20@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790945870.257195:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:8701:x1877942616469376:12345-192.168.204.20@tcp:501:mount.lustre.0 Request processed in 576us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945870.257205:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 298 00000100:00100000:1.0:1790945870.261419:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945870.261592:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616469504 00000100:00100000:2.0:1790945870.261604:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616469504 00000100:00100000:2.0:1790945870.261672:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 299 00000100:00100000:2.0:1790945870.261681:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:8701:x1877942616469504:12345-192.168.204.20@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790945870.261841:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:8701:x1877942616469504:12345-192.168.204.20@tcp:503:mount.lustre.0 Request processed in 160us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945870.261850:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 299 00000100:00100000:1.0:1790945870.267283:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945870.267369:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616469632 00000100:00100000:3.0:1790945870.267389:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616469632 00000100:00100000:3.0:1790945870.267588:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 300 00000100:00100000:3.0:1790945870.267609:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:8711:x1877942616469632:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790945870.267802:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:8711:x1877942616469632:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 204us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945870.267819:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 300 00000100:00100000:1.0:1790945870.276253:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945870.276354:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616469760 00000100:00100000:0.0:1790945870.276364:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616469760 00000100:00100000:0.0:1790945870.276440:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 301 00000100:00100000:0.0:1790945870.276460:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:8711:x1877942616469760:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790945870.276784:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:8711:x1877942616469760:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 334us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945870.276793:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 301 00000100:00100000:1.0:1790945870.298406:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945870.298462:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945870.298498:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945870.298531:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945870.298858:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616470016 00000100:00100000:2.0:1790945870.298870:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616470016 00000100:00100000:2.0:1790945870.298932:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616470144 00000100:00100000:2.0:1790945870.298936:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616470144 00000100:00100000:2.0:1790945870.298968:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616469888 00000100:00100000:2.0:1790945870.298971:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616469888 00000100:00100000:2.0:1790945870.298981:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616470400 00000100:00100000:2.0:1790945870.298983:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616470400 00000100:00100000:2.0:1790945870.298995:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 125 00000100:00100000:2.0:1790945870.299005:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2404:x1877942616470016:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790945870.299087:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2404:x1877942616470016:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 84us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945870.299095:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 125 00000100:00100000:2.0:1790945870.299117:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 126 00000100:00100000:2.0:1790945870.299123:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2404:x1877942616470144:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790945870.299147:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2404:x1877942616470144:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 24us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945870.299153:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 126 00000100:00100000:2.0:1790945870.299196:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:2.0:1790945870.299202:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2400:x1877942616469888:12345-192.168.204.20@tcp:38:mount.lustre.0 00010000:00080000:2.0:1790945870.299224:0:6521:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 0fac916e-06af-4e43-ae6d-171b0debcf61@192.168.204.20@tcp t0 exp 0000000000000000 cur 321 last 0 00000020:00000080:2.0:1790945870.299257:0:6521:0:(genops.c:1384:class_connect()) connect: client 0fac916e-06af-4e43-ae6d-171b0debcf61, cookie 0xd9f4181e0d27d23a 00000004:00100000:2.0:1790945870.299279:0:6521:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1790945870.299553:0:6521:0:(import.c:65:import_set_state_nolock()) ffff9d3f83707800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790945870.299584:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0fac916e-06af-4e43-ae6d-171b0debcf61+6:2400:x1877942616469888:12345-192.168.204.20@tcp:38:mount.lustre.0 Request processed in 381us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945870.299592:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:2.0:1790945870.299746:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:2.0:1790945870.299751:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2400:x1877942616470400:12345-192.168.204.20@tcp:38:mount.lustre.0 00010000:00080000:2.0:1790945870.299775:0:6521:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 0fac916e-06af-4e43-ae6d-171b0debcf61@192.168.204.20@tcp t0 exp 0000000000000000 cur 321 last 0 00000020:00000080:2.0:1790945870.299795:0:6521:0:(genops.c:1384:class_connect()) connect: client 0fac916e-06af-4e43-ae6d-171b0debcf61, cookie 0xd9f4181e0d27d241 00000004:00100000:2.0:1790945870.299809:0:6521:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1790945870.299863:0:6521:0:(import.c:65:import_set_state_nolock()) ffff9d3f83707000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790945870.299887:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0fac916e-06af-4e43-ae6d-171b0debcf61+6:2400:x1877942616470400:12345-192.168.204.20@tcp:38:mount.lustre.0 Request processed in 134us (1356us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945870.299893:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00080000:1.0:1790945870.300085:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790945870.300090:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790945870.303529:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945870.303749:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945870.303791:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945870.303862:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616470272 00000100:00100000:0.0:1790945870.303873:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616470272 00000100:00100000:0.0:1790945870.303941:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616470528 00000100:00100000:0.0:1790945870.303944:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616470528 00000100:00100000:0.0:1790945870.303966:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 18 00000100:00100000:0.0:1790945870.303975:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fac916e-06af-4e43-ae6d-171b0debcf61+6:0:x1877942616470272:12345-192.168.204.20@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790945870.304010:0:8457:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1790945870.304108:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fac916e-06af-4e43-ae6d-171b0debcf61+6:0:x1877942616470272:12345-192.168.204.20@tcp:41:mount.lustre.0 Request processed in 133us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945870.304128:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 18 00000100:00100000:0.0:1790945870.304146:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:0.0:1790945870.304152:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fac916e-06af-4e43-ae6d-171b0debcf61+6:0:x1877942616470528:12345-192.168.204.20@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790945870.304196:0:8457:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790945870.304232:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fac916e-06af-4e43-ae6d-171b0debcf61+6:0:x1877942616470528:12345-192.168.204.20@tcp:41:mount.lustre.0 Request processed in 80us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945870.304238:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00080000:1.0:1790945870.304696:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790945870.304700:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790945870.313326:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945870.313493:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616470656 00000100:00100000:0.0:1790945870.313505:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616470656 00000100:00100000:0.0:1790945870.313569:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 20 00000100:00100000:0.0:1790945870.313580:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fac916e-06af-4e43-ae6d-171b0debcf61+6:8701:x1877942616470656:12345-192.168.204.20@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790945870.313782:0:8457:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1790945870.313935:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fac916e-06af-4e43-ae6d-171b0debcf61+6:8701:x1877942616470656:12345-192.168.204.20@tcp:41:mount.lustre.0 Request processed in 355us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945870.313944:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 20 00000100:00100000:0.0:1790945870.319953:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945870.320164:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616470784 00000100:00100000:3.0:1790945870.320193:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616470784 00000100:00100000:3.0:1790945870.320269:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 21 00000100:00100000:3.0:1790945870.320280:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4db2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fac916e-06af-4e43-ae6d-171b0debcf61+6:8701:x1877942616470784:12345-192.168.204.20@tcp:40:mount.lustre.0 00000100:00100000:3.0:1790945870.320727:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4db2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fac916e-06af-4e43-ae6d-171b0debcf61+6:8701:x1877942616470784:12345-192.168.204.20@tcp:40:mount.lustre.0 Request processed in 448us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945870.320736:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 21 00000100:00100000:1.0:1790945870.329945:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945870.330036:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945870.330289:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945870.331193:0:6533:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616471168 00000100:00100000:3.0:1790945870.331204:0:6533:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616471168 00000100:00100000:2.0:1790945870.331370:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00100000:2.0:1790945870.331381:0:6533:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0fac916e-06af-4e43-ae6d-171b0debcf61+6:8701:x1877942616471168:12345-192.168.204.20@tcp:900:mount.lustre.0 00000100:00100000:2.0:1790945870.331491:0:6533:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0fac916e-06af-4e43-ae6d-171b0debcf61+6:8701:x1877942616471168:12345-192.168.204.20@tcp:900:mount.lustre.0 Request processed in 112us (1555us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945870.331499:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00100000:1.0:1790945870.335110:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945870.335274:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616471296 00000100:00100000:3.0:1790945870.335286:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616471296 00000100:00100000:3.0:1790945870.335362:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1 00000100:00100000:3.0:1790945870.335373:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0fac916e-06af-4e43-ae6d-171b0debcf61+6:8701:x1877942616471296:12345-192.168.204.20@tcp:33:mount.lustre.0 00000004:00200000:3.0:1790945870.335512:0:6524:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1790945870.335842:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0fac916e-06af-4e43-ae6d-171b0debcf61+6:8701:x1877942616471296:12345-192.168.204.20@tcp:33:mount.lustre.0 Request processed in 470us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945870.335862:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1 00000100:00100000:0.0:1790945870.338586:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616470912 00000100:00100000:2.0:1790945870.338759:0:8436:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616471040 00000100:00100000:2.0:1790945870.338768:0:8436:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616471040 00000100:00100000:0.0:1790945870.338936:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616470912 00000100:00100000:2.0:1790945870.338990:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 20 00000100:00100000:2.0:1790945870.338998:0:8436:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2400:x1877942616471040:12345-192.168.204.20@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790945870.339031:0:8436:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 0fac916e-06af-4e43-ae6d-171b0debcf61@192.168.204.20@tcp t0 exp 0000000000000000 cur 321 last 0 00000020:00000080:2.0:1790945870.339073:0:8436:0:(genops.c:1384:class_connect()) connect: client 0fac916e-06af-4e43-ae6d-171b0debcf61, cookie 0xd9f4181e0d27d248 00002000:00100000:2.0:1790945870.339087:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0fac916e-06af-4e43-ae6d-171b0debcf61/ffff9d3f83703000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790945870.339104:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790945870.339195:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790945870.339237:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9d3f83700800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790945870.339323:0:8436:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0fac916e-06af-4e43-ae6d-171b0debcf61+6:2400:x1877942616471040:12345-192.168.204.20@tcp:8:mount.lustre.0 Request processed in 315us (9025us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945870.339351:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 20 00000100:00100000:2.0:1790945870.339389:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 21 00000100:00100000:2.0:1790945870.339394:0:8436:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2400:x1877942616470912:12345-192.168.204.20@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790945870.339418:0:8436:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 0fac916e-06af-4e43-ae6d-171b0debcf61@192.168.204.20@tcp t0 exp 0000000000000000 cur 321 last 0 00000020:00000080:2.0:1790945870.339436:0:8436:0:(genops.c:1384:class_connect()) connect: client 0fac916e-06af-4e43-ae6d-171b0debcf61, cookie 0xd9f4181e0d27d24f 00002000:00100000:2.0:1790945870.339441:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0fac916e-06af-4e43-ae6d-171b0debcf61/ffff9d3f83705000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790945870.339463:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790945870.339499:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790945870.339514:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9d3f83700000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790945870.339538:0:8436:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0fac916e-06af-4e43-ae6d-171b0debcf61+6:2400:x1877942616470912:12345-192.168.204.20@tcp:8:mount.lustre.0 Request processed in 142us (9502us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945870.339546:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 21 00000100:00100000:3.0:1790945870.690476:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638563712:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790945870.690564:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945870.690803:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638563712 00000100:00100000:2.0:1790945870.690812:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638563712 00000100:00100000:2.0:1790945870.690879:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790945870.690889:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8301a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638563712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790945870.690918:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790945870.694752:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8301a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638563712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3855us (4178us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945870.694768:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1790945870.699616:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638563712:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1790945871.328703:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945871.711321:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638563840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790945871.711409:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945871.711432:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638563968:0@lo:400:kworker.0 00000100:00100000:0.0:1790945871.711476:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945871.711485:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638564480:0@lo:400:kworker.0 00000100:00100000:0.0:1790945871.711509:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877942638564352:0@lo:400:kworker.0 00000100:00100000:2.0:1790945871.711526:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945871.711547:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945871.711551:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638564992:0@lo:400:kworker.0 00000100:00100000:0.0:1790945871.711574:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638564864:0@lo:400:kworker.0 00000100:00100000:2.0:1790945871.711582:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945871.711606:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945871.711611:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638565504:0@lo:400:kworker.0 00000100:00100000:2.0:1790945871.711642:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945871.711644:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638565376:0@lo:400:kworker.0 00000100:00100000:2.0:1790945871.711669:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1790945871.711677:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638564096:0@lo:400:kworker.0 00000100:00100000:0.0:1790945871.711692:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945871.711709:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945871.711720:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1790945871.711729:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4db0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638564224:0@lo:400:kworker.0 00000100:00100000:2.0:1790945871.711736:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1877942638564608:0@lo:400:kworker.0 00000100:00100000:0.0:1790945871.711761:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945871.711771:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945871.711785:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1877942638564736:0@lo:400:kworker.0 00000100:00100000:2.0:1790945871.711796:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1877942638565120:0@lo:400:kworker.0 00000100:00100000:0.0:1790945871.711814:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945871.711839:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638563840 00000100:00100000:2.0:1790945871.711847:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638563840 00000100:00100000:0.0:1790945871.711850:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1877942638565248:0@lo:400:kworker.0 00000100:00100000:0.0:1790945871.711876:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945871.711909:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638563968 00000100:00100000:2.0:1790945871.711914:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790945871.711915:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638563968 00000100:00100000:2.0:1790945871.711927:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638563840:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790945871.711947:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00002000:00000024:2.0:1790945871.711950:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790945871.711957:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3650:x1877942638563968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945871.712805:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638563840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 878us (1393us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945871.712815:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790945871.712847:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638564992 00000100:00100000:2.0:1790945871.712857:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638564992 00000100:00100000:2.0:1790945871.712891:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638564864 00000100:00100000:2.0:1790945871.712895:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638564864 00000100:00100000:2.0:1790945871.712910:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638565504 00000100:00100000:2.0:1790945871.712913:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638565504 00000100:00100000:2.0:1790945871.712923:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638565376 00000100:00100000:2.0:1790945871.712925:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638565376 00000100:00100000:2.0:1790945871.712949:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790945871.712957:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638564992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945871.713002:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638564992:12345-0@lo:400:kworker.0 Request processed in 46us (1419us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945871.713009:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790945871.713253:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790945871.713263:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638564864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945871.713306:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638564864:12345-0@lo:400:kworker.0 Request processed in 46us (1700us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945871.713312:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790945871.713325:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790945871.713646:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3650:x1877942638563968:12345-0@lo:400:kworker.0 Request processed in 1690us (2168us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945871.713655:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1790945871.713704:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638564480 00000100:00100000:0.0:1790945871.713709:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638564480 00000100:00100000:0.0:1790945871.713735:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638564224 00000100:00100000:0.0:1790945871.713738:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638564224 00000100:00100000:0.0:1790945871.713751:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1790945871.713758:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638564480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945871.713792:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638564480:12345-0@lo:400:kworker.0 Request processed in 35us (2268us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945871.713799:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1790945871.713810:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1790945871.713827:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40baced500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638564224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945871.713866:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40baced500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638564224:12345-0@lo:400:kworker.0 Request processed in 50us (2105us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945871.713873:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1790945871.713892:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638564352 00000100:00100000:0.0:1790945871.713895:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638564352 00000100:00100000:0.0:1790945871.713912:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638564096 00000100:00100000:0.0:1790945871.713914:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638564096 00000100:00100000:0.0:1790945871.713923:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638564608 00000100:00100000:0.0:1790945871.713925:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638564608 00000100:00100000:0.0:1790945871.713937:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638564736 00000100:00100000:0.0:1790945871.713940:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638564736 00000100:00100000:0.0:1790945871.713949:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638565248 00000100:00100000:0.0:1790945871.713951:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638565248 00000100:00100000:0.0:1790945871.713965:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1790945871.713972:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877942638564352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945871.714003:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877942638564352:12345-0@lo:400:kworker.0 Request processed in 31us (2456us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945871.714008:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1790945871.714018:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1790945871.714024:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638564096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945871.714051:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638564096:12345-0@lo:400:kworker.0 Request processed in 27us (2343us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945871.714057:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1790945871.714068:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1790945871.714074:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1877942638564608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945871.714100:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1877942638564608:12345-0@lo:400:kworker.0 Request processed in 26us (2330us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945871.714115:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1790945871.714127:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1790945871.714133:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bacefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1877942638564736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945871.714161:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bacefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1877942638564736:12345-0@lo:400:kworker.0 Request processed in 29us (2349us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945871.714182:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1790945871.714193:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1790945871.714200:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bacef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877942638565248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945871.714226:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bacef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877942638565248:12345-0@lo:400:kworker.0 Request processed in 27us (2350us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945871.714231:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1790945871.714251:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790945871.714258:0:10099:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638565376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945871.714288:0:10099:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638565376:12345-0@lo:400:kworker.0 Request processed in 31us (2598us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945871.714294:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790945871.714350:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4db0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638564224:0@lo:400:kworker.0 00010000:00080000:0.0:1790945871.714363:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcb15180 x1877942638564736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945871.714374:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1877942638564736:0@lo:400:kworker.0 00010000:00080000:0.0:1790945871.714397:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcb17100 x1877942638565248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945871.714406:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1877942638565248:0@lo:400:kworker.0 00000100:00100000:0.0:1790945871.714426:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638563968:0@lo:400:kworker.0 00000100:00100000:0.0:1790945871.714436:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877942638564352:0@lo:400:kworker.0 00010000:00080000:0.0:1790945871.714446:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcb14700 x1877942638564864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945871.714454:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638564864:0@lo:400:kworker.0 00010000:00080000:0.0:1790945871.714464:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcb16300 x1877942638565376/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945871.714472:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638565376:0@lo:400:kworker.0 00000100:00100000:0.0:1790945871.714514:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945871.714545:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638565632:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790945871.714573:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945871.714599:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638564480:0@lo:400:kworker.0 00010000:00080000:0.0:1790945871.714610:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcb15500 x1877942638564992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945871.714618:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638564992:0@lo:400:kworker.0 00010000:00080000:0.0:1790945871.714629:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcbc1180 x1877942638563840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945887 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945871.714642:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638563840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790945871.714664:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638564096:0@lo:400:kworker.0 00000100:00100000:0.0:1790945871.714673:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1877942638564608:0@lo:400:kworker.0 00000100:00100000:0.0:1790945871.714690:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638565120 00000100:00100000:0.0:1790945871.714700:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638565120 00000100:00100000:0.0:1790945871.714727:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1790945871.714733:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bacef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1877942638565120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945871.714767:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bacef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1877942638565120:12345-0@lo:400:kworker.0 Request processed in 34us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945871.714772:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1790945871.714789:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638565632 00000100:00100000:0.0:1790945871.714793:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638565632 00000100:00100000:0.0:1790945871.714817:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790945871.714823:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bacec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638565632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790945871.714835:0:8438:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790945871.714864:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bacec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638565632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945871.714870:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790945871.714897:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1877942638565120:0@lo:400:kworker.0 00010000:00080000:0.0:1790945871.714906:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcb39180 x1877942638565632/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945887 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945871.714918:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638565632:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790945871.715820:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638565504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945871.715878:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638565504:12345-0@lo:400:kworker.0 Request processed in 2547us (4235us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945871.715886:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1790945871.715923:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790945871.715928:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790945871.715931:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790945871.715934:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1790945871.718368:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcb3b800 x1877942638565504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945871.718400:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638565504:0@lo:400:kworker.0 00010000:00010000:1.0:1790945872.351540:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945873.379224:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945873.759836:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790945873.759862:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638565760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790945873.759934:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945873.760098:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638565760 00000100:00100000:1.0:1790945873.760108:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638565760 00000100:00100000:1.0:1790945873.760199:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790945873.760211:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638565760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790945873.760239:0:8438:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790945873.760292:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638565760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945873.760542:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:1.0:1790945873.760701:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcbbc700 x1877942638565760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945889 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945873.760720:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638565760:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790945873.761108:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790945873.761200:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638565888:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790945873.761247:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945873.761571:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638565888 00000100:00100000:2.0:1790945873.761578:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638565888 00000100:00100000:2.0:1790945873.761622:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790945873.761629:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40baced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638565888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790945873.761660:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790945873.761703:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40baced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638565888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945873.761708:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1790945873.761743:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcbbc700 x1877942638565888/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945889 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945873.761758:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638565888:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1790945873.762756:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790945874.399322:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945875.300980:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638566016:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790945875.301055:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945875.301276:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638566016 00000100:00100000:1.0:1790945875.301284:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638566016 00000100:00100000:1.0:1790945875.301344:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790945875.301353:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638566016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790945875.301388:0:6526:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1790945875.301435:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638566016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945875.301454:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790945875.301503:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638566016:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1790945875.423420:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945875.524734:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945875.524774:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945875.524811:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945875.524847:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945875.524872:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945875.524892:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945875.524913:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945875.524942:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616471424 00000100:00100000:1.0:1790945875.524965:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616471424 00000100:00100000:1.0:1790945875.525019:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 303 00000100:00100000:1.0:1790945875.525028:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:2403:x1877942616471424:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945875.525114:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:2403:x1877942616471424:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 87us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945875.525123:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 303 00000100:00100000:1.0:1790945875.525154:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616471552 00000100:00100000:1.0:1790945875.525158:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616471552 00000100:00100000:1.0:1790945875.525218:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616471808 00000100:00100000:1.0:1790945875.525222:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616471808 00000100:00100000:1.0:1790945875.525250:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616471680 00000100:00100000:1.0:1790945875.525254:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616471680 00000100:00100000:1.0:1790945875.525266:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616471936 00000100:00100000:1.0:1790945875.525268:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616471936 00000100:00100000:1.0:1790945875.525281:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 133 00000100:00100000:1.0:1790945875.525300:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2403:x1877942616471552:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945875.525342:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2403:x1877942616471552:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 43us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945875.525349:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 133 00000100:00100000:1.0:1790945875.525361:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 134 00000100:00100000:1.0:1790945875.525368:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fac916e-06af-4e43-ae6d-171b0debcf61+6:2403:x1877942616471808:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945875.525392:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fac916e-06af-4e43-ae6d-171b0debcf61+6:2403:x1877942616471808:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 25us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945875.525398:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 134 00000100:00100000:1.0:1790945875.525408:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 135 00000100:00100000:1.0:1790945875.525414:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2403:x1877942616471680:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945875.525437:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2403:x1877942616471680:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 23us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945875.525452:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 135 00000100:00100000:1.0:1790945875.525464:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 136 00000100:00100000:1.0:1790945875.525471:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fac916e-06af-4e43-ae6d-171b0debcf61+6:2403:x1877942616471936:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945875.525495:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fac916e-06af-4e43-ae6d-171b0debcf61+6:2403:x1877942616471936:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 25us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945875.525501:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 136 00000100:00100000:1.0:1790945875.525523:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616472064 00000100:00100000:1.0:1790945875.525526:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616472064 00000100:00100000:1.0:1790945875.525553:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616472192 00000100:00100000:1.0:1790945875.525556:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616472192 00000100:00100000:1.0:1790945875.525577:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 56 00000100:00100000:1.0:1790945875.525583:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0fac916e-06af-4e43-ae6d-171b0debcf61+6:2403:x1877942616472064:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945875.525607:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0fac916e-06af-4e43-ae6d-171b0debcf61+6:2403:x1877942616472064:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 25us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945875.525613:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 56 00000100:00100000:1.0:1790945875.525625:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 57 00000100:00100000:1.0:1790945875.525632:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0fac916e-06af-4e43-ae6d-171b0debcf61+6:2403:x1877942616472192:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945875.525655:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0fac916e-06af-4e43-ae6d-171b0debcf61+6:2403:x1877942616472192:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 24us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945875.525660:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 57 00000100:00080000:1.0:1790945875.525792:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790945875.525796:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790945875.525799:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790945875.525800:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790945875.819656:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638566144:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790945875.819722:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945875.819877:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638566144 00000100:00100000:1.0:1790945875.819902:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638566144 00000100:00100000:1.0:1790945875.819973:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1790945875.819982:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bad28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638566144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790945875.820020:0:6526:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790945875.820073:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bad28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638566144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945875.820080:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790945875.820223:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638566144:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1790945876.191889:0:12189:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-client.virtnet: executing check_config_client /mnt/lustre 00000001:00100000:3.0:1790945876.325824:0:6500:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0fac916e-06af-4e43-ae6d-171b0debcf61 00000001:00100000:3.0:1790945876.325853:0:8429:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0fac916e-06af-4e43-ae6d-171b0debcf61 00000001:00100000:3.0:1790945876.326767:0:7452:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 0fac916e-06af-4e43-ae6d-171b0debcf61 00000001:00100000:0.0:1790945876.338876:0:9515:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0fac916e-06af-4e43-ae6d-171b0debcf61 00010000:00010000:3.0:1790945876.447432:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945876.831533:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40baceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638566272:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790945876.831607:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945876.831677:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790945876.831683:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638566400:0@lo:400:kworker.0 00000100:00100000:3.0:1790945876.831725:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945876.831747:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638566784:0@lo:400:kworker.0 00000100:00100000:1.0:1790945876.831748:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638566656:0@lo:400:kworker.0 00000100:00100000:3.0:1790945876.831772:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945876.831773:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945876.831789:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638567296:0@lo:400:kworker.0 00000100:00100000:3.0:1790945876.831812:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945876.831829:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638567808:0@lo:400:kworker.0 00000100:00100000:2.0:1790945876.831833:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638566912:0@lo:400:kworker.0 00000100:00100000:3.0:1790945876.831849:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945876.831902:0:11925:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638566272 00000100:00100000:0.0:1790945876.831911:0:11925:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638566272 00000100:00100000:1.0:1790945876.833325:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1877942638567168:0@lo:400:kworker.0 00000100:00100000:3.0:1790945876.833594:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638566656 00000100:00100000:3.0:1790945876.833601:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638566656 00000100:00100000:3.0:1790945876.833653:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1790945876.833663:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638566656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945876.833726:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638566656:12345-0@lo:400:kworker.0 Request processed in 64us (1949us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945876.833733:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1790945876.833758:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638566784 00000100:00100000:3.0:1790945876.833762:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638566784 00000100:00100000:3.0:1790945876.833787:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1790945876.833794:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8301b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638566784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945876.833831:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8301b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638566784:12345-0@lo:400:kworker.0 Request processed in 37us (2058us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945876.833852:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1790945876.833874:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945876.833896:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638567424:0@lo:400:kworker.0 00000100:00100000:3.0:1790945876.833991:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945876.834019:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945876.834043:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1877942638567680:0@lo:400:kworker.0 00000100:00100000:1.0:1790945876.834068:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945876.834105:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638566656:0@lo:400:kworker.0 00000100:00100000:1.0:1790945876.834121:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1790945876.834127:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877942638566528:0@lo:400:kworker.0 00000100:00100000:1.0:1790945876.834150:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945876.834186:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1877942638567040:0@lo:400:kworker.0 00000100:00100000:1.0:1790945876.834209:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945876.834221:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1877942638567552:0@lo:400:kworker.0 00000100:00100000:1.0:1790945876.834242:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945876.835070:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790945876.835083:0:11925:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83018380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638566272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790945876.835114:0:11925:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790945876.835183:0:11925:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83018380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638566272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (3576us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945876.835189:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790945876.835224:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638566400 00000100:00100000:0.0:1790945876.835230:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638566400 00000100:00100000:0.0:1790945876.835258:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1790945876.835266:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3649:x1877942638566400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945876.835312:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3649:x1877942638566400:12345-0@lo:400:kworker.0 Request processed in 48us (3586us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945876.835320:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1790945876.835377:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638567168 00000100:00100000:0.0:1790945876.835381:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638567168 00000100:00100000:0.0:1790945876.835404:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638567680 00000100:00100000:0.0:1790945876.835406:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638567680 00000100:00100000:0.0:1790945876.835418:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638566528 00000100:00100000:0.0:1790945876.835421:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638566528 00000100:00100000:0.0:1790945876.835430:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638567040 00000100:00100000:0.0:1790945876.835432:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638567040 00000100:00100000:0.0:1790945876.835442:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638567552 00000100:00100000:0.0:1790945876.835444:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638567552 00000100:00100000:0.0:1790945876.835455:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1790945876.835460:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1877942638567168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945876.835499:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1877942638567168:12345-0@lo:400:kworker.0 Request processed in 38us (1480us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945876.835521:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1790945876.835534:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1790945876.835540:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1877942638567680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945876.835571:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1877942638567680:12345-0@lo:400:kworker.0 Request processed in 31us (1501us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945876.835576:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1790945876.835586:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1790945876.835592:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1877942638566528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945876.835619:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1877942638566528:12345-0@lo:400:kworker.0 Request processed in 28us (1468us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945876.835625:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1790945876.835636:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1790945876.835641:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1877942638567040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945876.835668:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1877942638567040:12345-0@lo:400:kworker.0 Request processed in 27us (1458us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945876.835673:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1790945876.835683:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1790945876.835689:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1877942638567552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945876.835713:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1877942638567552:12345-0@lo:400:kworker.0 Request processed in 25us (1471us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945876.835719:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1790945876.835758:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877942638566528:0@lo:400:kworker.0 00000100:00100000:0.0:1790945876.835768:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1877942638567040:0@lo:400:kworker.0 00000100:00100000:0.0:1790945876.835790:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1877942638567552:0@lo:400:kworker.0 00010000:00080000:0.0:1790945876.835804:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f825a5c00 x1877942638567168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945876.835814:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1877942638567168:0@lo:400:kworker.0 00010000:00080000:0.0:1790945876.835823:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f825a6300 x1877942638567680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945876.835830:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1877942638567680:0@lo:400:kworker.0 00000100:00080000:0.0:1790945876.837970:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790945876.837980:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790945876.837983:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790945876.838042:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638566912 00000100:00100000:0.0:1790945876.838052:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638566912 00000100:00100000:0.0:1790945876.838102:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1790945876.838111:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638566912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945876.838221:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638566912:12345-0@lo:400:kworker.0 Request processed in 111us (4345us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945876.838227:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1790945876.838273:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638566784:0@lo:400:kworker.0 00000100:00100000:0.0:1790945876.838297:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638566400:0@lo:400:kworker.0 00010000:00080000:0.0:1790945876.838312:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40baceea00 x1877942638566272/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945892 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945876.838328:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40baceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638566272:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790945876.840495:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bad28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638567936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790945876.840563:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945876.840606:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638567936 00000100:00100000:3.0:1790945876.840614:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638567936 00000100:00100000:2.0:1790945876.840698:0:8436:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638567296 00000100:00100000:1.0:1790945876.840699:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638567808 00000100:00100000:2.0:1790945876.840704:0:8436:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638567296 00000100:00100000:1.0:1790945876.840706:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638567808 00000100:00100000:2.0:1790945876.840746:0:8436:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638567424 00000100:00100000:2.0:1790945876.840750:0:8436:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638567424 00000100:00100000:2.0:1790945876.840777:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790945876.840785:0:8436:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638567296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945876.840856:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790945876.840865:0:8436:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638567296:12345-0@lo:400:kworker.0 Request processed in 70us (9041us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945876.840883:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83019180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1877942638567808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945876.841202:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790945876.841226:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790945876.841242:0:8436:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83019500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638567424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945876.841298:0:8436:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83019500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638567424:12345-0@lo:400:kworker.0 Request processed in 57us (7306us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945876.841306:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1790945876.841307:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790945876.841313:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790945876.841328:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790945876.841343:0:11925:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1877942638567936:12345-0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1790945876.841352:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f825a5880 x1877942638567296/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00002000:00000024:1.0:1790945876.841360:0:11925:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790945876.841369:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638567296:0@lo:400:kworker.0 00000100:00100000:1.0:1790945876.841402:0:11925:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1877942638567936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945876.841410:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:2.0:1790945876.841417:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bad28700 x1877942638567936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945892 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945876.841434:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bad28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638567936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790945876.841460:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638566912:0@lo:400:kworker.0 00010000:00080000:2.0:1790945876.841470:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f825a4000 x1877942638567424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945876.841478:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638567424:0@lo:400:kworker.0 00000100:00100000:0.0:1790945876.841597:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83019180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638567808:12345-0@lo:400:kworker.0 Request processed in 716us (9745us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945876.841604:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:2.0:1790945876.842099:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f825a4a80 x1877942638567808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945876.842109:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638567808:0@lo:400:kworker.0 00010000:00010000:2.0:1790945877.474811:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945878.497456:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945878.879755:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638568064:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790945878.879837:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945878.882031:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638568064 00000100:00100000:1.0:1790945878.882047:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638568064 00000100:00100000:1.0:1790945878.882108:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790945878.882120:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638568064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790945878.882155:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790945878.883042:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83018a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638568192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790945878.883111:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945878.883180:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638568192 00000100:00100000:3.0:1790945878.883185:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638568192 00000100:00100000:3.0:1790945878.883216:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790945878.883224:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83646d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638568192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790945878.883239:0:8438:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790945878.883290:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83646d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638568192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945878.883298:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:3.0:1790945878.883352:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f83018a80 x1877942638568192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945894 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945878.883372:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83018a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638568192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790945878.884540:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638568064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2419us (4699us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945878.884551:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1790945878.884577:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790945878.884623:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40b4d03100 x1877942638568064/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945894 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945878.884641:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638568064:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1790945879.520679:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945880.415427:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790945880.415451:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638568320:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790945880.415522:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945880.415706:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638568320 00000100:00100000:0.0:1790945880.415714:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638568320 00000100:00100000:0.0:1790945880.415763:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1790945880.415771:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638568320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790945880.415812:0:6526:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1790945880.415869:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638568320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945880.415876:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1790945880.416032:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638568320:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1790945880.551902:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945880.645030:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945880.645066:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945880.645104:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945880.645141:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945880.645164:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945880.645201:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945880.645294:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945880.645321:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616472320 00000100:00100000:1.0:1790945880.645330:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616472320 00000100:00100000:1.0:1790945880.645373:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 305 00000100:00100000:1.0:1790945880.645382:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:2401:x1877942616472320:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945880.645446:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:2401:x1877942616472320:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 66us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945880.645454:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 305 00000100:00100000:1.0:1790945880.645487:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616472960 00000100:00100000:1.0:1790945880.645491:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616472960 00000100:00100000:0.0:1790945880.645493:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616472448 00000100:00100000:0.0:1790945880.645496:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616472448 00000100:00100000:1.0:1790945880.645535:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616473088 00000100:00100000:1.0:1790945880.645538:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616473088 00000100:00100000:1.0:1790945880.645560:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 61 00000100:00100000:1.0:1790945880.645578:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2402:x1877942616472960:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945880.645608:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2402:x1877942616472960:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 32us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945880.645615:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 61 00000100:00100000:1.0:1790945880.645627:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 62 00000100:00100000:1.0:1790945880.645633:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bfef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2401:x1877942616473088:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945880.645655:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bfef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2401:x1877942616473088:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 23us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945880.645661:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 62 00000100:00100000:0.0:1790945880.645678:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616472704 00000100:00100000:0.0:1790945880.645681:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616472704 00000100:00100000:0.0:1790945880.645697:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616472576 00000100:00100000:0.0:1790945880.645699:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616472576 00000100:00100000:0.0:1790945880.645710:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616472832 00000100:00100000:0.0:1790945880.645712:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616472832 00000100:00100000:0.0:1790945880.645725:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 143 00000100:00100000:0.0:1790945880.645732:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2402:x1877942616472448:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790945880.645761:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2402:x1877942616472448:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 30us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945880.645767:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 143 00000100:00100000:0.0:1790945880.645780:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 144 00000100:00100000:0.0:1790945880.645786:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2402:x1877942616472704:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790945880.645833:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2402:x1877942616472704:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 47us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945880.645840:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 144 00000100:00100000:0.0:1790945880.645853:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 145 00000100:00100000:0.0:1790945880.645859:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2401:x1877942616472576:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790945880.645882:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2401:x1877942616472576:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 24us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945880.645888:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 145 00000100:00100000:0.0:1790945880.645900:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 146 00000100:00100000:0.0:1790945880.645906:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2401:x1877942616472832:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790945880.645928:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2401:x1877942616472832:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 23us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945880.645935:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 146 00000100:00080000:2.0:1790945880.646099:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790945880.646105:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790945880.646107:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790945880.646109:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790945880.929693:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790945880.929718:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bfef1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638568448:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790945880.929800:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945880.929995:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638568448 00000100:00100000:1.0:1790945880.930003:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638568448 00000100:00100000:1.0:1790945880.930060:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790945880.930070:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40baceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638568448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790945880.930116:0:6526:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790945880.930164:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40baceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638568448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945880.930196:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1790945880.930423:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bfef1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638568448:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1790945881.570993:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945881.951880:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790945881.951902:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83018a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638568576:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790945881.951970:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945881.952031:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638568576 00000100:00100000:3.0:1790945881.952039:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638568576 00000100:00100000:3.0:1790945881.952095:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790945881.952104:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638568576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790945881.952130:0:8438:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790945881.952215:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638568576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 111us (243us total) trans 0 rc 0/0 00010000:00080000:0.0:1790945881.952243:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f83018a80 x1877942638568576/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945897 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945881.952261:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83018a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638568576:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790945881.952759:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1790945881.952787:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790945881.953597:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790945881.953609:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40baceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638568704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790945881.953648:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945881.953705:0:11925:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638568704 00000100:00100000:0.0:1790945881.953710:0:11925:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638568704 00000100:00100000:0.0:1790945881.953743:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790945881.953751:0:11925:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bacece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638568704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790945881.953787:0:11925:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790945881.953826:0:11925:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bacece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638568704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945881.953833:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:0.0:1790945881.953863:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40baceed80 x1877942638568704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945897 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945881.953878:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40baceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638568704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790945881.955321:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40baceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638568832:0@lo:400:kworker.0 00000100:00100000:0.0:1790945881.955366:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790945881.955377:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790945881.955389:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1877942638569216:0@lo:400:kworker.0 00000100:00100000:0.0:1790945881.955393:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638569344:0@lo:400:kworker.0 00000100:00100000:3.0:1790945881.955415:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945881.955415:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945881.955431:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638569728:0@lo:400:kworker.0 00000100:00100000:0.0:1790945881.955431:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638569856:0@lo:400:kworker.0 00000100:00100000:0.0:1790945881.955451:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945881.955458:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638569216 00000100:00100000:3.0:1790945881.955463:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638569216 00000100:00100000:0.0:1790945881.955474:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1790945881.955480:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83018a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877942638568960:0@lo:400:kworker.0 00000100:00100000:3.0:1790945881.955495:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1790945881.955499:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945881.955503:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1877942638569216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945881.955512:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1877942638569472:0@lo:400:kworker.0 00000100:00100000:3.0:1790945881.955538:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1877942638569216:12345-0@lo:400:kworker.0 Request processed in 36us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945881.955545:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1790945881.955558:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638568960 00000100:00100000:3.0:1790945881.955568:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638568960 00000100:00100000:3.0:1790945881.955591:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1790945881.955591:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945881.955596:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877942638568960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945881.955604:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1877942638569984:0@lo:400:kworker.0 00000100:00100000:0.0:1790945881.955623:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945881.955637:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877942638568960:12345-0@lo:400:kworker.0 Request processed in 40us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945881.955642:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1790945881.955644:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83018a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877942638568960:0@lo:400:kworker.0 00000100:00100000:3.0:1790945881.955652:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638569472 00000100:00100000:3.0:1790945881.955655:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638569472 00000100:00100000:0.0:1790945881.955673:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638568832 00000100:00100000:0.0:1790945881.955677:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638568832 00000100:00100000:3.0:1790945881.955686:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638569984 00000100:00100000:3.0:1790945881.955689:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638569984 00000100:00100000:0.0:1790945881.955698:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1790945881.955702:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1790945881.955703:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3649:x1877942638568832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945881.955706:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877942638569472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945881.955734:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877942638569472:12345-0@lo:400:kworker.0 Request processed in 27us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945881.955740:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1790945881.955751:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1790945881.955757:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1877942638569984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945881.956554:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638569344 00000100:00100000:1.0:1790945881.956559:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638569344 00000100:00100000:1.0:1790945881.956596:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1790945881.956604:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638569344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945881.963383:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945881.963470:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1877942638569216:0@lo:400:kworker.0 00000100:00100000:2.0:1790945881.963488:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1790945881.963501:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638569088:0@lo:400:kworker.0 00000100:00100000:2.0:1790945881.963664:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945881.963681:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1877942638569600:0@lo:400:kworker.0 00000100:00100000:2.0:1790945881.963705:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945881.963724:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1877942638570112:0@lo:400:kworker.0 00000100:00100000:2.0:1790945881.963744:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945881.963934:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638569600 00000100:00100000:2.0:1790945881.963941:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638569600 00000100:00100000:2.0:1790945881.963976:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638570112 00000100:00100000:2.0:1790945881.963979:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638570112 00000100:00100000:2.0:1790945881.963995:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1790945881.964002:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bad28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1877942638569600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945881.964052:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bad28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1877942638569600:12345-0@lo:400:kworker.0 Request processed in 50us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945881.964059:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1790945881.964079:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1790945881.964084:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bad29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1877942638570112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945881.969070:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3649:x1877942638568832:12345-0@lo:400:kworker.0 Request processed in 13355us (13692us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945881.969084:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1790945881.969148:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638569856 00000100:00100000:0.0:1790945881.969157:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638569856 00000100:00100000:0.0:1790945881.969238:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638569728 00000100:00100000:0.0:1790945881.969243:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638569728 00000100:00100000:0.0:1790945881.969269:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790945881.969277:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638569856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945881.969343:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638569856:12345-0@lo:400:kworker.0 Request processed in 67us (13890us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945881.969350:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790945881.969363:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790945881.969369:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bad28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638569728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945881.969402:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bad28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638569728:12345-0@lo:400:kworker.0 Request processed in 33us (6026us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945881.969408:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790945881.969638:0:6527:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1790945881.969646:0:6527:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00080000:0.0:1790945881.970322:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790945881.970328:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790945881.970331:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790945881.970365:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1877942638569472:0@lo:400:kworker.0 00000100:00100000:0.0:1790945881.970396:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1877942638569984:0@lo:400:kworker.0 00000100:00100000:0.0:1790945881.970406:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40baceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638568832:0@lo:400:kworker.0 00000100:00100000:0.0:1790945881.970415:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638569344:0@lo:400:kworker.0 00010000:00080000:0.0:1790945881.970427:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f825a5f80 x1877942638569856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945881.970437:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638569856:0@lo:400:kworker.0 00000100:00100000:2.0:1790945881.970816:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bad29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1877942638570112:12345-0@lo:400:kworker.0 Request processed in 6729us (7069us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945881.970825:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00010000:00080000:2.0:1790945881.970870:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f825a5c00 x1877942638569600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945881.970881:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1877942638569600:0@lo:400:kworker.0 00010000:00080000:2.0:1790945881.970902:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcb39180 x1877942638570112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945881.970911:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1877942638570112:0@lo:400:kworker.0 00010000:00080000:2.0:1790945881.970921:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f825a7800 x1877942638569728/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945881.970928:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638569728:0@lo:400:kworker.0 00000100:00100000:2.0:1790945881.971046:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638569088 00000100:00100000:2.0:1790945881.971052:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638569088 00000100:00100000:2.0:1790945881.971196:0:12418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790945881.971205:0:12418:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bad29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638569088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945881.971638:0:12418:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bad29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638569088:12345-0@lo:400:kworker.0 Request processed in 434us (7974us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945881.971645:0:12418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790945881.971673:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638569088:0@lo:400:kworker.0 00000100:00100000:3.0:1790945881.977747:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1877942638569984:12345-0@lo:400:kworker.0 Request processed in 21977us (22110us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945881.977762:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1790945881.979421:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638569344:12345-0@lo:400:kworker.0 Request processed in 22814us (24000us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945881.979433:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00010000:1.0:1790945882.593616:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945883.615496:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945884.000428:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bfef0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638570240:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790945884.000503:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945884.000627:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638570240 00000100:00100000:1.0:1790945884.000636:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638570240 00000100:00100000:1.0:1790945884.000695:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790945884.000705:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcd84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638570240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790945884.000736:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790945884.000794:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcd84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638570240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945884.000802:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1790945884.000973:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790945884.001007:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bfef0e00 x1877942638570240/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945900 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945884.001025:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bfef0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638570240:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790945884.007576:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790945884.007599:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bfef1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638570368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790945884.007665:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945884.007717:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638570368 00000100:00100000:2.0:1790945884.007724:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638570368 00000100:00100000:2.0:1790945884.007792:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790945884.007801:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bad2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638570368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790945884.007822:0:8438:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790945884.007876:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bad2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638570368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945884.007893:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:2.0:1790945884.007919:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790945884.007945:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bfef1180 x1877942638570368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945900 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945884.007961:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bfef1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638570368:0@lo:13:osp-pre-0-0.0 00000020:00000004:2.0:1790945884.179122:0:12506:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790945884.179393:0:12506:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790945884.650686:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945885.535557:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bfef2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638570496:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790945885.535640:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945885.535911:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638570496 00000100:00100000:3.0:1790945885.535920:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638570496 00000100:00100000:3.0:1790945885.535982:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1790945885.535992:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bad28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638570496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790945885.536030:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1790945885.536251:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bad28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638570496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 259us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945885.536272:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1790945885.538981:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bfef2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638570496:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1790945885.670310:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945885.763509:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945885.763592:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945885.766613:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945885.766647:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945885.766668:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945885.766955:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616473344 00000100:00100000:2.0:1790945885.766966:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616473344 00000100:00100000:2.0:1790945885.767033:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616473600 00000100:00100000:2.0:1790945885.767037:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616473600 00000100:00100000:2.0:1790945885.767062:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 153 00000100:00100000:2.0:1790945885.767071:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bfef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2401:x1877942616473344:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790945885.767196:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bfef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2401:x1877942616473344:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 98us (3668us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945885.767205:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 153 00000100:00080000:0.0:1790945885.767342:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790945885.767494:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 154 00000100:00100000:2.0:1790945885.767502:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bfef1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2401:x1877942616473600:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790945885.767530:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bfef1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2401:x1877942616473600:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 29us (3939us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945885.767537:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 154 00000100:00100000:1.0:1790945885.767642:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945885.767754:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945885.767786:0:8436:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616473856 00000100:00100000:1.0:1790945885.767791:0:8436:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616473856 00000100:00100000:1.0:1790945885.767829:0:8436:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616473984 00000100:00100000:1.0:1790945885.767832:0:8436:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616473984 00000100:00100000:1.0:1790945885.767853:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 65 00000100:00100000:1.0:1790945885.767861:0:8436:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bfef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2401:x1877942616473856:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945885.767908:0:8436:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bfef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2401:x1877942616473856:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 48us (1304us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945885.767915:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 65 00000100:00100000:1.0:1790945885.767928:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 66 00000100:00100000:1.0:1790945885.767934:0:8436:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bfef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2401:x1877942616473984:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945885.767957:0:8436:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bfef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2401:x1877942616473984:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 23us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945885.767963:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 66 00000100:00100000:1.0:1790945885.767982:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616473216 00000100:00100000:1.0:1790945885.767985:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616473216 00000100:00100000:1.0:1790945885.768011:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 307 00000100:00100000:1.0:1790945885.768016:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:2401:x1877942616473216:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945885.768043:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:2401:x1877942616473216:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 26us (1395us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945885.768049:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 307 00000100:00080000:1.0:1790945885.768161:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790945885.768164:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790945885.774246:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616473472 00000100:00100000:3.0:1790945885.774262:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616473472 00000100:00100000:3.0:1790945885.774325:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616473728 00000100:00100000:3.0:1790945885.774328:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616473728 00000100:00100000:3.0:1790945885.774352:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 155 00000100:00100000:3.0:1790945885.774361:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bfef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2401:x1877942616473472:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790945885.774447:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bfef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2401:x1877942616473472:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 86us (7777us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945885.774455:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 155 00000100:00100000:3.0:1790945885.774485:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 156 00000100:00100000:3.0:1790945885.774492:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bfef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2401:x1877942616473728:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790945885.774518:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bfef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2401:x1877942616473728:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 27us (6876us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945885.774524:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 156 00000100:00080000:1.0:1790945885.774586:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790945886.048312:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790945886.049934:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638570624:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790945886.050013:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945886.050311:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638570624 00000100:00100000:1.0:1790945886.050321:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638570624 00000100:00100000:1.0:1790945886.050371:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790945886.050381:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bad2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638570624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790945886.050416:0:6526:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790945886.050475:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bad2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638570624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945886.050483:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790945886.050524:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638570624:0@lo:41:osp-pre-1-0.0 00000020:00000004:2.0:1790945886.149002:0:12604:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790945886.149307:0:12604:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790945886.687466:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945887.073716:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638570752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790945887.073789:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945887.073869:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638570752 00000100:00100000:1.0:1790945887.073877:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638570752 00000100:00100000:1.0:1790945887.073972:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790945887.073982:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638570752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790945887.074021:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790945887.074065:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638570752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945887.074072:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:1.0:1790945887.074104:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1790945887.074131:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40b4d02a00 x1877942638570752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945903 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945887.074149:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638570752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790945887.075038:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790945887.075049:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638570880:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790945887.075097:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945887.076303:0:11925:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638570880 00000100:00100000:3.0:1790945887.076314:0:11925:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638570880 00000100:00100000:3.0:1790945887.076362:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790945887.076371:0:11925:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638570880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790945887.076389:0:11925:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790945887.076443:0:11925:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638570880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (1345us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945887.076459:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:3.0:1790945887.076499:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f833f0700 x1877942638570880/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945903 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945887.076517:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638570880:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1790945887.077838:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790945887.080507:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bad28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638571008:0@lo:400:kworker.0 00000100:00100000:3.0:1790945887.080579:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945887.080825:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638571136:0@lo:400:kworker.0 00000100:00100000:1.0:1790945887.080886:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945887.080939:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790945887.080945:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638571264:0@lo:400:kworker.0 00000100:00100000:1.0:1790945887.080995:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945887.081030:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638571136 00000100:00100000:1.0:1790945887.081038:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638571136 00000100:00100000:1.0:1790945887.081110:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1790945887.081119:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638571136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945887.081196:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638571136:12345-0@lo:400:kworker.0 Request processed in 77us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945887.081204:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1790945887.081229:0:12418:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638571264 00000100:00100000:1.0:1790945887.081233:0:12418:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638571264 00000100:00100000:1.0:1790945887.081288:0:12418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1790945887.081295:0:12418:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638571264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945887.081331:0:12418:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638571264:12345-0@lo:400:kworker.0 Request processed in 36us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945887.081337:0:12418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1790945887.081378:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638571392:0@lo:400:kworker.0 00000100:00100000:1.0:1790945887.081404:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945887.081444:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638571392 00000100:00100000:1.0:1790945887.081447:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638571392 00000100:00100000:1.0:1790945887.081473:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1790945887.081479:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638571392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945887.081508:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638571392:12345-0@lo:400:kworker.0 Request processed in 30us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945887.081513:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1790945887.081543:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638571392:0@lo:400:kworker.0 00000100:00100000:1.0:1790945887.081581:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638571264:0@lo:400:kworker.0 00000100:00100000:1.0:1790945887.081589:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638571136:0@lo:400:kworker.0 00000100:00100000:3.0:1790945887.087162:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638571008 00000100:00100000:3.0:1790945887.087193:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638571008 00000100:00100000:3.0:1790945887.087247:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1790945887.087256:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3650:x1877942638571008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945887.087335:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3650:x1877942638571008:12345-0@lo:400:kworker.0 Request processed in 80us (6755us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945887.087342:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1790945887.087396:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bad28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638571008:0@lo:400:kworker.0 00000100:00100000:2.0:1790945887.088190:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1877942638571648:0@lo:400:kworker.0 00000100:00100000:2.0:1790945887.088231:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945887.088287:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638571648 00000100:00100000:2.0:1790945887.088291:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638571648 00000100:00100000:2.0:1790945887.088325:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1790945887.088332:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1877942638571648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945887.088368:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1877942638571648:12345-0@lo:400:kworker.0 Request processed in 36us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945887.088374:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:2.0:1790945887.088395:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790945887.088416:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1877942638571648:0@lo:400:kworker.0 00000100:00100000:2.0:1790945887.088444:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1877942638571776:0@lo:400:kworker.0 00000100:00100000:2.0:1790945887.088464:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945887.088486:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638571776 00000100:00100000:2.0:1790945887.088489:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638571776 00000100:00100000:2.0:1790945887.088508:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1790945887.088513:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1877942638571776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945887.088541:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1877942638571776:12345-0@lo:400:kworker.0 Request processed in 28us (77us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945887.088546:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:2.0:1790945887.088558:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1790945887.088572:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f825a7800 x1877942638571776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945887.088598:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1877942638571776:0@lo:400:kworker.0 00000100:00100000:2.0:1790945887.088634:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1877942638572160:0@lo:400:kworker.0 00000100:00100000:2.0:1790945887.088654:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945887.088672:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638572160 00000100:00100000:2.0:1790945887.088675:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638572160 00000100:00100000:2.0:1790945887.088693:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1790945887.088698:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1877942638572160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945887.088919:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1877942638572160:12345-0@lo:400:kworker.0 Request processed in 219us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945887.088926:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:2.0:1790945887.088941:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790945887.088957:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1877942638572160:0@lo:400:kworker.0 00000100:00100000:2.0:1790945887.088999:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1877942638572288:0@lo:400:kworker.0 00000100:00100000:2.0:1790945887.089021:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945887.089041:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638572288 00000100:00100000:2.0:1790945887.089044:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638572288 00000100:00100000:2.0:1790945887.089065:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1790945887.089071:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1877942638572288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945887.089112:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1877942638572288:12345-0@lo:400:kworker.0 Request processed in 41us (90us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945887.089119:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:2.0:1790945887.089134:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1790945887.089150:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f825a6300 x1877942638572288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945887.089192:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1877942638572288:0@lo:400:kworker.0 00000100:00100000:3.0:1790945887.092328:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638571520:0@lo:400:kworker.0 00000100:00100000:3.0:1790945887.092401:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945887.092450:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638572032:0@lo:400:kworker.0 00000100:00100000:3.0:1790945887.092474:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945887.092497:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790945887.092503:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638571904:0@lo:400:kworker.0 00000100:00100000:3.0:1790945887.092526:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945887.092720:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638571520 00000100:00100000:0.0:1790945887.092730:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638571520 00000100:00100000:0.0:1790945887.092789:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1790945887.092798:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638571520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945887.092863:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638571520:12345-0@lo:400:kworker.0 Request processed in 66us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945887.092871:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1790945887.092896:0:10099:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638572032 00000100:00100000:0.0:1790945887.092900:0:10099:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638572032 00000100:00100000:0.0:1790945887.092944:0:10099:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638571904 00000100:00100000:0.0:1790945887.092948:0:10099:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638571904 00000100:00100000:0.0:1790945887.093020:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790945887.093028:0:10099:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638572032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945887.093065:0:10099:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638572032:12345-0@lo:400:kworker.0 Request processed in 38us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945887.093072:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790945887.093099:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790945887.093117:0:10099:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638571904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945887.093156:0:10099:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638571904:12345-0@lo:400:kworker.0 Request processed in 41us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945887.093162:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1790945887.093200:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790945887.093229:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f825a7800 x1877942638571904/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945887.093244:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638571904:0@lo:400:kworker.0 00000100:00100000:0.0:1790945887.093256:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638571520:0@lo:400:kworker.0 00010000:00080000:0.0:1790945887.093268:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f825a5880 x1877942638572032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945887.093283:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638572032:0@lo:400:kworker.0 00010000:00010000:3.0:1790945887.711544:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1790945888.296842:0:12702:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790945888.297650:0:12702:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790945888.736871:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945889.125312:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638572416:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790945889.125433:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945889.125520:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638572416 00000100:00100000:1.0:1790945889.125528:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638572416 00000100:00100000:1.0:1790945889.125601:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790945889.125613:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638572416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790945889.125648:0:8438:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790945889.125693:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638572416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945889.125700:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1790945889.125723:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790945889.125752:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcbc0700 x1877942638572416/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945905 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945889.125771:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638572416:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790945889.126993:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790945889.127009:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638572544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790945889.127070:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945889.127330:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638572544 00000100:00100000:3.0:1790945889.127346:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638572544 00000100:00100000:3.0:1790945889.127409:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790945889.127419:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638572544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790945889.127440:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790945889.127483:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638572544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945889.127490:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:3.0:1790945889.127527:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f833f2680 x1877942638572544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945905 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945889.127544:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638572544:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790945889.127644:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790945889.760763:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1790945890.608446:0:12799:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790945890.608879:0:12799:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1790945890.657950:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790945890.657974:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638572672:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790945890.658069:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945890.658382:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638572672 00000100:00100000:1.0:1790945890.658393:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638572672 00000100:00100000:1.0:1790945890.658457:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1790945890.658466:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638572672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790945890.658501:0:6526:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1790945890.658565:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638572672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945890.658573:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1790945890.658628:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638572672:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1790945890.783358:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945890.884070:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945890.884103:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945890.884130:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945890.884164:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945890.884204:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945890.884257:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945890.884288:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945890.884317:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616474240 00000100:00100000:3.0:1790945890.884329:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616474240 00000100:00100000:3.0:1790945890.884382:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616474496 00000100:00100000:3.0:1790945890.884385:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616474496 00000100:00100000:3.0:1790945890.884398:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616474368 00000100:00100000:3.0:1790945890.884400:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616474368 00000100:00100000:3.0:1790945890.884413:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616474624 00000100:00100000:3.0:1790945890.884414:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616474624 00000100:00100000:3.0:1790945890.884430:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 163 00000100:00100000:3.0:1790945890.884439:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2402:x1877942616474240:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790945890.884518:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2402:x1877942616474240:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 80us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945890.884534:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 163 00000100:00100000:3.0:1790945890.885919:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 164 00000100:00100000:3.0:1790945890.885933:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2402:x1877942616474496:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790945890.885979:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2402:x1877942616474496:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 51us (1876us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945890.885985:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 164 00000100:00100000:3.0:1790945890.885997:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 165 00000100:00100000:3.0:1790945890.886003:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bad28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2402:x1877942616474368:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790945890.886040:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bad28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2402:x1877942616474368:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 37us (1876us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945890.886046:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 165 00000100:00100000:3.0:1790945890.886057:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 166 00000100:00100000:3.0:1790945890.886063:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2402:x1877942616474624:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790945890.886083:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2402:x1877942616474624:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 20us (1879us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945890.886088:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 166 00000100:00100000:3.0:1790945890.888106:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616474112 00000100:00100000:3.0:1790945890.888117:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616474112 00000100:00100000:3.0:1790945890.888196:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 309 00000100:00100000:3.0:1790945890.888206:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:2402:x1877942616474112:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790945890.888263:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:2402:x1877942616474112:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 59us (4132us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945890.888271:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 309 00000100:00080000:3.0:1790945890.888319:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790945890.888324:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790945890.891516:0:10099:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616474752 00000100:00100000:2.0:1790945890.891532:0:10099:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616474752 00000100:00100000:2.0:1790945890.891687:0:10099:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616474880 00000100:00100000:2.0:1790945890.891691:0:10099:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616474880 00000100:00100000:2.0:1790945890.891722:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 22 00000100:00100000:2.0:1790945890.891732:0:10099:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2400:x1877942616474752:12345-192.168.204.20@tcp:9:kworker.0 00000020:00000080:2.0:1790945890.891762:0:10099:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27d24f 00000100:00080000:2.0:1790945890.891771:0:10099:0:(import.c:65:import_set_state_nolock()) ffff9d3f83700000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790945890.891816:0:10099:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1790945890.891989:0:10099:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0fac916e-06af-4e43-ae6d-171b0debcf61+2:2400:x1877942616474752:12345-192.168.204.20@tcp:9:kworker.0 Request processed in 258us (7731us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945890.891998:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 22 00000100:00100000:2.0:1790945890.892032:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 23 00000100:00100000:2.0:1790945890.892040:0:10099:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83cd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2400:x1877942616474880:12345-192.168.204.20@tcp:9:kworker.0 00000020:00000080:2.0:1790945890.892052:0:10099:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27d248 00000100:00080000:2.0:1790945890.892059:0:10099:0:(import.c:65:import_set_state_nolock()) ffff9d3f83700800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790945890.892081:0:10099:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1790945890.892161:0:10099:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83cd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0fac916e-06af-4e43-ae6d-171b0debcf61+2:2400:x1877942616474880:12345-192.168.204.20@tcp:9:kworker.0 Request processed in 121us (7871us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945890.892201:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 23 00010000:00010000:2.0:1790945890.892233:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945890.892356:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790945890.892704:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790945890.892710:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790945891.167495:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638572800:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790945891.167601:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945891.167857:0:12418:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638572800 00000100:00100000:1.0:1790945891.167866:0:12418:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638572800 00000100:00100000:1.0:1790945891.167931:0:12418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1790945891.167940:0:12418:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638572800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790945891.167971:0:12418:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790945891.168100:0:12418:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638572800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 161us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945891.168107:0:12418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1790945891.168417:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638572800:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1790945891.807387:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945892.194381:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638572928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790945892.194459:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945892.194521:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790945892.194529:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83cd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638573056:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790945892.194555:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945892.194589:0:11925:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638572928 00000100:00100000:3.0:1790945892.194596:0:11925:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638572928 00000100:00100000:0.0:1790945892.195157:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638573184:0@lo:400:kworker.0 00000100:00100000:0.0:1790945892.195211:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945892.195237:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638573696:0@lo:400:kworker.0 00000100:00100000:0.0:1790945892.195266:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945892.195285:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638574208:0@lo:400:kworker.0 00000100:00100000:0.0:1790945892.195312:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945892.195395:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1790945892.195403:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638573312:0@lo:400:kworker.0 00000100:00100000:0.0:1790945892.195436:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945892.195463:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40baced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1877942638573824:0@lo:400:kworker.0 00000100:00100000:0.0:1790945892.195500:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945892.195524:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1877942638574336:0@lo:400:kworker.0 00000100:00100000:0.0:1790945892.195549:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945892.195583:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638573440:0@lo:400:kworker.0 00000100:00100000:0.0:1790945892.195610:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945892.195634:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1877942638573952:0@lo:400:kworker.0 00000100:00100000:0.0:1790945892.195662:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945892.195686:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1877942638574464:0@lo:400:kworker.0 00000100:00100000:0.0:1790945892.195711:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945892.195726:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1790945892.195732:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638573568:0@lo:400:kworker.0 00000100:00100000:0.0:1790945892.195777:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945892.195792:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40baceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638574080:0@lo:400:kworker.0 00000100:00100000:0.0:1790945892.195824:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945892.195861:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638573184 00000100:00100000:0.0:1790945892.195867:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638573184 00000100:00100000:0.0:1790945892.195920:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1790945892.195930:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3647:x1877942638573184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945892.195991:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3647:x1877942638573184:12345-0@lo:400:kworker.0 Request processed in 51us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945892.195999:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1790945892.196030:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638573696 00000100:00100000:0.0:1790945892.196034:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638573696 00000100:00100000:0.0:1790945892.196069:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638573440 00000100:00100000:0.0:1790945892.196073:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638573440 00000100:00100000:0.0:1790945892.196086:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1790945892.196092:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638573696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945892.196124:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638573696:12345-0@lo:400:kworker.0 Request processed in 33us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945892.196130:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1790945892.196141:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1790945892.196147:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638573440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945892.196195:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638573440:12345-0@lo:400:kworker.0 Request processed in 49us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945892.196201:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1790945892.196218:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638574208 00000100:00100000:0.0:1790945892.196222:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638574208 00000100:00100000:0.0:1790945892.196246:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638574080 00000100:00100000:0.0:1790945892.196249:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638574080 00000100:00100000:0.0:1790945892.196268:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790945892.196274:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638574208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945892.196316:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638574208:12345-0@lo:400:kworker.0 Request processed in 42us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945892.196324:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790945892.196340:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790945892.196347:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83018380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638574080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945892.196378:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83018380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638574080:12345-0@lo:400:kworker.0 Request processed in 32us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945892.196385:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790945892.196405:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638573312 00000100:00100000:0.0:1790945892.196409:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638573312 00000100:00100000:0.0:1790945892.196428:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638573824 00000100:00100000:0.0:1790945892.196430:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638573824 00000100:00100000:0.0:1790945892.196442:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638574336 00000100:00100000:0.0:1790945892.196444:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638574336 00000100:00100000:0.0:1790945892.196454:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638573952 00000100:00100000:0.0:1790945892.196456:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638573952 00000100:00100000:0.0:1790945892.196468:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638574464 00000100:00100000:0.0:1790945892.196470:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638574464 00000100:00100000:0.0:1790945892.196488:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638573568 00000100:00100000:0.0:1790945892.196490:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638573568 00000100:00100000:0.0:1790945892.196506:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1790945892.196514:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638573312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945892.196547:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638573312:12345-0@lo:400:kworker.0 Request processed in 34us (1110us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945892.196553:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1790945892.196567:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1790945892.196576:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1877942638573824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945892.196611:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1877942638573824:12345-0@lo:400:kworker.0 Request processed in 37us (1110us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945892.196624:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1790945892.196638:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1790945892.196644:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1877942638574336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945892.196667:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1877942638574336:12345-0@lo:400:kworker.0 Request processed in 24us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945892.196672:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1790945892.196680:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1790945892.196685:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8301aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877942638573952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945892.196706:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8301aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877942638573952:12345-0@lo:400:kworker.0 Request processed in 21us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945892.196711:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1790945892.196720:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1790945892.196725:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8301ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877942638574464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945892.196744:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8301ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877942638574464:12345-0@lo:400:kworker.0 Request processed in 20us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945892.196748:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1790945892.196757:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1790945892.196762:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8301b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638573568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945892.196782:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8301b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638573568:12345-0@lo:400:kworker.0 Request processed in 20us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945892.196787:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1790945892.196829:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638573312:0@lo:400:kworker.0 00000100:00100000:0.0:1790945892.196838:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40baced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1877942638573824:0@lo:400:kworker.0 00000100:00100000:0.0:1790945892.196855:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1877942638574336:0@lo:400:kworker.0 00000100:00100000:0.0:1790945892.196862:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638573184:0@lo:400:kworker.0 00000100:00100000:0.0:1790945892.196870:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638573696:0@lo:400:kworker.0 00010000:00080000:0.0:1790945892.196879:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcb39c00 x1877942638574208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945892.196889:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638574208:0@lo:400:kworker.0 00000100:00100000:0.0:1790945892.196923:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638573568:0@lo:400:kworker.0 00010000:00080000:0.0:1790945892.196932:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40baceed80 x1877942638574080/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945892.196940:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40baceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638574080:0@lo:400:kworker.0 00000100:00100000:0.0:1790945892.196949:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638573440:0@lo:400:kworker.0 00010000:00080000:0.0:1790945892.196957:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bacece00 x1877942638573952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945892.196964:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1877942638573952:0@lo:400:kworker.0 00010000:00080000:0.0:1790945892.196972:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcb38700 x1877942638574464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945892.196994:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1877942638574464:0@lo:400:kworker.0 00000100:00100000:3.0:1790945892.197081:0:11925:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638573056 00000100:00100000:3.0:1790945892.197086:0:11925:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638573056 00000100:00100000:3.0:1790945892.197108:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790945892.197115:0:11925:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638572928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790945892.197140:0:11925:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790945892.197208:0:11925:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638572928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (2749us total) trans 0 rc 0/0 00010000:00080000:0.0:1790945892.197247:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcbc3b80 x1877942638572928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945908 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945892.197260:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638572928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790945892.198044:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790945892.198064:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790945892.198071:0:11925:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638573056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790945892.198083:0:11925:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790945892.198123:0:11925:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638573056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (3567us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945892.198129:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1790945892.198150:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790945892.198155:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790945892.198165:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790945892.198188:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1790945892.198347:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f83cd7100 x1877942638573056/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945908 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945892.198362:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83cd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638573056:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1790945892.831880:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1790945893.049508:0:12897:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790945893.049812:0:12897:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790945893.856319:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945894.245500:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638574592:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790945894.245588:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945894.246492:0:11925:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638574592 00000100:00100000:2.0:1790945894.246504:0:11925:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638574592 00000100:00100000:2.0:1790945894.246573:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790945894.246595:0:11925:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638574592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790945894.246625:0:11925:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790945894.246677:0:11925:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638574592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945894.246684:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1790945894.247517:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790945894.247567:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcbc1180 x1877942638574592/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945910 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945894.247597:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638574592:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790945894.252329:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790945894.252350:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638574720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790945894.252599:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945894.252745:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638574720 00000100:00100000:1.0:1790945894.252753:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638574720 00000100:00100000:1.0:1790945894.252820:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790945894.252830:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83018a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638574720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790945894.252853:0:8438:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790945894.252912:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83018a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638574720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945894.252931:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:0.0:1790945894.253337:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f83019f80 x1877942638574720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945910 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945894.253358:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638574720:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790945894.253395:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790945894.880398:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945895.776464:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638574848:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790945895.776540:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945895.776651:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638574848 00000100:00100000:1.0:1790945895.776660:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638574848 00000100:00100000:1.0:1790945895.776715:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1790945895.776724:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638574848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790945895.776758:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1790945895.777554:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638574848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 827us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945895.777564:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1790945895.780531:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638574848:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1790945895.903958:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945896.003049:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945896.003089:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945896.003115:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945896.003147:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945896.003160:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616475264 00000100:00100000:0.0:1790945896.003198:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616475264 00000100:00100000:2.0:1790945896.003205:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945896.003245:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616475520 00000100:00100000:2.0:1790945896.003250:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616475520 00000100:00100000:0.0:1790945896.003262:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616475136 00000100:00100000:0.0:1790945896.003267:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616475136 00000100:00100000:2.0:1790945896.003276:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616475392 00000100:00100000:2.0:1790945896.003280:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616475392 00000100:00100000:0.0:1790945896.003295:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 173 00000100:00100000:3.0:1790945896.003336:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616475008 00000100:00100000:3.0:1790945896.003341:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616475008 00000100:00100000:0.0:1790945896.003371:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2403:x1877942616475264:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790945896.003373:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 311 00000100:00100000:3.0:1790945896.003385:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:2403:x1877942616475008:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790945896.003447:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2403:x1877942616475264:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 142us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945896.005999:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 174 00000100:00100000:2.0:1790945896.006023:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2403:x1877942616475520:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945896.006306:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 175 00000100:00100000:1.0:1790945896.006321:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2403:x1877942616475136:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790945896.007334:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:2403:x1877942616475008:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 3947us (4291us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945896.007346:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 311 00000100:00080000:3.0:1790945896.007427:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790945896.007432:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790945896.010041:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2403:x1877942616475520:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 4015us (6910us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945896.010073:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 174 00000100:00100000:2.0:1790945896.010116:0:6521:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1790945896.010125:0:6521:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1790945896.010435:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 176 00000100:00100000:2.0:1790945896.010448:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2403:x1877942616475392:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790945896.010503:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2403:x1877942616475392:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 60us (7299us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945896.010510:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 176 00000100:00100000:0.0:1790945896.015295:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 173 00000100:00100000:1.0:1790945896.015475:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2403:x1877942616475136:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 9155us (12322us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945896.015488:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 175 00000100:00100000:2.0:1790945896.291317:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790945896.291347:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638574976:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790945896.291454:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945896.291673:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638574976 00000100:00100000:1.0:1790945896.291681:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638574976 00000100:00100000:1.0:1790945896.291738:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1790945896.291746:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638574976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790945896.291780:0:6526:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790945896.291840:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638574976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945896.291848:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1790945896.292209:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638574976:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1790945896.927972:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945897.312054:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638575104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790945897.312144:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945897.312217:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40baceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877942638575616:0@lo:400:kworker.0 00000100:00100000:0.0:1790945897.312254:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945897.312273:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638576128:0@lo:400:kworker.0 00000100:00100000:0.0:1790945897.312299:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945897.312318:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638576640:0@lo:400:kworker.0 00000100:00100000:0.0:1790945897.312343:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945897.312366:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1790945897.312372:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638575488:0@lo:400:kworker.0 00000100:00100000:0.0:1790945897.312396:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945897.312415:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40baced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1877942638576000:0@lo:400:kworker.0 00000100:00100000:0.0:1790945897.313272:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945897.313399:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4db1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1877942638576512:0@lo:400:kworker.0 00000100:00100000:0.0:1790945897.313436:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945897.314336:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638575104 00000100:00100000:1.0:1790945897.314355:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638575104 00000100:00100000:1.0:1790945897.314494:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790945897.314516:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4db3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638575104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790945897.314612:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790945897.314678:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4db3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638575104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 167us (2533us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945897.314705:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790945897.314734:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877942638575360:0@lo:400:kworker.0 00000100:00100000:1.0:1790945897.314773:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638575232:0@lo:400:kworker.0 00000100:00100000:1.0:1790945897.314801:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945897.314837:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638575744:0@lo:400:kworker.0 00000100:00080000:3.0:1790945897.315112:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790945897.315596:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945897.315626:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638576256:0@lo:400:kworker.0 00000100:00100000:1.0:1790945897.315655:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945897.315681:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4db1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638576768:0@lo:400:kworker.0 00000100:00100000:1.0:1790945897.315720:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945897.315765:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638575232 00000100:00100000:1.0:1790945897.315770:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638575232 00000100:00100000:1.0:1790945897.315814:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1790945897.315838:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408397d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3647:x1877942638575232:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1790945897.316725:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcb38700 x1877942638575104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945913 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945897.316757:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638575104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790945897.316791:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638575616 00000100:00100000:0.0:1790945897.316797:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638575616 00000100:00100000:0.0:1790945897.316836:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638576000 00000100:00100000:0.0:1790945897.316840:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638576000 00000100:00100000:2.0:1790945897.317699:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638576512 00000100:00100000:2.0:1790945897.317707:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638576512 00000100:00100000:2.0:1790945897.317758:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1790945897.317766:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4db0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877942638575616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945897.317816:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4db0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877942638575616:12345-0@lo:400:kworker.0 Request processed in 51us (5561us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945897.317987:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408397d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3647:x1877942638575232:12345-0@lo:400:kworker.0 Request processed in 1584us (2618us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945897.318003:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1790945897.318052:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638575488 00000100:00100000:1.0:1790945897.318057:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638575488 00000100:00100000:1.0:1790945897.318609:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638575744 00000100:00100000:1.0:1790945897.318614:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638575744 00000100:00100000:1.0:1790945897.318637:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1790945897.318665:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408aa8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638575488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945897.318726:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408aa8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638575488:12345-0@lo:400:kworker.0 Request processed in 82us (6328us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945897.318732:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1790945897.318752:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1790945897.318759:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638575744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945897.318786:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638575744:12345-0@lo:400:kworker.0 Request processed in 28us (3192us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945897.318791:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1790945897.318841:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638575232:0@lo:400:kworker.0 00000100:00100000:2.0:1790945897.318965:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1790945897.318981:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1790945897.318994:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408aa8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877942638576512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945897.319037:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408aa8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877942638576512:12345-0@lo:400:kworker.0 Request processed in 49us (5600us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945897.319050:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1790945897.319201:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1790945897.319209:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408aa8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1877942638576000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945897.319245:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408aa8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1877942638576000:12345-0@lo:400:kworker.0 Request processed in 38us (5975us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945897.319251:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1790945897.319273:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638576128 00000100:00100000:0.0:1790945897.319284:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638576128 00000100:00100000:0.0:1790945897.319311:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638576640 00000100:00100000:0.0:1790945897.319314:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638576640 00000100:00100000:0.0:1790945897.319338:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638576256 00000100:00100000:0.0:1790945897.319341:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638576256 00000100:00100000:0.0:1790945897.319354:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638576768 00000100:00100000:0.0:1790945897.319357:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638576768 00000100:00100000:0.0:1790945897.319379:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790945897.319385:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4db0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638576128:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1790945897.319646:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790945897.319651:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790945897.319653:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790945897.320038:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638575744:0@lo:400:kworker.0 00000100:00100000:0.0:1790945897.320590:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4db0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638576128:12345-0@lo:400:kworker.0 Request processed in 1202us (8288us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945897.320598:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790945897.320619:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790945897.320628:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408aa8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638576640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945897.320695:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408aa8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638576640:12345-0@lo:400:kworker.0 Request processed in 70us (8351us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945897.320701:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790945897.320712:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790945897.320718:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638576256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945897.320761:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638576256:12345-0@lo:400:kworker.0 Request processed in 43us (5104us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945897.320767:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790945897.320778:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790945897.320784:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83647800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638576768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945897.320812:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83647800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638576768:12345-0@lo:400:kworker.0 Request processed in 28us (5091us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945897.320817:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:3.0:1790945897.321350:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcb17100 x1877942638576256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945897.321363:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638576256:0@lo:400:kworker.0 00010000:00080000:3.0:1790945897.321377:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40b4db1880 x1877942638576768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945897.321386:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4db1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638576768:0@lo:400:kworker.0 00000100:00100000:0.0:1790945897.322021:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945897.322063:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1877942638575872:0@lo:400:kworker.0 00000100:00100000:3.0:1790945897.322535:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638575360 00000100:00100000:3.0:1790945897.322543:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638575360 00000100:00100000:3.0:1790945897.322589:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1790945897.322597:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408aa8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1877942638575360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945897.322654:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408aa8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1877942638575360:12345-0@lo:400:kworker.0 Request processed in 58us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945897.322672:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000001:00100000:2.0:1790945897.322963:0:8429:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0fac916e-06af-4e43-ae6d-171b0debcf61 00000020:00000080:2.0:1790945897.322969:0:8429:0:(genops.c:885:class_export_put()) final put ffff9d3f83705000/0fac916e-06af-4e43-ae6d-171b0debcf61 00000100:00100000:0.0:1790945897.323160:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945897.323212:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1877942638576384:0@lo:400:kworker.0 00000100:00100000:0.0:1790945897.323236:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945897.323255:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638576896:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790945897.323279:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945897.323318:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877942638575360:0@lo:400:kworker.0 00000100:00100000:0.0:1790945897.323343:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638575872 00000100:00100000:0.0:1790945897.323347:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638575872 00000100:00100000:0.0:1790945897.323379:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638576384 00000100:00100000:0.0:1790945897.323381:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638576384 00000100:00100000:0.0:1790945897.323400:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1790945897.323407:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408aa8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1877942638575872:12345-0@lo:400:kworker.0 00000020:00000080:3.0:1790945897.323601:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f83705000/0fac916e-06af-4e43-ae6d-171b0debcf61 for lustre-OST0000 00000020:00000080:3.0:1790945897.323643:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d3f83700000 for lustre-OST0000 00000100:00100000:2.0:1790945897.323698:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1790945897.323706:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408aa8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1877942638576384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945897.323753:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408aa8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1877942638576384:12345-0@lo:400:kworker.0 Request processed in 48us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945897.323759:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1790945897.323941:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1877942638576384:0@lo:400:kworker.0 00000100:00100000:0.0:1790945897.324194:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408aa8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1877942638575872:12345-0@lo:400:kworker.0 Request processed in 787us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945897.324201:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1790945897.324232:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638575488:0@lo:400:kworker.0 00010000:00080000:0.0:1790945897.324246:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40baced180 x1877942638576000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945897.324255:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40baced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1877942638576000:0@lo:400:kworker.0 00010000:00080000:0.0:1790945897.324266:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40b4db1500 x1877942638576512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945897.324275:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4db1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1877942638576512:0@lo:400:kworker.0 00000100:00100000:0.0:1790945897.324298:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40baceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877942638575616:0@lo:400:kworker.0 00010000:00080000:0.0:1790945897.324309:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcb14380 x1877942638576128/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945897.324317:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638576128:0@lo:400:kworker.0 00010000:00080000:0.0:1790945897.324326:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40b4db0a80 x1877942638576640/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945897.324333:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638576640:0@lo:400:kworker.0 00000100:00100000:3.0:1790945897.324962:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1877942638575872:0@lo:400:kworker.0 00000100:00080000:3.0:1790945897.325222:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790945897.325238:0:11925:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638576896 00000100:00100000:3.0:1790945897.325245:0:11925:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638576896 00000100:00100000:3.0:1790945897.325285:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790945897.325293:0:11925:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408aa8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638576896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790945897.325311:0:11925:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790945897.325362:0:11925:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408aa8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638576896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (2082us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945897.325369:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:3.0:1790945897.325402:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f81bd2a00 x1877942638576896/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945913 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945897.325417:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638576896:0@lo:13:osp-pre-1-1.0 00000001:00100000:1.0:1790945897.327253:0:9515:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0fac916e-06af-4e43-ae6d-171b0debcf61 00000020:00000080:1.0:1790945897.327262:0:9515:0:(genops.c:885:class_export_put()) final put ffff9d3f83703000/0fac916e-06af-4e43-ae6d-171b0debcf61 00000020:00000080:0.0:1790945897.327355:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f83703000/0fac916e-06af-4e43-ae6d-171b0debcf61 for lustre-OST0001 00000020:00000080:0.0:1790945897.327408:0:1365:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d3f83700800 for lustre-OST0001 00000001:02000400:1.0:1790945897.347754:0:13042:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1790945897.951438:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945898.975395:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945899.363315:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638577024:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790945899.363397:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945899.363610:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638577024 00000100:00100000:3.0:1790945899.363621:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638577024 00000100:00100000:3.0:1790945899.363701:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790945899.363713:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83646d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638577024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790945899.363746:0:8438:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790945899.363797:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83646d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638577024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945899.363821:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1790945899.363907:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790945899.363942:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f81bd0000 x1877942638577024/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945915 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945899.363962:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638577024:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790945899.364594:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83cd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638577152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790945899.364638:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945899.364809:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638577152 00000100:00100000:3.0:1790945899.364815:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638577152 00000100:00100000:3.0:1790945899.364875:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1790945899.364883:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bacec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638577152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790945899.364970:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790945899.365111:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bacec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638577152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 228us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945899.365119:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1790945899.366139:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790945899.366198:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f83cd5180 x1877942638577152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945915 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945899.366306:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83cd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638577152:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790945899.999332:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790945900.646034:0:13191:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe3f363200 20000000:00000080:1.0:1790945900.646055:0:13191:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d40bfe67000 uarg=0000000000000000 20000000:01000000:1.0:1790945900.646098:0:13191:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1790945900.646105:0:13191:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1790945900.646109:0:13191:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1790945900.654018:0:13192:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1790945900.660428:0:13191:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1790945900.683925:0:13191:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790945900.684033:0:13191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d3f8363dc00/0xd9f4181e0d27d256 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945900.684054:0:13191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40c21d7c00/0xd9f4181e0d27d1e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a17 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945900.684061:0:13191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40baef0800/0xd9f4181e0d27d1f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d1ed expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945900.684068:0:13191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d4086a4d000/0xd9f4181e0d27d202 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d1fb expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945900.684074:0:13191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40baef1000/0xd9f4181e0d27d210 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d209 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945900.684079:0:13191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40c21d7000/0xd9f4181e0d27d21e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d217 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945900.684085:0:13191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d4086a4d200/0xd9f4181e0d27d233 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a56 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945900.684110:0:13191:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d3f8363dc00/0xd9f4181e0d27d256 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945900.684154:0:13191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d4086a4d200/0xd9f4181e0d27d233 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a56 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945900.684746:0:13191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d4086a4d200/0xd9f4181e0d27d233 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a56 expref: 12 pid: 6514 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945900.684765:0:13191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1877942638577280:192.168.204.20@tcp:104: 00010000:00010000:2.0:1790945900.685649:0:13191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40c21d7000/0xd9f4181e0d27d21e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27d217 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945900.685661:0:13191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40c21d7000/0xd9f4181e0d27d21e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27d217 expref: 23 pid: 6514 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945900.685671:0:13191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1877942638577408:0@lo:104: 00000100:00100000:2.0:1790945900.685710:0:13191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790945900.685741:0:13191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40baef1000/0xd9f4181e0d27d210 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27d209 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945900.685750:0:13191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40baef1000/0xd9f4181e0d27d210 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27d209 expref: 23 pid: 6516 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945900.685758:0:13191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1877942638577536:0@lo:104: 00000100:00100000:2.0:1790945900.685778:0:13191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790945900.685805:0:13191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d4086a4d000/0xd9f4181e0d27d202 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27d1fb expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945900.685839:0:13191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d4086a4d000/0xd9f4181e0d27d202 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27d1fb expref: 23 pid: 6514 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945900.685848:0:13191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1877942638577664:0@lo:104: 00000100:00100000:2.0:1790945900.685870:0:13191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790945900.685887:0:13191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40baef0800/0xd9f4181e0d27d1f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27d1ed expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945900.685894:0:13191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40baef0800/0xd9f4181e0d27d1f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27d1ed expref: 23 pid: 6514 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945900.685902:0:13191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1877942638577792:0@lo:104: 00000100:00100000:2.0:1790945900.685921:0:13191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790945900.685939:0:13191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40c21d7c00/0xd9f4181e0d27d1e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a17 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945900.685946:0:13191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40c21d7c00/0xd9f4181e0d27d1e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a17 expref: 12 pid: 6516 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945900.685954:0:13191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1877942638577920:192.168.204.20@tcp:104: 00000100:00100000:0.0:1790945900.686734:0:6504:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638577408 00000100:00100000:0.0:1790945900.686745:0:6504:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638577408 00000100:00100000:0.0:1790945900.686784:0:6504:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638577536 00000100:00100000:0.0:1790945900.686788:0:6504:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638577536 00000100:00100000:0.0:1790945900.686799:0:6504:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638577664 00000100:00100000:0.0:1790945900.686801:0:6504:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638577664 00000100:00100000:0.0:1790945900.686811:0:6504:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638577792 00000100:00100000:0.0:1790945900.686825:0:6504:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638577792 00000100:00100000:0.0:1790945900.686890:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790945900.686901:0:6504:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+6:13191:x1877942638577408:12345-0@lo:104: 00010000:00010000:0.0:1790945900.686914:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d40baef1c00/0xd9f4181e0d27d217 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27d21e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945900.686982:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790945900.686988:0:6504:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+6:13191:x1877942638577408:12345-0@lo:104: Request processed in 91us (1279us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945900.686995:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790945900.687025:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790945900.687032:0:6504:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+5:13191:x1877942638577536:12345-0@lo:104: 00010000:00010000:0.0:1790945900.687040:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d4080030a00/0xd9f4181e0d27d209 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27d210 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945900.687127:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790945900.687133:0:6504:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+5:13191:x1877942638577536:12345-0@lo:104: Request processed in 102us (1354us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945900.687139:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790945900.687153:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790945900.687159:0:6504:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+4:13191:x1877942638577664:12345-0@lo:104: 00010000:00010000:0.0:1790945900.690094:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d4080031400/0xd9f4181e0d27d1fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27d202 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945900.690235:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1790945900.690245:0:6504:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+4:13191:x1877942638577664:12345-0@lo:104: Request processed in 3083us (4370us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945900.690257:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790945900.690295:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790945900.690305:0:6504:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+3:13191:x1877942638577792:12345-0@lo:104: 00010000:00010000:0.0:1790945900.690320:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d4086a4dc00/0xd9f4181e0d27d1ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27d1f4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945900.690348:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1790945900.690352:0:6504:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+3:13191:x1877942638577792:12345-0@lo:104: Request processed in 52us (4432us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945900.690357:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1790945900.690392:0:10339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1790945900.690398:0:10339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40baef1c00/0xd9f4181e0d27d217 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27d21e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945900.690417:0:10339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef1c00 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:0.0:1790945900.690422:0:10339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40baef1c00/0xd9f4181e0d27d217 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27d21e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945900.690431:0:10339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40baef1c00/0xd9f4181e0d27d217 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27d21e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790945900.690438:0:10339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40baef1c00/0xd9f4181e0d27d217 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27d21e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945900.690443:0:10339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790945900.690478:0:10339:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40baef1c00/0xd9f4181e0d27d217 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d21e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945900.690659:0:10339:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790945900.690680:0:10339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40baef1c00/0xd9f4181e0d27d217 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d21e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945900.690687:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40baef1c00/0xd9f4181e0d27d217 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d21e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945900.690701:0:10339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790945900.690705:0:10339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d4080030a00/0xd9f4181e0d27d209 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27d210 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945900.690710:0:10339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080030a00 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:0.0:1790945900.690712:0:10339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d4080030a00/0xd9f4181e0d27d209 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27d210 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945900.690725:0:10339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d4080030a00/0xd9f4181e0d27d209 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27d210 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790945900.690731:0:10339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d4080030a00/0xd9f4181e0d27d209 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27d210 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945900.690736:0:10339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790945900.690750:0:10339:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d4080030a00/0xd9f4181e0d27d209 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d210 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945900.690756:0:10339:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790945900.690763:0:10339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d4080030a00/0xd9f4181e0d27d209 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d210 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945900.690769:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d4080030a00/0xd9f4181e0d27d209 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d210 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945900.690779:0:10339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790945900.690782:0:10339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d4080031400/0xd9f4181e0d27d1fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27d202 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945900.690788:0:10339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080031400 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:0.0:1790945900.690791:0:10339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d4080031400/0xd9f4181e0d27d1fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27d202 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945900.690797:0:10339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d4080031400/0xd9f4181e0d27d1fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27d202 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790945900.690803:0:10339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d4080031400/0xd9f4181e0d27d1fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27d202 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945900.690827:0:10339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790945900.690846:0:10339:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d4080031400/0xd9f4181e0d27d1fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d202 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945900.690853:0:10339:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790945900.690870:0:10339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d4080031400/0xd9f4181e0d27d1fb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d202 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945900.690876:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d4080031400/0xd9f4181e0d27d1fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d202 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945900.690887:0:10339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790945900.690890:0:10339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d4086a4dc00/0xd9f4181e0d27d1ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27d1f4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945900.690896:0:10339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4086a4dc00 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:0.0:1790945900.690899:0:10339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d4086a4dc00/0xd9f4181e0d27d1ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27d1f4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945900.690905:0:10339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d4086a4dc00/0xd9f4181e0d27d1ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27d1f4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790945900.690911:0:10339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d4086a4dc00/0xd9f4181e0d27d1ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27d1f4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945900.690916:0:10339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790945900.690928:0:10339:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d4086a4dc00/0xd9f4181e0d27d1ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d1f4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945900.690934:0:10339:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790945900.690948:0:10339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d4086a4dc00/0xd9f4181e0d27d1ed lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d1f4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945900.690955:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d4086a4dc00/0xd9f4181e0d27d1ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d1f4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945900.690968:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945900.690970:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945900.690972:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945900.690980:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945900.690994:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d408aa8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638578304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790945900.691039:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790945900.692581:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945900.692615:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d408aa8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638578048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790945900.692692:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945900.692758:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638578304 00000100:00100000:1.0:1790945900.692768:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638578304 00010000:00010000:1.0:1790945900.692809:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d4086a4d000/0xd9f4181e0d27d202 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27d1fb expref: 24 pid: 6514 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945900.692849:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638578048 00000100:00100000:1.0:1790945900.692852:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638578048 00010000:00010000:1.0:1790945900.692865:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40c21d7000/0xd9f4181e0d27d21e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27d217 expref: 25 pid: 6514 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945900.692886:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790945900.692896:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+25:3649:x1877942638578304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790945900.692914:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945900.692919:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d4086a4d000/0xd9f4181e0d27d202 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27d1fb expref: 25 pid: 6514 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945900.692931:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d4086a4d000/0xd9f4181e0d27d202 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27d1fb expref: 25 pid: 6514 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945900.692970:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945900.693012:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+25:3649:x1877942638578304:12345-0@lo:103:ldlm_bl.0 Request processed in 117us (1972us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945900.693020:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790945900.693039:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790945900.693045:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3647:x1877942638578048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790945900.693054:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945900.693057:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40c21d7000/0xd9f4181e0d27d21e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27d217 expref: 24 pid: 6514 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945900.693066:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40c21d7000/0xd9f4181e0d27d21e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27d217 expref: 24 pid: 6514 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945900.693075:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945900.693112:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3647:x1877942638578048:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945900.693118:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790945900.693669:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638578432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790945900.693705:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945900.694353:0:7471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638578432 00000100:00100000:0.0:1790945900.694363:0:7471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638578432 00010000:00010000:0.0:1790945900.694397:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40baef0800/0xd9f4181e0d27d1f4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27d1ed expref: 24 pid: 6514 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945900.694493:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d408aa8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8841fcfb-fb47-4307-92c2-97500c1c82bd:3648:1877942638578176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790945900.694533:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945900.694563:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638578176 00000100:00100000:3.0:1790945900.694569:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638578176 00000100:00100000:0.0:1790945900.694573:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790945900.694584:0:7471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40baceed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8841fcfb-fb47-4307-92c2-97500c1c82bd+25:3650:x1877942638578432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790945900.694591:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40baef1000/0xd9f4181e0d27d210 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27d209 expref: 25 pid: 6516 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945900.694598:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945900.694606:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40baef0800/0xd9f4181e0d27d1f4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27d1ed expref: 25 pid: 6514 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945900.694614:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00010000:00010000:0.0:1790945900.694621:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40baef0800/0xd9f4181e0d27d1f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27d1ed expref: 25 pid: 6514 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945900.694638:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945900.694671:0:7471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40baceed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8841fcfb-fb47-4307-92c2-97500c1c82bd+25:3650:x1877942638578432:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945900.694677:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790945900.695449:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3648:x1877942638578176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790945900.695461:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945900.695466:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40baef1000/0xd9f4181e0d27d210 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27d209 expref: 24 pid: 6516 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945900.695475:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40baef1000/0xd9f4181e0d27d210 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27d209 expref: 24 pid: 6516 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945900.695495:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945900.695544:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3648:x1877942638578176:12345-0@lo:103:ldlm_bl.0 Request processed in 922us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945900.695552:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790945900.695835:0:13191:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096d1ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1790945900.695863:0:13191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1877942638577280:192.168.204.20@tcp:104: 00010000:00010000:2.0:1790945900.695877:0:13191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40c21d7000/0xd9f4181e0d27d21e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27d217 expref: 23 pid: 6514 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945900.695890:0:13191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1877942638577408:0@lo:104: 00010000:00010000:2.0:1790945900.695900:0:13191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40baef1000/0xd9f4181e0d27d210 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27d209 expref: 22 pid: 6516 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945900.695919:0:13191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1877942638577536:0@lo:104: 00010000:00010000:2.0:1790945900.695932:0:13191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d4086a4d000/0xd9f4181e0d27d202 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27d1fb expref: 21 pid: 6514 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945900.695939:0:13191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1877942638577664:0@lo:104: 00010000:00010000:2.0:1790945900.695947:0:13191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40baef0800/0xd9f4181e0d27d1f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27d1ed expref: 20 pid: 6514 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945900.695954:0:13191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1877942638577792:0@lo:104: 00000100:00100000:0.0:1790945900.696034:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d408aa8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638578304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790945900.696157:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d408aa8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638578048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790945900.696330:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d408aa8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8841fcfb-fb47-4307-92c2-97500c1c82bd:3648:1877942638578176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790945900.696509:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945900.696759:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945900.696804:0:13191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1877942638577920:192.168.204.20@tcp:104: 00010000:00010000:2.0:1790945900.696843:0:13191:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d3f8363dc00/0xd9f4181e0d27d256 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945900.698469:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638578432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790945900.698920:0:7471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616475648 00000100:00100000:0.0:1790945900.698928:0:7471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616475648 00010000:00010000:0.0:1790945900.698964:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d4086a4d200/0xd9f4181e0d27d233 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a56 expref: 13 pid: 6514 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945900.699001:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616475776 00000100:00100000:1.0:1790945900.699006:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616475776 00010000:00010000:1.0:1790945900.699022:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40c21d7c00/0xd9f4181e0d27d1e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a17 expref: 14 pid: 6516 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945900.699054:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 44 00000100:00100000:1.0:1790945900.699063:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83cd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+14:2404:x1877942616475648:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790945900.699095:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945900.699100:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d4086a4d200/0xd9f4181e0d27d233 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a56 expref: 14 pid: 6514 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945900.699111:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d4086a4d200/0xd9f4181e0d27d233 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a56 expref: 14 pid: 6514 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945900.699129:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d4086a4d200/0xd9f4181e0d27d233 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a56 expref: 14 pid: 6514 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945900.699144:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945900.699217:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83cd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:2404:x1877942616475648:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 154us (3594us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945900.699224:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 44 00000100:00100000:1.0:1790945900.699241:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 45 00000100:00100000:1.0:1790945900.699247:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4096cbd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+12:2404:x1877942616475776:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790945900.699255:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945900.699259:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40c21d7c00/0xd9f4181e0d27d1e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a17 expref: 12 pid: 6516 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945900.699269:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40c21d7c00/0xd9f4181e0d27d1e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a17 expref: 12 pid: 6516 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945900.699279:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40c21d7c00/0xd9f4181e0d27d1e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a17 expref: 12 pid: 6516 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945900.699289:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d3f8363dc00/0xd9f4181e0d27d256 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945900.699309:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3f8363dc00/0xd9f4181e0d27d256 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945900.699324:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d3f8363dc00/0xd9f4181e0d27d256 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945900.699331:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d3f8363dc00/0xd9f4181e0d27d256 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945900.699337:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d3f8363dc00/0xd9f4181e0d27d256 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945900.699344:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d3f8363dc00/0xd9f4181e0d27d256 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945900.699349:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f8363dc00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:1.0:1790945900.699353:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d3f8363dc00/0xd9f4181e0d27d256 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945900.699361:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d3f8363dc00/0xd9f4181e0d27d256 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945900.699499:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d3f8363dc00/0xd9f4181e0d27d256 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945900.699511:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945900.699532:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4096cbd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+11:2404:x1877942616475776:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 285us (2774us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945900.699539:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 45 00010000:00010000:2.0:1790945900.699930:0:13191:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d3f8363dc00/0xd9f4181e0d27d256 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945900.699940:0:13191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d3f8363dc00/0xd9f4181e0d27d256 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945900.699946:0:13191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3f8363dc00/0xd9f4181e0d27d256 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945900.895776:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790945900.895802:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40baceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638578560:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790945900.895889:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945900.896100:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638578560 00000100:00100000:1.0:1790945900.896124:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638578560 00000100:00100000:1.0:1790945900.896382:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1790945900.896444:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638578560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790945900.896481:0:6526:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1790945900.896549:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638578560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 158us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945900.896619:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40baceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638578560:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790945900.897055:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00010000:00010000:0.0:1790945901.024872:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945901.121953:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945901.122003:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945901.122109:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945901.122195:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616475904 00000100:00100000:0.0:1790945901.122208:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616475904 00000100:00100000:0.0:1790945901.122275:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 313 00000100:00100000:0.0:1790945901.122284:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408397fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+11:2402:x1877942616475904:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790945901.122360:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408397fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+11:2402:x1877942616475904:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 77us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945901.122367:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 313 00000100:00100000:2.0:1790945901.127534:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616476160 00000100:00100000:2.0:1790945901.127551:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616476160 00000100:00100000:3.0:1790945901.127605:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00080000:1.0:1790945901.127870:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790945901.128048:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945901.128237:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616476416 00000100:00100000:2.0:1790945901.128309:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616476416 00000100:00100000:2.0:1790945901.128362:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616476032 00000100:00100000:2.0:1790945901.128366:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616476032 00000100:00100000:2.0:1790945901.128385:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 183 00000100:00100000:2.0:1790945901.128394:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2402:x1877942616476160:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790945901.128548:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2402:x1877942616476160:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 154us (6543us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945901.128556:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 183 00000100:00100000:2.0:1790945901.128578:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 184 00000100:00100000:2.0:1790945901.128585:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2402:x1877942616476416:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790945901.128613:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2402:x1877942616476416:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 29us (6503us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945901.128619:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 184 00000100:00100000:2.0:1790945901.128631:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 185 00000100:00100000:2.0:1790945901.128637:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83cd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2402:x1877942616476032:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790945901.128661:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83cd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2402:x1877942616476032:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 24us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945901.128667:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 185 00000100:00080000:2.0:1790945901.128709:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790945901.128713:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790945901.134073:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616476288 00000100:00100000:2.0:1790945901.134088:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616476288 00000100:00100000:2.0:1790945901.134191:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 186 00000100:00100000:2.0:1790945901.134202:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4db0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2402:x1877942616476288:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790945901.134309:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4db0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2402:x1877942616476288:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 108us (6260us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945901.134335:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 186 00000100:00080000:1.0:1790945901.135737:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790945901.408014:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790945901.408394:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40baceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638578688:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790945901.408485:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945901.410493:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638578688 00000100:00100000:2.0:1790945901.410506:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638578688 00000100:00100000:2.0:1790945901.410581:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1790945901.410592:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4db1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638578688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790945901.410631:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790945901.410714:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4db1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638578688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (2230us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945901.410720:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1790945901.410878:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40baceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638578688:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1790945902.047266:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945902.225401:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945902.225453:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616476544 00000100:00100000:0.0:1790945902.225471:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616476544 00000100:00100000:0.0:1790945902.225522:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 314 00000100:00100000:0.0:1790945902.225531:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408397e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+11:6173:x1877942616476544:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790945902.225548:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945902.225568:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d4086a4c200/0xd9f4181e0d27d25d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330a87 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945902.225597:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d4086a4c200/0xd9f4181e0d27d25d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a87 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945902.225610:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d4086a4c200/0xd9f4181e0d27d25d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a87 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945902.225620:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4086a4c200, rc 0) 00000100:00100000:0.0:1790945902.225679:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408397e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+12:6173:x1877942616476544:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 149us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945902.225686:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 314 00000100:00100000:2.0:1790945902.235417:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945902.239323:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616476672 00000100:00100000:1.0:1790945902.239340:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616476672 00000100:00100000:1.0:1790945902.239441:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 315 00000100:00100000:1.0:1790945902.239453:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a72fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+12:6173:x1877942616476672:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790945902.239645:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a72fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+12:6173:x1877942616476672:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 194us (4237us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945902.239653:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 315 00000100:00100000:0.0:1790945902.254992:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945902.255279:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616476800 00000100:00100000:1.0:1790945902.255290:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616476800 00000100:00100000:1.0:1790945902.255341:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 316 00000100:00100000:1.0:1790945902.255351:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a72fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+12:6173:x1877942616476800:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790945902.255491:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a72fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+12:6173:x1877942616476800:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 Request processed in 141us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945902.255499:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 316 00000100:00100000:1.0:1790945902.261964:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945902.262091:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616476928 00000100:00100000:0.0:1790945902.262101:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616476928 00000100:00100000:0.0:1790945902.262146:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 317 00000100:00100000:0.0:1790945902.262156:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a71e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+12:6173:x1877942616476928:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790945902.262199:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945902.262219:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d4086a4ce00/0xd9f4181e0d27d264 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330a8e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945902.262250:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d4086a4ce00/0xd9f4181e0d27d264 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a8e expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945902.262276:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d4086a4ce00/0xd9f4181e0d27d264 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a8e expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945902.262286:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4086a4ce00, rc 0) 00000100:00100000:0.0:1790945902.262342:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a71e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:6173:x1877942616476928:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 188us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945902.262350:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 317 00000100:00100000:1.0:1790945902.267500:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945902.267623:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616477056 00000100:00100000:3.0:1790945902.267634:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616477056 00000100:00100000:3.0:1790945902.267692:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 318 00000100:00100000:3.0:1790945902.267703:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a71e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:6173:x1877942616477056:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790945902.267876:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a71e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:6173:x1877942616477056:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 174us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945902.267885:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 318 00000100:00100000:0.0:1790945902.274356:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945902.274432:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616477184 00000100:00100000:3.0:1790945902.274444:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616477184 00000100:00100000:3.0:1790945902.274506:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 319 00000100:00100000:3.0:1790945902.274517:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a71e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:6173:x1877942616477184:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790945902.274802:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a71e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:6173:x1877942616477184:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 Request processed in 282us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945902.274811:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 319 00000100:00100000:0.0:1790945902.433863:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638578816:0@lo:400:kworker.0 00000100:00100000:0.0:1790945902.433939:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945902.433989:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d408aa8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638579328:0@lo:400:kworker.0 00000100:00100000:0.0:1790945902.434015:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945902.434033:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638579840:0@lo:400:kworker.0 00000100:00100000:0.0:1790945902.434055:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945902.434072:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638580352:0@lo:400:kworker.0 00000100:00100000:0.0:1790945902.434092:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945902.434117:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1790945902.434123:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877942638578944:0@lo:400:kworker.0 00000100:00100000:0.0:1790945902.434147:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945902.434187:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d408aa8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1877942638579456:0@lo:400:kworker.0 00000100:00100000:0.0:1790945902.434208:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945902.434224:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1877942638579968:0@lo:400:kworker.0 00000100:00100000:0.0:1790945902.434239:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945902.434270:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638579072:0@lo:400:kworker.0 00000100:00100000:0.0:1790945902.434288:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945902.434302:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1877942638579584:0@lo:400:kworker.0 00000100:00100000:0.0:1790945902.434317:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945902.434328:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1877942638580096:0@lo:400:kworker.0 00000100:00100000:0.0:1790945902.434343:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945902.434358:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1790945902.434362:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d408aa8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1877942638579200:0@lo:400:kworker.0 00000100:00100000:0.0:1790945902.434377:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945902.434384:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638579712:0@lo:400:kworker.0 00000100:00100000:0.0:1790945902.434398:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945902.434409:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638580224:0@lo:400:kworker.0 00000100:00100000:0.0:1790945902.434437:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945902.434578:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4db1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638580480:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790945902.434604:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945902.434629:0:11925:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638580480 00000100:00100000:3.0:1790945902.434635:0:11925:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638580480 00000100:00100000:3.0:1790945902.434678:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1790945902.434686:0:11925:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638580480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790945902.434711:0:11925:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790945902.434745:0:11925:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638580480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945902.434752:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1790945902.434770:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1790945902.434806:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40b4db1880 x1877942638580480/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945918 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945902.434823:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4db1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638580480:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790945902.435833:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638578944 00000100:00100000:2.0:1790945902.435842:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638578944 00000100:00100000:2.0:1790945902.435872:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638579456 00000100:00100000:2.0:1790945902.435875:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638579456 00000100:00100000:2.0:1790945902.435894:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638579968 00000100:00100000:2.0:1790945902.435897:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638579968 00000100:00100000:2.0:1790945902.435909:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638579584 00000100:00100000:2.0:1790945902.435911:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638579584 00000100:00100000:2.0:1790945902.435922:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638580096 00000100:00100000:2.0:1790945902.435925:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638580096 00000100:00100000:2.0:1790945902.435934:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638579200 00000100:00100000:2.0:1790945902.435936:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638579200 00000100:00100000:2.0:1790945902.435951:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1790945902.435958:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877942638578944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945902.436019:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877942638578944:12345-0@lo:400:kworker.0 Request processed in 60us (1870us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945902.436026:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1790945902.436044:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1790945902.436057:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877942638579456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945902.436087:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877942638579456:12345-0@lo:400:kworker.0 Request processed in 32us (1877us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945902.436093:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1790945902.436105:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1790945902.436111:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1877942638579968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945902.436137:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1877942638579968:12345-0@lo:400:kworker.0 Request processed in 27us (1897us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945902.436142:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1790945902.436153:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1790945902.436159:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1877942638579584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945902.436218:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1877942638579584:12345-0@lo:400:kworker.0 Request processed in 60us (1899us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945902.436224:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1790945902.436235:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1790945902.436240:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1877942638580096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945902.436267:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1877942638580096:12345-0@lo:400:kworker.0 Request processed in 27us (1923us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945902.436272:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1790945902.436282:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1790945902.436287:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1877942638579200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945902.436313:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1877942638579200:12345-0@lo:400:kworker.0 Request processed in 27us (1936us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945902.436318:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1790945902.437850:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790945902.437867:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40baced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638580608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790945902.437917:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945902.438019:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638580608 00000100:00100000:3.0:1790945902.438027:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638580608 00000100:00100000:3.0:1790945902.438082:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790945902.438091:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bacece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638580608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790945902.438109:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790945902.438147:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bacece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638580608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945902.438154:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1790945902.438202:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790945902.438207:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790945902.438209:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790945902.438255:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877942638578944:0@lo:400:kworker.0 00000100:00100000:3.0:1790945902.438270:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d408aa8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1877942638579456:0@lo:400:kworker.0 00000100:00100000:3.0:1790945902.438281:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1877942638579968:0@lo:400:kworker.0 00000100:00100000:0.0:1790945902.438454:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638578816 00000100:00100000:0.0:1790945902.438459:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638578816 00000100:00100000:0.0:1790945902.438486:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1790945902.438493:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087036850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+20:3649:x1877942638578816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945902.438530:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087036850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+20:3649:x1877942638578816:12345-0@lo:400:kworker.0 Request processed in 38us (4591us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945902.438536:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1790945902.438564:0:12418:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638579328 00000100:00100000:0.0:1790945902.438567:0:12418:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638579328 00000100:00100000:0.0:1790945902.438592:0:12418:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638579072 00000100:00100000:0.0:1790945902.438594:0:12418:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638579072 00000100:00100000:0.0:1790945902.438605:0:12418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1790945902.438611:0:12418:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638579328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945902.438648:0:12418:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638579328:12345-0@lo:400:kworker.0 Request processed in 38us (4632us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945902.438653:0:12418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1790945902.438662:0:12418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1790945902.438667:0:12418:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638579072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945902.438689:0:12418:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638579072:12345-0@lo:400:kworker.0 Request processed in 22us (4400us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945902.438694:0:12418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1790945902.438708:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638579840 00000100:00100000:0.0:1790945902.438711:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638579840 00000100:00100000:0.0:1790945902.438732:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638580352 00000100:00100000:0.0:1790945902.438734:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638580352 00000100:00100000:0.0:1790945902.438742:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638579712 00000100:00100000:0.0:1790945902.438744:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638579712 00000100:00100000:0.0:1790945902.438752:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638580224 00000100:00100000:0.0:1790945902.438755:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638580224 00000100:00100000:0.0:1790945902.438764:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790945902.438769:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638579840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945902.438810:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638579840:12345-0@lo:400:kworker.0 Request processed in 40us (4754us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945902.438816:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790945902.438828:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790945902.438834:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638580352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945902.438862:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638580352:12345-0@lo:400:kworker.0 Request processed in 29us (4769us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945902.438867:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790945902.438878:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790945902.438889:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638579712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945902.438932:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638579712:12345-0@lo:400:kworker.0 Request processed in 43us (4532us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945902.438938:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790945902.438950:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1790945902.438956:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638580224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945902.438981:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638580224:12345-0@lo:400:kworker.0 Request processed in 26us (4543us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945902.438987:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1790945902.439044:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d408aa8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1877942638579200:0@lo:400:kworker.0 00010000:00080000:0.0:1790945902.439058:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f8265f100 x1877942638579712/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945902.439067:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638579712:0@lo:400:kworker.0 00010000:00080000:0.0:1790945902.439076:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f8265ce00 x1877942638580224/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945902.439082:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638580224:0@lo:400:kworker.0 00000100:00100000:0.0:1790945902.439090:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638579072:0@lo:400:kworker.0 00010000:00080000:0.0:1790945902.439101:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f8265e680 x1877942638579584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945902.439108:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1877942638579584:0@lo:400:kworker.0 00010000:00080000:0.0:1790945902.439117:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f8265e300 x1877942638580096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945902.439124:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1877942638580096:0@lo:400:kworker.0 00000100:00080000:3.0:1790945902.439280:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790945902.439300:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638578816:0@lo:400:kworker.0 00000100:00100000:3.0:1790945902.439311:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d408aa8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638579328:0@lo:400:kworker.0 00010000:00080000:3.0:1790945902.439322:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f8265f800 x1877942638579840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945902.439331:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638579840:0@lo:400:kworker.0 00010000:00080000:3.0:1790945902.439340:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f8265d180 x1877942638580352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945902.439348:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638580352:0@lo:400:kworker.0 00010000:00080000:1.0:1790945902.439433:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40baced180 x1877942638580608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945918 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945902.439458:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40baced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638580608:0@lo:13:osp-pre-1-0.0 10000000:01000000:3.0:1790945902.560238:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790945902.560245:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d3f8248e800 from 7 10000000:01000000:3.0:1790945902.560250:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790945902.560307:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40813ff800/0xd9f4181e0d27d26b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945902.560320:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40813ff800/0xd9f4181e0d27d26b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945902.560333:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40813ff800/0xd9f4181e0d27d26b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945902.560372:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb15180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638580736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790945902.560468:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945902.560518:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40af6600c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790945902.564275:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638580736 00000100:00100000:1.0:1790945902.564288:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638580736 00000100:00100000:1.0:1790945902.564469:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1790945902.564480:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087035050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+20:6519:x1877942638580736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790945902.564499:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945902.564519:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40c21d6000/0xd9f4181e0d27d272 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27d26b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945902.564547:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40c21d6000/0xd9f4181e0d27d272 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27d26b expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945902.564728:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40c21d6000/0xd9f4181e0d27d272 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d26b expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945902.564740:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40c21d6000, rc 0) 00000100:00100000:1.0:1790945902.564834:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087035050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:6519:x1877942638580736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 355us (4372us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945902.564842:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1790945902.566984:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb15180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638580736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790945902.567119:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40813ff800/0xd9f4181e0d27d26b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d272 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945902.567221:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40813ff800/0xd9f4181e0d27d26b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d272 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945902.567308:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb15180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638580864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790945902.567367:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945902.567414:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40af6600c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790945902.571084:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638580864 00000100:00100000:2.0:1790945902.571115:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638580864 00000100:00100000:2.0:1790945902.571289:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1790945902.571302:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087037850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:6519:x1877942638580864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790945902.574071:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087037850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:6519:x1877942638580864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2763us (6697us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945902.574085:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1790945902.574244:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb15180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638580864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790945902.574303:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb15180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638580992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790945902.574356:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945902.574395:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40af6600c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790945902.574811:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638580992 00000100:00100000:2.0:1790945902.574818:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638580992 00000100:00100000:2.0:1790945902.574961:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1790945902.574972:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087036450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:6519:x1877942638580992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790945902.575136:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087036450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:6519:x1877942638580992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945902.575143:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1790945902.575451:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb15180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638580992:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790945902.576738:0:13320:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1790945902.577085:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1790945902.577115:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790945902.577126:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40813ff800/0xd9f4181e0d27d26b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d272 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945902.577138:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40813ff800/0xd9f4181e0d27d26b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d272 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945902.577148:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790945902.577151:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d40bc9be000 from 7 10000000:01000000:2.0:1790945902.577154:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790945902.577343:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d3f8363de00/0xd9f4181e0d27d279 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945902.577353:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d3f8363de00/0xd9f4181e0d27d279 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945902.577374:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d3f8363de00/0xd9f4181e0d27d279 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945902.577395:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638581120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790945902.577451:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945902.577530:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f83588e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790945902.577578:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638581120 00000100:00100000:3.0:1790945902.577586:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638581120 00000100:00100000:3.0:1790945902.577669:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1790945902.577679:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087037450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:6519:x1877942638581120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790945902.577691:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945902.577703:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40813fea00/0xd9f4181e0d27d280 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27d279 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945902.577738:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40813fea00/0xd9f4181e0d27d280 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27d279 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945902.577749:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40813fea00/0xd9f4181e0d27d280 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d279 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945902.577757:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40813fea00, rc 0) 00000100:00100000:3.0:1790945902.577812:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087037450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:6519:x1877942638581120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945902.577818:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1790945902.578067:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638581120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790945902.578082:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d3f8363de00/0xd9f4181e0d27d279 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d280 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945902.578091:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d3f8363de00/0xd9f4181e0d27d279 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d280 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945902.578144:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638581248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790945902.578311:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945902.578382:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40af660480 going to sleep for 11 seconds 00000100:00100000:2.0:1790945902.578417:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638581248 00000100:00100000:2.0:1790945902.578422:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638581248 00000100:00100000:2.0:1790945902.578483:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1790945902.578491:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087034050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:6519:x1877942638581248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790945902.578603:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087034050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:6519:x1877942638581248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945902.578610:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1790945902.578666:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638581248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790945902.578697:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638581376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790945902.578734:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945902.578749:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40af660480 going to sleep for 11 seconds 00000100:00100000:3.0:1790945902.578761:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638581376 00000100:00100000:3.0:1790945902.578770:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638581376 00000100:00100000:3.0:1790945902.578803:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1790945902.578810:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087034450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:6519:x1877942638581376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790945902.578886:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087034450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:6519:x1877942638581376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945902.578893:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1790945902.578937:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638581376:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790945902.579646:0:13321:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1790945902.580032:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1790945902.580056:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790945902.580065:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d3f8363de00/0xd9f4181e0d27d279 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d280 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945902.580077:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d3f8363de00/0xd9f4181e0d27d279 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d280 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945902.580086:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790945902.580089:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d40bacd0800 from 7 10000000:01000000:2.0:1790945902.580092:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790945902.580118:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d3f8363d200/0xd9f4181e0d27d287 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945902.580126:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d3f8363d200/0xd9f4181e0d27d287 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945902.580143:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d3f8363d200/0xd9f4181e0d27d287 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945902.580160:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638581504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790945902.580228:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945902.580257:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f83588a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790945902.580459:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638581504 00000100:00100000:0.0:1790945902.580467:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638581504 00000100:00100000:0.0:1790945902.580515:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1790945902.580524:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087035850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:6519:x1877942638581504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790945902.580539:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945902.580664:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d4086a4d000/0xd9f4181e0d27d28e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27d287 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945902.580691:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d4086a4d000/0xd9f4181e0d27d28e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27d287 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945902.580702:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d4086a4d000/0xd9f4181e0d27d28e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d287 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945902.580711:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4086a4d000, rc 0) 00000100:00100000:0.0:1790945902.580760:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087035850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:6519:x1877942638581504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 237us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945902.580768:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1790945902.580832:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638581504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790945902.580846:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d3f8363d200/0xd9f4181e0d27d287 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d28e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945902.580856:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d3f8363d200/0xd9f4181e0d27d287 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d28e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945902.580908:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638581632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790945902.580934:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945902.580960:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f83588a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790945902.581023:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638581632 00000100:00100000:0.0:1790945902.581027:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638581632 00000100:00100000:0.0:1790945902.581096:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1790945902.581104:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:6519:x1877942638581632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790945902.581236:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:6519:x1877942638581632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945902.581243:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1790945902.582545:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638581632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790945902.582586:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638581760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790945902.582641:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945902.582713:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f83588a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790945902.582786:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638581760 00000100:00100000:0.0:1790945902.582799:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638581760 00000100:00100000:0.0:1790945902.582840:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1790945902.582848:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:6519:x1877942638581760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790945902.582942:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:6519:x1877942638581760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945902.582950:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1790945902.583058:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638581760:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790945902.583912:0:13322:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1790945902.584065:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1790945902.584095:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790945902.584106:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d3f8363d200/0xd9f4181e0d27d287 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d28e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945902.584118:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d3f8363d200/0xd9f4181e0d27d287 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d28e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945902.584128:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790945902.584131:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d4087223000 from 7 10000000:01000000:0.0:1790945902.584134:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790945902.584193:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d600/0xd9f4181e0d27d295 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945902.584202:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d600/0xd9f4181e0d27d295 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945902.584212:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d600/0xd9f4181e0d27d295 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945902.584229:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40accd1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638581888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790945902.584272:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945902.584299:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f81b38180 going to sleep for 11 seconds 00000100:00100000:2.0:1790945902.584372:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638581888 00000100:00100000:2.0:1790945902.584379:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638581888 00000100:00100000:2.0:1790945902.584423:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1790945902.584432:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087033050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:6519:x1877942638581888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790945902.584444:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945902.584456:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3f8363da00/0xd9f4181e0d27d29c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27d295 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945902.584479:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3f8363da00/0xd9f4181e0d27d29c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27d295 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945902.584491:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3f8363da00/0xd9f4181e0d27d29c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d295 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945902.584500:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f8363da00, rc 0) 00000100:00100000:2.0:1790945902.584537:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087033050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:6519:x1877942638581888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945902.584544:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1790945902.584621:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40accd1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638581888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790945902.584641:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d600/0xd9f4181e0d27d295 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d29c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945902.584651:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d600/0xd9f4181e0d27d295 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d29c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945902.584698:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40accd1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638582016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790945902.584721:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945902.584740:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f81b38180 going to sleep for 11 seconds 00000100:00100000:2.0:1790945902.584836:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638582016 00000100:00100000:2.0:1790945902.584841:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638582016 00000100:00100000:2.0:1790945902.584870:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1790945902.584877:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:6519:x1877942638582016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790945902.585116:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:6519:x1877942638582016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 239us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945902.585124:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1790945902.585547:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40accd1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638582016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790945902.585578:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40accd1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638582144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790945902.585706:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945902.585748:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638582144 00000100:00100000:3.0:1790945902.585755:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638582144 00000100:00100000:0.0:1790945902.585758:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f81b38180 going to sleep for 11 seconds 00000100:00100000:3.0:1790945902.585802:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1790945902.585812:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:6519:x1877942638582144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790945902.585901:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:6519:x1877942638582144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945902.585908:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1790945902.586066:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40accd1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638582144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790945902.586915:0:13323:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1790945902.587135:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1790945902.587158:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790945902.587189:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d600/0xd9f4181e0d27d295 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d29c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945902.587202:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d600/0xd9f4181e0d27d295 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d29c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945903.071317:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790945903.707409:0:13389:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790945904.096861:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945904.480375:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638582272:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790945904.480449:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945904.480612:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638582272 00000100:00100000:2.0:1790945904.480622:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638582272 00000100:00080000:0.0:1790945904.480758:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790945904.480811:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790945904.480822:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40baced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638582272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790945904.480854:0:8438:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790945904.480930:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40baced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638582272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945904.480938:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:1.0:1790945904.481127:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f81bd3800 x1877942638582272/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945920 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945904.481146:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638582272:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790945904.481323:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790945904.481333:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638582400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790945904.481361:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945904.481474:0:11925:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638582400 00000100:00100000:3.0:1790945904.481480:0:11925:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638582400 00000100:00100000:3.0:1790945904.481526:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1790945904.481535:0:11925:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bacee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638582400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790945904.481557:0:11925:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790945904.481601:0:11925:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bacee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638582400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945904.481608:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:1.0:1790945904.481757:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcb17100 x1877942638582400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945920 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945904.481771:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638582400:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790945904.481824:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790945905.119330:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945906.016557:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638582528:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790945906.016640:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945906.016931:0:12418:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638582528 00000100:00100000:2.0:1790945906.016940:0:12418:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638582528 00000100:00100000:2.0:1790945906.017002:0:12418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1790945906.017012:0:12418:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40baceed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638582528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790945906.017047:0:12418:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1790945906.017107:0:12418:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40baceed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638582528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945906.017115:0:12418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1790945906.017573:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638582528:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1790945906.143334:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945906.247382:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945906.247423:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945906.247451:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945906.247471:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945906.247497:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945906.247523:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616477440 00000100:00100000:2.0:1790945906.247531:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616477440 00000100:00100000:2.0:1790945906.247597:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616477696 00000100:00100000:2.0:1790945906.247600:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616477696 00000100:00100000:2.0:1790945906.247614:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616477568 00000100:00100000:2.0:1790945906.247617:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616477568 00000100:00100000:2.0:1790945906.247628:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616477824 00000100:00100000:2.0:1790945906.247630:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616477824 00000100:00100000:2.0:1790945906.247644:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 193 00000100:00100000:2.0:1790945906.247653:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2403:x1877942616477440:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790945906.247747:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2403:x1877942616477440:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 95us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945906.247771:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 193 00000100:00100000:2.0:1790945906.247793:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 194 00000100:00100000:2.0:1790945906.247800:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2403:x1877942616477696:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790945906.247828:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2403:x1877942616477696:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 29us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945906.247847:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 194 00000100:00100000:2.0:1790945906.247861:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 195 00000100:00100000:2.0:1790945906.247867:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2403:x1877942616477568:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790945906.247893:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2403:x1877942616477568:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 26us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945906.247898:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 195 00000100:00100000:2.0:1790945906.247910:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 196 00000100:00100000:2.0:1790945906.247916:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2403:x1877942616477824:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790945906.247939:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2403:x1877942616477824:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 23us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945906.247945:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 196 00000100:00100000:2.0:1790945906.247963:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616477312 00000100:00100000:2.0:1790945906.247966:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616477312 00000100:00100000:2.0:1790945906.247990:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 333 00000100:00100000:2.0:1790945906.247996:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:2403:x1877942616477312:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790945906.248018:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:2403:x1877942616477312:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 22us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945906.248023:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 333 00000100:00080000:2.0:1790945906.248056:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790945906.248061:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790945906.527517:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638582656:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790945906.527593:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945906.527756:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638582656 00000100:00100000:1.0:1790945906.527764:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638582656 00000100:00100000:1.0:1790945906.527821:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1790945906.527830:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40accd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638582656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790945906.527865:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790945906.527918:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40accd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638582656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945906.527926:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1790945906.528007:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638582656:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1790945907.173458:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945907.551449:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790945907.551477:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638582784:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790945907.551556:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945907.551913:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790945907.551923:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638582912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790945907.551951:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945907.551986:0:11925:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638582784 00000100:00100000:2.0:1790945907.551994:0:11925:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638582784 00000100:00100000:2.0:1790945907.552054:0:11925:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638582912 00000100:00100000:2.0:1790945907.552058:0:11925:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638582912 00000100:00100000:2.0:1790945907.552077:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790945907.552096:0:11925:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638582784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790945907.552126:0:11925:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790945907.552187:0:11925:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638582784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945907.552195:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790945907.552214:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1790945907.552221:0:11925:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638582912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790945907.552231:0:11925:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790945907.552259:0:11925:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638582912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945907.552265:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:2.0:1790945907.552281:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1790945907.552309:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f81bd3480 x1877942638582912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945923 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945907.552499:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638582912:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1790945907.552548:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcb17100 x1877942638582784/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945923 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945907.552559:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638582784:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790945907.567517:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638583168:0@lo:400:kworker.0 00000100:00100000:2.0:1790945907.567600:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945907.567703:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638583168 00000100:00100000:2.0:1790945907.567712:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638583168 00000100:00100000:2.0:1790945907.567755:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1790945907.567764:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4cec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638583168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945907.567822:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4cec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638583168:12345-0@lo:400:kworker.0 Request processed in 57us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945907.567829:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1790945907.567876:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638583168:0@lo:400:kworker.0 00000100:00100000:2.0:1790945907.567917:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4cefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638583296:0@lo:400:kworker.0 00000100:00100000:2.0:1790945907.567944:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945907.567976:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638583296 00000100:00100000:2.0:1790945907.567980:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638583296 00000100:00100000:2.0:1790945907.568023:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1790945907.568031:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4ced180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638583296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945907.568067:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4ced180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638583296:12345-0@lo:400:kworker.0 Request processed in 38us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945907.568073:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1790945907.568432:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4cefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638583296:0@lo:400:kworker.0 00000100:00100000:2.0:1790945907.568476:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1877942638583680:0@lo:400:kworker.0 00000100:00100000:2.0:1790945907.568514:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945907.568563:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4cef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1877942638583808:0@lo:400:kworker.0 00000100:00100000:2.0:1790945907.568583:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945907.568633:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4cef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1877942638584192:0@lo:400:kworker.0 00000100:00100000:0.0:1790945907.568799:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4cefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638583424:0@lo:400:kworker.0 00000100:00100000:0.0:1790945907.568830:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945907.568860:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4cee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638583936:0@lo:400:kworker.0 00000100:00100000:0.0:1790945907.568884:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945907.568903:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1790945907.568910:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638583040:0@lo:400:kworker.0 00000100:00100000:0.0:1790945907.568935:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945907.568955:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4cec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638583552:0@lo:400:kworker.0 00000100:00100000:0.0:1790945907.568976:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945907.568991:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4ceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638584064:0@lo:400:kworker.0 00000100:00100000:0.0:1790945907.569028:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945907.569056:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638583936 00000100:00100000:0.0:1790945907.569061:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638583936 00000100:00100000:0.0:1790945907.569113:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638584064 00000100:00100000:0.0:1790945907.569116:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638584064 00000100:00100000:0.0:1790945907.569136:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1790945907.569143:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40accd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638583936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945907.569209:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40accd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638583936:12345-0@lo:400:kworker.0 Request processed in 66us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945907.569217:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1790945907.569231:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1790945907.569237:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40accd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638584064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945907.569263:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40accd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638584064:12345-0@lo:400:kworker.0 Request processed in 26us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945907.569268:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1790945907.569284:0:12418:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638583552 00000100:00100000:0.0:1790945907.569287:0:12418:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638583552 00000100:00100000:0.0:1790945907.569314:0:12418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1790945907.569637:0:12418:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40accd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638583552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945907.569778:0:12418:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40accd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638583552:12345-0@lo:400:kworker.0 Request processed in 145us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945907.569785:0:12418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1790945907.569828:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4cec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638583552:0@lo:400:kworker.0 00010000:00080000:0.0:1790945907.569841:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40b4ceca80 x1877942638584064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945907.569851:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4ceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638584064:0@lo:400:kworker.0 00010000:00080000:0.0:1790945907.569861:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40b4cee680 x1877942638583936/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945907.569870:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4cee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638583936:0@lo:400:kworker.0 00000100:00100000:3.0:1790945907.570523:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638583680 00000100:00100000:3.0:1790945907.570531:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638583680 00000100:00100000:3.0:1790945907.570578:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638583808 00000100:00100000:3.0:1790945907.570581:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638583808 00000100:00100000:3.0:1790945907.570594:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638583424 00000100:00100000:3.0:1790945907.570596:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638583424 00000100:00100000:3.0:1790945907.570609:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1790945907.570615:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4cece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1877942638583680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945907.570671:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4cece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1877942638583680:12345-0@lo:400:kworker.0 Request processed in 55us (2156us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945907.570677:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1790945907.570713:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1790945907.570720:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4ceed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1877942638583808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945907.570749:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4ceed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1877942638583808:12345-0@lo:400:kworker.0 Request processed in 31us (2165us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945907.570754:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1790945907.570766:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1790945907.570772:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40accd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638583424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945907.570805:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40accd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638583424:12345-0@lo:400:kworker.0 Request processed in 33us (1974us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945907.570811:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1790945907.570847:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638583040 00000100:00100000:3.0:1790945907.570850:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638583040 00000100:00100000:3.0:1790945907.570874:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1790945907.570880:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087031050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3649:x1877942638583040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945907.570910:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087031050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3649:x1877942638583040:12345-0@lo:400:kworker.0 Request processed in 31us (1975us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945907.570915:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1790945907.570957:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638583040:0@lo:400:kworker.0 00000100:00100000:3.0:1790945907.570969:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4cefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638583424:0@lo:400:kworker.0 00010000:00080000:3.0:1790945907.571017:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40b4cef100 x1877942638583808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945907.571026:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4cef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1877942638583808:0@lo:400:kworker.0 00000100:00100000:3.0:1790945907.571069:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1877942638584320:0@lo:400:kworker.0 00000100:00100000:2.0:1790945907.571528:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945907.571563:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1877942638583680:0@lo:400:kworker.0 00000100:00080000:2.0:1790945907.571588:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790945907.571592:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790945907.571595:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790945907.571603:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638584192 00000100:00100000:2.0:1790945907.571606:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638584192 00000100:00100000:2.0:1790945907.571637:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1790945907.571794:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945907.571822:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638584320 00000100:00100000:3.0:1790945907.571826:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638584320 00000100:00100000:3.0:1790945907.571845:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1790945907.571852:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1877942638584320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945907.571888:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1877942638584320:12345-0@lo:400:kworker.0 Request processed in 37us (93us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945907.571894:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00010000:00080000:3.0:1790945907.571920:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcb15180 x1877942638584320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945907.571932:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1877942638584320:0@lo:400:kworker.0 00000100:00080000:3.0:1790945907.571979:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790945907.571981:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790945907.573198:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4cedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1877942638584192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945907.573277:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4cedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1877942638584192:12345-0@lo:400:kworker.0 Request processed in 1633us (1749us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945907.573284:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1790945907.573948:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4cef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1877942638584192:0@lo:400:kworker.0 00000001:02000400:2.0:1790945907.994599:0:13539:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 08:58:27 (1790945907) === 00010000:00010000:0.0:1790945908.204642:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945908.230280:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945908.230320:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945908.230529:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616478080 00000100:00100000:3.0:1790945908.230540:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616478080 00000100:00100000:3.0:1790945908.230611:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2 00000100:00100000:3.0:1790945908.230623:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4cec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:10472:x1877942616478080:12345-192.168.204.20@tcp:700:mkdir.0 00000100:00100000:3.0:1790945908.230713:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4cec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:10472:x1877942616478080:12345-192.168.204.20@tcp:700:mkdir.0 Request processed in 92us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945908.230721:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2 00000100:00100000:3.0:1790945908.230749:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616477952 00000100:00100000:3.0:1790945908.230753:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616477952 00000100:00100000:3.0:1790945908.230777:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 22 00000100:00100000:3.0:1790945908.230784:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4cedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2401:x1877942616477952:12345-192.168.204.20@tcp:41:mkdir.0 00000004:00000024:3.0:1790945908.230808:0:6521:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1790945908.230858:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4cedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2401:x1877942616477952:12345-192.168.204.20@tcp:41:mkdir.0 Request processed in 74us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945908.230865:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 22 00000100:00080000:2.0:1790945908.231101:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790945908.233690:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945908.233838:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616478336 00000100:00100000:0.0:1790945908.233849:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616478336 00000100:00100000:0.0:1790945908.233898:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 23 00000100:00100000:0.0:1790945908.233907:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:10472:x1877942616478336:12345-192.168.204.20@tcp:36:mkdir.0 00010000:00010000:0.0:1790945908.234028:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945908.234079:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d145 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a02 expref: 6 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.234107:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3f824ef100) 00010000:00010000:0.0:1790945908.234123:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790945908.234875:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4d200/0xd9f4181e0d27d2a3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.234892:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4d200/0xd9f4181e0d27d2a3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.234916:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4d200/0xd9f4181e0d27d2a3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.234928:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4da00/0xd9f4181e0d27d2aa lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.234934:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4da00/0xd9f4181e0d27d2aa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.234939:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4da00/0xd9f4181e0d27d2aa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.238303:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4cc00/0xd9f4181e0d27d2b1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.238338:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4cc00/0xd9f4181e0d27d2b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.238349:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4cc00/0xd9f4181e0d27d2b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790945908.238370:0:6523:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008ec9dbca reply state 000000004f46e71c transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4cc00/0xd9f4181e0d27d2b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.238382:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4cc00/0xd9f4181e0d27d2b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.238390:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d40bc9af200) 00010000:00010000:0.0:1790945908.238393:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790945908.238397:0:6523:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1790945908.238402:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1790945908.238410:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4d200/0xd9f4181e0d27d2a3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.238424:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4d200/0xd9f4181e0d27d2a3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.238431:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4d200/0xd9f4181e0d27d2a3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.238437:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4086a4d200 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945908.238442:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4d200/0xd9f4181e0d27d2a3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.238449:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4d200/0xd9f4181e0d27d2a3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.238458:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d40bc9af900) 00010000:00010000:0.0:1790945908.238876:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945908.238883:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4d200/0xd9f4181e0d27d2a3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.238890:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4d200/0xd9f4181e0d27d2a3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790945908.238911:0:6523:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008ec9dbca reply state 000000004f46e71c transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4da00/0xd9f4181e0d27d2aa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.238919:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4da00/0xd9f4181e0d27d2aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.238925:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9d40bc9afe00) 00010000:00010000:0.0:1790945908.238927:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790945908.238929:0:6523:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1790945908.239122:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:10472:x1877942616478336:12345-192.168.204.20@tcp:36:mkdir.0 Request processed in 5210us (5450us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1790945908.239139:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 23 00000100:00100000:2.0:1790945908.247019:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945908.247233:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616478464 00000100:00100000:3.0:1790945908.247245:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616478464 00000100:00100000:3.0:1790945908.247320:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 24 00000100:00100000:3.0:1790945908.247332:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4ced500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:10473:x1877942616478464:12345-192.168.204.20@tcp:101:chmod.0 00010000:00010000:3.0:1790945908.247358:0:13005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945908.247386:0:13005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d2b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330a95 expref: -99 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.247474:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27d2bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.247489:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27d2bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.247502:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27d2bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945908.247547:0:13005:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790945908.247551:0:13005:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790945908.247584:0:13005:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27d2bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.247608:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d2b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a95 expref: 9 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.247624:0:13005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27d2bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a95 expref: 8 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.247633:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d408a8d4b00) 00010000:00010000:3.0:1790945908.247635:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790945908.247639:0:13005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4080030a00, rc 0) 00000100:00100000:3.0:1790945908.247706:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4ced500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+8:10473:x1877942616478464:12345-192.168.204.20@tcp:101:chmod.0 Request processed in 376us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945908.247713:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 24 00000100:00100000:3.0:1790945908.251838:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945908.252100:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616478720 00000100:00100000:0.0:1790945908.252111:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616478720 00000100:00100000:0.0:1790945908.252191:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 25 00000100:00100000:0.0:1790945908.252200:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+8:10473:x1877942616478720:12345-192.168.204.20@tcp:36:chmod.0 00010000:00010000:0.0:1790945908.252259:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945908.252285:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27d2bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a95 expref: 8 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.252309:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d408a8d4b00) 00010000:00010000:0.0:1790945908.252319:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790945908.252345:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4d200/0xd9f4181e0d27d2c6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.252365:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4d200/0xd9f4181e0d27d2c6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.252376:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4d200/0xd9f4181e0d27d2c6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790945908.252676:0:8457:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000016c8a87 reply state 00000000753bd3f2 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4d200/0xd9f4181e0d27d2c6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.252692:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4d200/0xd9f4181e0d27d2c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.252699:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d40bc9af900) 00010000:00010000:0.0:1790945908.252702:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1790945908.252705:0:8457:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1790945908.252721:0:8457:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1790945908.252864:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+9:10473:x1877942616478720:12345-192.168.204.20@tcp:36:chmod.0 Request processed in 664us (1035us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1790945908.252874:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 25 00000100:00100000:3.0:1790945908.287786:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945908.287980:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616478848 00000100:00100000:0.0:1790945908.287991:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616478848 00000100:00100000:0.0:1790945908.288054:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 26 00000100:00100000:0.0:1790945908.288064:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+9:10474:x1877942616478848:12345-192.168.204.20@tcp:101:chown.0 00010000:00010000:0.0:1790945908.288087:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945908.288107:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4c000/0xd9f4181e0d27d2cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330a9c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.288204:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4dc00/0xd9f4181e0d27d2d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.288218:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4dc00/0xd9f4181e0d27d2d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.288230:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4dc00/0xd9f4181e0d27d2d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945908.288278:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790945908.288282:0:6523:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790945908.288325:0:6523:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4dc00/0xd9f4181e0d27d2d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.288349:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4c000/0xd9f4181e0d27d2cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a9c expref: 11 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.288368:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4dc00/0xd9f4181e0d27d2d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a9c expref: 10 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.288385:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d40bc9af900) 00010000:00010000:0.0:1790945908.288389:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790945908.288392:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4086a4dc00, rc 0) 00000100:00100000:0.0:1790945908.288455:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+10:10474:x1877942616478848:12345-192.168.204.20@tcp:101:chown.0 Request processed in 391us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945908.288474:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 26 00000100:00100000:2.0:1790945908.291564:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945908.291720:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616478976 00000100:00100000:3.0:1790945908.291740:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616478976 00000100:00100000:3.0:1790945908.291786:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 27 00000100:00100000:3.0:1790945908.291794:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4cef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+10:10474:x1877942616478976:12345-192.168.204.20@tcp:101:chown.0 00010000:00010000:3.0:1790945908.291813:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945908.291829:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d2db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330aa3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.291887:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030200/0xd9f4181e0d27d2e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.291901:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030200/0xd9f4181e0d27d2e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.291911:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030200/0xd9f4181e0d27d2e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.291920:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27d2e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.291927:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27d2e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.291933:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27d2e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.292000:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d2f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.292007:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d2f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.292027:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d2f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945908.292066:0:6521:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790945908.292069:0:6521:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790945908.292088:0:6521:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d2f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.292100:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030200/0xd9f4181e0d27d2e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.292106:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030200/0xd9f4181e0d27d2e2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.292113:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030200/0xd9f4181e0d27d2e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.292119:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080030200 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945908.292123:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030200/0xd9f4181e0d27d2e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.292129:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030200/0xd9f4181e0d27d2e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.292140:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d40bc9af900) 00010000:00010000:3.0:1790945908.292142:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945908.292147:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030200/0xd9f4181e0d27d2e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.292151:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030200/0xd9f4181e0d27d2e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.292443:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27d2e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.292450:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27d2e9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.292455:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27d2e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.292460:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080030a00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945908.292464:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27d2e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.292469:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27d2e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.292477:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9d40bc9afe00) 00010000:00010000:3.0:1790945908.292596:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945908.292602:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27d2e9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.292608:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27d2e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.292636:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d2db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330aa3 expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.292651:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d2f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330aa3 expref: 11 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.292679:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d40bc9af200) 00010000:00010000:3.0:1790945908.292682:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790945908.292684:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4080031800, rc 0) 00000100:00100000:3.0:1790945908.292889:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4cef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+11:10474:x1877942616478976:12345-192.168.204.20@tcp:101:chown.0 Request processed in 1094us (1332us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945908.292897:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 27 00000100:00100000:3.0:1790945908.307118:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945908.307300:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616479104 00000100:00100000:2.0:1790945908.307320:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616479104 00000100:00100000:2.0:1790945908.307389:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00100000:2.0:1790945908.307400:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+11:10474:x1877942616479104:12345-192.168.204.20@tcp:900:chown.0 00000100:00100000:2.0:1790945908.307502:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+11:10474:x1877942616479104:12345-192.168.204.20@tcp:900:chown.0 Request processed in 104us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945908.307511:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00100000:0.0:1790945908.311848:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945908.312269:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616479360 00000100:00100000:3.0:1790945908.312280:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616479360 00000100:00100000:3.0:1790945908.312378:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 28 00000100:00100000:3.0:1790945908.312389:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40accd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+11:10474:x1877942616479360:12345-192.168.204.20@tcp:36:chown.0 00010000:00010000:3.0:1790945908.312442:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945908.312477:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d2f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330aa3 expref: 11 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.312504:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d40bc9af200) 00010000:00010000:3.0:1790945908.312509:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790945908.312539:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d2f7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.312553:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d2f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.312563:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d2f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790945908.317206:0:6500:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:0.0:1790945908.317341:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4da00/0xd9f4181e0d27d2aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.317355:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4da00/0xd9f4181e0d27d2aa lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.317364:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4da00/0xd9f4181e0d27d2aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.317369:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4086a4da00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945908.317374:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4da00/0xd9f4181e0d27d2aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.317381:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4da00/0xd9f4181e0d27d2aa lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.317396:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9d40bc9afe00) 00010000:00010000:0.0:1790945908.317399:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00010000:3.0:1790945908.317402:0:8457:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000fb38b273 reply state 00000000eff8322c transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d2f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.317403:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4da00/0xd9f4181e0d27d2aa lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.317409:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4da00/0xd9f4181e0d27d2aa lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.317425:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d2f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.317433:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4cc00/0xd9f4181e0d27d2b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.317438:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4cc00/0xd9f4181e0d27d2b1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.317445:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4cc00/0xd9f4181e0d27d2b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.317646:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d40bc9af200) 00010000:00010000:3.0:1790945908.317650:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1790945908.317654:0:8457:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1790945908.317679:0:8457:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:3.0:1790945908.317840:0:8457:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1790945908.317860:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40accd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+9:10474:x1877942616479360:12345-192.168.204.20@tcp:36:chown.0 Request processed in 5468us (6017us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1790945908.317868:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 28 00010000:00010000:3.0:1790945908.317919:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d2f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.317928:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d2f7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.317934:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d2f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.317939:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080031400 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945908.317943:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d2f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.317949:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d2f7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.317959:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d40bc9af200) 00010000:00010000:3.0:1790945908.317961:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790945908.317964:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d2f7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.317977:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d2f7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.318359:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4086a4cc00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945908.318364:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4cc00/0xd9f4181e0d27d2b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.318371:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4cc00/0xd9f4181e0d27d2b1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.318379:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d40bc9af200) 00010000:00010000:0.0:1790945908.318382:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945908.318385:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4cc00/0xd9f4181e0d27d2b1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.318391:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4cc00/0xd9f4181e0d27d2b1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.318407:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4d200/0xd9f4181e0d27d2c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.318414:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4d200/0xd9f4181e0d27d2c6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.318420:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4d200/0xd9f4181e0d27d2c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.318432:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4086a4d200 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945908.318435:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4d200/0xd9f4181e0d27d2c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.318440:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4d200/0xd9f4181e0d27d2c6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.318449:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d40bc9af900) 00010000:00010000:0.0:1790945908.318451:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790945908.318454:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4d200/0xd9f4181e0d27d2c6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.318460:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4d200/0xd9f4181e0d27d2c6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945908.327567:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945908.327661:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616479488 00000100:00100000:1.0:1790945908.327683:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616479488 00000100:00100000:1.0:1790945908.327758:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 29 00000100:00100000:1.0:1790945908.327768:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:10475:x1877942616479488:12345-192.168.204.20@tcp:101:touch.500 00010000:00010000:1.0:1790945908.327795:0:13005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945908.327832:0:13005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6a00/0xd9f4181e0d27d2fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330aaa expref: -99 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790945908.331941:0:13005:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4056us 00010000:00010000:0.0:1790945908.339881:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4d200/0xd9f4181e0d27d305 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.339905:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4d200/0xd9f4181e0d27d305 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.339917:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4d200/0xd9f4181e0d27d305 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.339934:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4cc00/0xd9f4181e0d27d30c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.339941:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4cc00/0xd9f4181e0d27d30c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.339948:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4cc00/0xd9f4181e0d27d30c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.340071:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4da00/0xd9f4181e0d27d313 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.340080:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4da00/0xd9f4181e0d27d313 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.340086:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4da00/0xd9f4181e0d27d313 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945908.340115:0:13005:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790945908.340119:0:13005:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790945908.340206:0:13005:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4da00/0xd9f4181e0d27d313 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.340219:0:13005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4d200/0xd9f4181e0d27d305 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.340226:0:13005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4d200/0xd9f4181e0d27d305 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.340232:0:13005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4d200/0xd9f4181e0d27d305 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.340238:0:13005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4086a4d200 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945908.340242:0:13005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4d200/0xd9f4181e0d27d305 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.340249:0:13005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4d200/0xd9f4181e0d27d305 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.340261:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d40bc9af900) 00010000:00010000:0.0:1790945908.340269:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945908.340274:0:13005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4d200/0xd9f4181e0d27d305 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.340280:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4d200/0xd9f4181e0d27d305 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.340292:0:13005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4cc00/0xd9f4181e0d27d30c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.340298:0:13005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4cc00/0xd9f4181e0d27d30c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.340371:0:13005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4cc00/0xd9f4181e0d27d30c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.340376:0:13005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4086a4cc00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945908.340379:0:13005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4cc00/0xd9f4181e0d27d30c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.340386:0:13005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4cc00/0xd9f4181e0d27d30c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.340392:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9d40bc9af200) 00010000:00010000:0.0:1790945908.340395:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945908.340397:0:13005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4cc00/0xd9f4181e0d27d30c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.340402:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4cc00/0xd9f4181e0d27d30c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.340438:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6a00/0xd9f4181e0d27d2fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330aaa expref: 8 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.340466:0:13005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4da00/0xd9f4181e0d27d313 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330aaa expref: 7 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.340474:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d40bc9afe00) 00010000:00010000:0.0:1790945908.340476:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1790945908.340479:0:13005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4086a4da00, rc 0) 00000100:00100000:0.0:1790945908.340562:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:10475:x1877942616479488:12345-192.168.204.20@tcp:101:touch.500 Request processed in 12795us (13003us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945908.340572:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 29 00000100:00100000:2.0:1790945908.343299:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945908.343410:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616479744 00000100:00100000:0.0:1790945908.343419:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616479744 00000100:00100000:0.0:1790945908.343542:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 30 00000100:00100000:0.0:1790945908.343552:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4cef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:10475:x1877942616479744:12345-192.168.204.20@tcp:101:touch.500 00010000:00010000:0.0:1790945908.343573:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945908.343591:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4c000/0xd9f4181e0d27d31a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330ab1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.343717:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4ca00/0xd9f4181e0d27d321 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.343795:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4ca00/0xd9f4181e0d27d321 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.343806:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4ca00/0xd9f4181e0d27d321 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.343835:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27d328 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x30bd2b02 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.343845:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27d328 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x30bd2b02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.343851:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27d328 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x30bd2b02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790945908.344328:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:0.0:1790945908.344496:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27d32f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.344507:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27d32f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.344518:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27d32f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.344553:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4ca00/0xd9f4181e0d27d321 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.344560:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4ca00/0xd9f4181e0d27d321 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.344566:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4ca00/0xd9f4181e0d27d321 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.344572:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4086a4ca00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945908.344576:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4ca00/0xd9f4181e0d27d321 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.344584:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4ca00/0xd9f4181e0d27d321 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.344606:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d40bc9afe00) 00010000:00010000:0.0:1790945908.344608:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945908.344613:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4ca00/0xd9f4181e0d27d321 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.344619:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4ca00/0xd9f4181e0d27d321 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790945908.344632:0:6521:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000061433130 reply state 00000000dc8f857b transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27d328 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x30bd2b02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.344642:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27d328 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x30bd2b02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.344648:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x30bd2b02 (ffff9d40bc9af400) 00010000:00010000:0.0:1790945908.344650:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790945908.344653:0:6521:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790945908.344695:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4c000/0xd9f4181e0d27d31a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ab1 expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.344710:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27d32f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ab1 expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.344717:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9d40bc9af600) 00010000:00010000:0.0:1790945908.344719:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790945908.344840:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe0600, rc 0) 00000100:00100000:0.0:1790945908.344908:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4cef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+10:10475:x1877942616479744:12345-192.168.204.20@tcp:101:touch.500 Request processed in 1357us (1617us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1790945908.344915:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 30 00000100:00100000:2.0:1790945908.347928:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945908.348034:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616480000 00000100:00100000:3.0:1790945908.348044:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616480000 00000100:00100000:3.0:1790945908.348137:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 31 00000100:00100000:3.0:1790945908.348147:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4cefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+10:10475:x1877942616480000:12345-192.168.204.20@tcp:36:touch.500 00010000:00010000:3.0:1790945908.348235:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945908.348259:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27d32f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ab1 expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.348279:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9d40bc9af600) 00010000:00010000:3.0:1790945908.348289:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790945908.348341:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d33d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.348354:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d33d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.348364:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d33d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790945908.348469:0:8457:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001e83b0bb reply state 000000002a863363 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d33d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.348482:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d33d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.348501:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9d408a8d4600) 00010000:00010000:3.0:1790945908.348504:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790945908.348507:0:8457:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790945908.348598:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4cefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+11:10475:x1877942616480000:12345-192.168.204.20@tcp:36:touch.500 Request processed in 453us (679us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1790945908.348606:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 31 00000100:00100000:3.0:1790945908.350972:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945908.351073:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616480128 00000100:00100000:0.0:1790945908.351082:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616480128 00000100:00100000:0.0:1790945908.351204:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 32 00000100:00100000:0.0:1790945908.351215:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+11:10475:x1877942616480128:12345-192.168.204.20@tcp:101:touch.500 00010000:00010000:0.0:1790945908.351237:0:13005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945908.351254:0:13005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27d344 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330ab8 expref: -99 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.351311:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27d344 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ab8 expref: 12 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.351325:0:13005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27d344 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ab8 expref: 12 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.351344:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9d408a8d4600) 00010000:00010000:0.0:1790945908.351347:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790945908.351350:0:13005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe1200, rc 0) 00000100:00100000:0.0:1790945908.351399:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+12:10475:x1877942616480128:12345-192.168.204.20@tcp:101:touch.500 Request processed in 187us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945908.351406:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 32 00000100:00100000:0.0:1790945908.359754:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945908.359794:0:8436:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616480256 00000100:00100000:2.0:1790945908.359805:0:8436:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616480256 00000100:00100000:2.0:1790945908.359893:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 24 00000100:00100000:2.0:1790945908.359903:0:8436:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40accd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2400:x1877942616480256:12345-192.168.204.20@tcp:8:touch.500 00010000:00080000:2.0:1790945908.359938:0:8436:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 0cadc7a5-c0ba-4320-984f-d871ffb3a3ef@192.168.204.20@tcp t0 exp 0000000000000000 cur 359 last 0 00000020:00000080:2.0:1790945908.359967:0:8436:0:(genops.c:1384:class_connect()) connect: client 0cadc7a5-c0ba-4320-984f-d871ffb3a3ef, cookie 0xd9f4181e0d27d34b 00002000:00100000:2.0:1790945908.360469:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0cadc7a5-c0ba-4320-984f-d871ffb3a3ef/ffff9d3f83d22000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790945908.360500:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790945908.360573:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790945908.360604:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9d3f83d26000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790945908.360686:0:8436:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40accd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2400:x1877942616480256:12345-192.168.204.20@tcp:8:touch.500 Request processed in 782us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945908.360704:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 24 00000100:00100000:2.0:1790945908.365321:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945908.365424:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616480384 00000100:00100000:0.0:1790945908.365435:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616480384 00000100:00100000:0.0:1790945908.365539:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 25 00000100:00100000:0.0:1790945908.365548:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4cee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:0:x1877942616480384:12345-192.168.204.20@tcp:2:touch.500 00000100:00080000:2.0:1790945908.365796:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1790945908.380455:0:8429:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:2.0:1790945908.380474:0:8429:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0cadc7a5-c0ba-4320-984f-d871ffb3a3ef 00000100:00100000:0.0:1790945908.381973:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4cee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:0:x1877942616480384:12345-192.168.204.20@tcp:2:touch.500 Request processed in 16415us (16652us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1790945908.382345:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 25 00000100:00100000:3.0:1790945908.392448:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945908.392704:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616480640 00000100:00100000:1.0:1790945908.392726:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616480640 00000100:00100000:1.0:1790945908.392789:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2 00000100:00100000:1.0:1790945908.392799:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+12:10475:x1877942616480640:12345-192.168.204.20@tcp:35:touch.500 00000100:00100000:1.0:1790945908.393121:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+13:10475:x1877942616480640:12345-192.168.204.20@tcp:35:touch.500 Request processed in 322us (687us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1790945908.393130:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2 00000100:00100000:2.0:1790945908.430508:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945908.432271:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616480768 00000100:00100000:0.0:1790945908.432288:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616480768 00000100:00100000:0.0:1790945908.432366:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 33 00000100:00100000:0.0:1790945908.432377:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4ceca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+13:10476:x1877942616480768:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:0.0:1790945908.432403:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945908.432422:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27d352 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330abf expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.432492:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27d359 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.432507:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27d359 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.432520:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27d359 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945908.432580:0:6521:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790945908.432585:0:6521:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790945908.432628:0:6521:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27d359 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.432655:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27d352 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330abf expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.432690:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27d359 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330abf expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.432719:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d40bc9afe00) 00010000:00010000:0.0:1790945908.432722:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790945908.432726:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe1800, rc 0) 00000100:00100000:0.0:1790945908.432806:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4ceca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+14:10476:x1877942616480768:12345-192.168.204.20@tcp:101:rm.0 Request processed in 430us (2309us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945908.432814:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 33 00000100:00100000:2.0:1790945908.443301:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945908.443908:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616481024 00000100:00100000:3.0:1790945908.443918:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616481024 00000100:00100000:3.0:1790945908.443993:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 34 00000100:00100000:3.0:1790945908.444004:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4cec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+14:10476:x1877942616481024:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:3.0:1790945908.444025:0:8457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945908.444048:0:8457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d360 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330ac6 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945908.444152:0:8457:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1790945908.448411:0:8457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d360 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ac6 expref: 16 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945908.448508:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d40bc9af900) 00010000:00010000:2.0:1790945908.448512:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790945908.448519:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d360 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ac6 expref: 16 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945908.448536:0:8457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4080031800, rc 0) 00000100:00100000:2.0:1790945908.448722:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4cec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+15:10476:x1877942616481024:12345-192.168.204.20@tcp:101:rm.0 Request processed in 4718us (5429us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1790945908.448731:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 34 00000100:00100000:3.0:1790945908.451647:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945908.451891:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616481152 00000100:00100000:0.0:1790945908.451901:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616481152 00000100:00100000:0.0:1790945908.451958:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 3 00000100:00100000:0.0:1790945908.451968:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+15:10476:x1877942616481152:12345-192.168.204.20@tcp:37:rm.0 00000100:00100000:3.0:1790945908.460945:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+15:10476:x1877942616481152:12345-192.168.204.20@tcp:37:rm.0 Request processed in 8967us (9297us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945908.460959:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 3 00000100:00100000:2.0:1790945908.465831:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945908.465993:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616481408 00000100:00100000:1.0:1790945908.466004:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616481408 00000100:00100000:1.0:1790945908.466096:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4 00000100:00100000:1.0:1790945908.466107:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4096dda050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+15:10476:x1877942616481408:12345-192.168.204.20@tcp:35:rm.0 00000100:00100000:1.0:1790945908.466411:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4096dda050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+16:10476:x1877942616481408:12345-192.168.204.20@tcp:35:rm.0 Request processed in 306us (591us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1790945908.466420:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4 00000100:00100000:2.0:1790945908.469514:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945908.469593:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616481664 00000100:00100000:0.0:1790945908.469603:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616481664 00000100:00100000:0.0:1790945908.469692:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 35 00000100:00100000:0.0:1790945908.469702:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+16:10476:x1877942616481664:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:0.0:1790945908.469724:0:13005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945908.469743:0:13005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27d36e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330acd expref: -99 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.469881:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d375 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.469898:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d375 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.469909:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d375 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945908.469939:0:13005:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1790945908.470047:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27d36e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330acd expref: 19 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.470068:0:13005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d375 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330acd expref: 18 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945908.470078:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d40bc9afe00) 00010000:00010000:0.0:1790945908.470081:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790945908.470086:0:13005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe0400, rc 0) 00000100:00100000:0.0:1790945908.470152:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+18:10476:x1877942616481664:12345-192.168.204.20@tcp:101:rm.0 Request processed in 452us (647us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1790945908.470160:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 35 00000100:00100000:0.0:1790945908.474774:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945908.474951:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616481792 00000100:00100000:3.0:1790945908.474961:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616481792 00000100:00100000:3.0:1790945908.475021:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 36 00000100:00100000:3.0:1790945908.475031:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40accd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+18:10476:x1877942616481792:12345-192.168.204.20@tcp:41:rm.0 00000004:00000024:3.0:1790945908.475084:0:6521:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:3.0:1790945908.475215:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40accd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+18:10476:x1877942616481792:12345-192.168.204.20@tcp:41:rm.0 Request processed in 186us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945908.475223:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 36 00000100:00100000:1.0:1790945908.478120:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945908.478212:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616481920 00000100:00100000:2.0:1790945908.478222:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616481920 00000100:00100000:2.0:1790945908.478290:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 37 00000100:00100000:2.0:1790945908.478299:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+18:10476:x1877942616481920:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:2.0:1790945908.478326:0:8457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945908.478347:0:8457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d383 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330ad4 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945908.478411:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d38a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945908.478426:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d38a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945908.478437:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d38a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945908.478464:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363dc00/0xd9f4181e0d27d391 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x30bd2b02 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945908.478474:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363dc00/0xd9f4181e0d27d391 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x30bd2b02 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945908.478480:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363dc00/0xd9f4181e0d27d391 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x30bd2b02 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945908.478565:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27d398 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945908.478574:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27d398 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945908.478582:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27d398 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945908.478617:0:8457:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:2.0:1790945908.478621:0:8457:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790945908.478637:0:8457:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27d398 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945908.478649:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27d398 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945908.478656:0:8457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d38a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945908.478677:0:8457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d38a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945908.478694:0:8457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d38a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945908.478699:0:8457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f8363c000 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945908.478703:0:8457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d38a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945908.478711:0:8457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d38a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945908.478722:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d40bc9afe00) 00010000:00010000:2.0:1790945908.478725:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945908.478729:0:8457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d38a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945908.478736:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d38a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945908.478750:0:8457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363dc00/0xd9f4181e0d27d391 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x30bd2b02 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945908.478755:0:8457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363dc00/0xd9f4181e0d27d391 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x30bd2b02 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945908.478760:0:8457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363dc00/0xd9f4181e0d27d391 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x30bd2b02 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945908.478765:0:8457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f8363dc00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945908.478768:0:8457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363dc00/0xd9f4181e0d27d391 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x30bd2b02 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945908.478783:0:8457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363dc00/0xd9f4181e0d27d391 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x30bd2b02 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945908.478791:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x30bd2b02 (ffff9d40bc9af400) 00010000:00010000:2.0:1790945908.478794:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945908.478797:0:8457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363dc00/0xd9f4181e0d27d391 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x30bd2b02 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945908.478803:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363dc00/0xd9f4181e0d27d391 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x30bd2b02 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945908.479011:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d383 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ad4 expref: 20 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945908.479024:0:8457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27d398 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ad4 expref: 19 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945908.479031:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9d408a8d4600) 00010000:00010000:2.0:1790945908.479033:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790945908.479036:0:8457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f8363c200, rc 0) 00000100:00100000:2.0:1790945908.479142:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+19:10476:x1877942616481920:12345-192.168.204.20@tcp:101:rm.0 Request processed in 843us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945908.479150:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 37 00000100:00100000:2.0:1790945908.482205:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945908.482285:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616482176 00000100:00100000:3.0:1790945908.482295:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616482176 00000100:00100000:3.0:1790945908.482355:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 38 00000100:00100000:3.0:1790945908.482364:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+19:10476:x1877942616482176:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:3.0:1790945908.482424:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1790945908.482450:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27d398 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ad4 expref: 19 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.482472:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27d344 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ab8 expref: 18 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.482483:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9d408a8d4600) 00010000:00010000:3.0:1790945908.482491:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27d359 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330abf expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.482499:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d40bc9afe00) 00010000:00010000:3.0:1790945908.482502:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790945908.482522:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27d39f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.482534:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27d39f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.482543:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27d39f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.482576:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030200/0xd9f4181e0d27d3a6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x30bd2b02 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.482584:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030200/0xd9f4181e0d27d3a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x30bd2b02 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.482590:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030200/0xd9f4181e0d27d3a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x30bd2b02 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.482734:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d3ad lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.482744:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d3ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.482750:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d3ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790945908.482958:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1790945908.482968:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 359298799463ns, next at 360298796855ns, rc = 0 00010000:00010000:3.0:1790945908.483028:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d3b4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.483038:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d3b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.483046:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d3b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.483052:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d3b4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.483067:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d3b4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.483074:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d3b4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.486328:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790945908.486371:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d3ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.486383:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d3ad lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.486391:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d3ad lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.486397:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080031800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945908.486402:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d3ad lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.486409:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d3ad lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.486428:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9d408a8d4600) 00010000:00010000:3.0:1790945908.486432:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1790945908.486436:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d3ad lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.486442:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d3ad lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.486471:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27d39f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.486494:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27d39f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.486500:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27d39f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.486506:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080030a00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945908.486509:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27d39f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.486515:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27d39f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.486523:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d40bc9afe00) 00010000:00010000:3.0:1790945908.486525:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945908.486528:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27d39f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.486534:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27d39f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790945908.486544:0:6522:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000089ee5455 reply state 0000000063536c66 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030200/0xd9f4181e0d27d3a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x30bd2b02 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.486555:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030200/0xd9f4181e0d27d3a6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x30bd2b02 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945908.486561:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x30bd2b02 (ffff9d40bc9af400) 00010000:00010000:3.0:1790945908.486563:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790945908.486566:0:6522:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790945908.486673:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+18:10476:x1877942616482176:12345-192.168.204.20@tcp:36:rm.0 Request processed in 4294us (4492us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1790945908.486689:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 38 00010000:00010000:1.0:1790945908.489459:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790945908.489473:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d3b4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945908.489483:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40813fe800 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:1.0:1790945908.489487:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d3b4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945908.489495:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d3b4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945908.489531:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9d408a8d4600) 00010000:00010000:1.0:1790945908.489534:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790945908.489540:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d3b4 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945908.489545:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d3b4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945908.489560:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945908.489562:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945908.489563:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945908.489822:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945908.489896:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616482432 00000100:00100000:3.0:1790945908.489906:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616482432 00000100:00100000:3.0:1790945908.489958:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00100000:3.0:1790945908.489968:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40accd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+18:10476:x1877942616482432:12345-192.168.204.20@tcp:35:rm.0 00000100:00100000:3.0:1790945908.490203:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40accd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+19:10476:x1877942616482432:12345-192.168.204.20@tcp:35:rm.0 Request processed in 235us (383us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1790945908.490212:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00100000:0.0:1790945908.495369:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945908.495642:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616482688 00000100:00100000:1.0:1790945908.495653:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616482688 00000100:00100000:1.0:1790945908.495724:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 39 00000100:00100000:1.0:1790945908.495734:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40accd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+19:10476:x1877942616482688:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:1.0:1790945908.495791:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1790945908.495818:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d375 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330acd expref: 19 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945908.495840:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4da00/0xd9f4181e0d27d313 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330aaa expref: 18 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945908.495851:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d40bc9afe00) 00010000:00010000:1.0:1790945908.495865:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4086a4dc00/0xd9f4181e0d27d2d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a9c expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945908.495872:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d40bc9af900) 00010000:00010000:1.0:1790945908.495893:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790945908.495917:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6200/0xd9f4181e0d27d3bb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945908.495931:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6200/0xd9f4181e0d27d3bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945908.495941:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6200/0xd9f4181e0d27d3bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945908.495952:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27d3c2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945908.495959:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27d3c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945908.495964:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27d3c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945908.496036:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d7c00/0xd9f4181e0d27d3c9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945908.496044:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d7c00/0xd9f4181e0d27d3c9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945908.496051:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d7c00/0xd9f4181e0d27d3c9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790945908.496684:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1790945908.496701:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d7c00/0xd9f4181e0d27d3c9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945908.496710:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d7c00/0xd9f4181e0d27d3c9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945908.496722:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d7c00/0xd9f4181e0d27d3c9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945908.496728:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d7c00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:1.0:1790945908.496732:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d7c00/0xd9f4181e0d27d3c9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945908.496753:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d7c00/0xd9f4181e0d27d3c9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945908.496764:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d40928bd400) 00010000:00010000:1.0:1790945908.496767:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1790945908.496770:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d7c00/0xd9f4181e0d27d3c9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945908.496777:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d7c00/0xd9f4181e0d27d3c9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945908.496799:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6200/0xd9f4181e0d27d3bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945908.496805:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6200/0xd9f4181e0d27d3bb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945908.496810:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6200/0xd9f4181e0d27d3bb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945908.496815:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d6200 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:1.0:1790945908.496817:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6200/0xd9f4181e0d27d3bb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945908.496832:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6200/0xd9f4181e0d27d3bb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945908.496840:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d40928bda00) 00010000:00010000:1.0:1790945908.496843:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945908.496846:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6200/0xd9f4181e0d27d3bb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945908.496852:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6200/0xd9f4181e0d27d3bb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790945908.496863:0:6523:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ea0ea839 reply state 00000000144b9d05 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27d3c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945908.496873:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27d3c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945908.496879:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9d40928bd600) 00010000:00010000:1.0:1790945908.496882:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790945908.496884:0:6523:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790945908.496969:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40accd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+18:10476:x1877942616482688:12345-192.168.204.20@tcp:36:rm.0 Request processed in 1236us (1608us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1790945908.496977:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 39 00010000:00010000:0.0:1790945909.215381:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1790945909.599361:0:8915:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 360415189476ns, next at 361415186460ns, rc = 0 00000100:00100000:0.0:1790945909.599382:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638584448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790945909.599426:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83def100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638584576:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790945909.599453:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945909.599496:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945909.599581:0:11925:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638584448 00000100:00100000:2.0:1790945909.599589:0:11925:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638584448 00000100:00100000:2.0:1790945909.599663:0:11925:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638584576 00000100:00100000:2.0:1790945909.599667:0:11925:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638584576 00000100:00100000:2.0:1790945909.599695:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1790945909.599703:0:11925:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40accd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638584448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790945909.599723:0:11925:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790945909.599768:0:11925:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40accd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638584448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945909.599775:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1790945909.599794:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1790945909.599801:0:11925:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638584576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790945909.599810:0:11925:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790945909.599834:0:11925:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638584576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 35us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945909.599841:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:0.0:1790945909.599891:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790945909.599920:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcbbc000 x1877942638584448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945925 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1790945909.599935:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f83def100 x1877942638584576/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945925 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945909.599939:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638584448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790945909.599970:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83def100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638584576:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1790945910.239330:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945911.138354:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790945911.138377:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83dee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638584704:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790945911.138447:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945911.138510:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638584704 00000100:00100000:2.0:1790945911.138519:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638584704 00000100:00100000:2.0:1790945911.138568:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1790945911.138577:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83dee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638584704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790945911.140516:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1790945911.140630:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83dee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638584704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2050us (2178us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945911.140642:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1790945911.140726:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83dee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638584704:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1790945911.263544:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945911.367267:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945911.367339:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945911.367376:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945911.367405:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945911.367423:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945911.367447:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945911.367472:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616483200 00000100:00100000:0.0:1790945911.367481:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616483200 00000100:00100000:0.0:1790945911.367536:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 81 00000100:00100000:0.0:1790945911.367545:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2404:x1877942616483200:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945911.367593:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616483072 00000100:00100000:1.0:1790945911.367599:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616483072 00000100:00100000:0.0:1790945911.367647:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2404:x1877942616483200:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 102us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945911.367654:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616483328 00000100:00100000:0.0:1790945911.367656:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 81 00000100:00100000:1.0:1790945911.367660:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616483328 00000100:00080000:0.0:1790945911.367684:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790945911.367689:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790945911.367691:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616482944 00000100:00080000:0.0:1790945911.367692:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790945911.367741:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616482816 00000100:00100000:2.0:1790945911.367747:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616482816 00000100:00100000:2.0:1790945911.367798:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 335 00000100:00100000:1.0:1790945911.367818:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616482944 00000100:00100000:2.0:1790945911.367859:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:2404:x1877942616482816:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790945911.368006:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:2404:x1877942616482816:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 201us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945911.368019:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 335 00000100:00100000:3.0:1790945911.379237:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616483456 00000100:00100000:3.0:1790945911.379254:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616483456 00000100:00100000:0.0:1790945911.379268:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 203 00000100:00100000:0.0:1790945911.379284:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2404:x1877942616483072:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945911.379377:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 204 00000100:00100000:0.0:1790945911.379382:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2404:x1877942616483072:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 100us (12041us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945911.379391:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 205 00000100:00100000:1.0:1790945911.379396:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2404:x1877942616483328:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790945911.379403:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 203 00000100:00100000:2.0:1790945911.379421:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+18:2404:x1877942616482944:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945911.379509:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2404:x1877942616483328:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 51us (12061us total) trans 0 rc 0/0 00000100:00080000:0.0:1790945911.379518:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790945911.379523:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790945911.379528:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 204 00000100:00100000:0.0:1790945911.379538:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 206 00000100:00100000:0.0:1790945911.379546:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2404:x1877942616483456:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790945911.379589:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+18:2404:x1877942616482944:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 185us (12181us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945911.379597:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2404:x1877942616483456:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 50us (12146us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945911.379600:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 205 00000100:00100000:0.0:1790945911.379673:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 206 00000100:00100000:3.0:1790945911.647441:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790945911.647467:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638584832:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790945911.647550:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945911.647659:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638584832 00000100:00100000:3.0:1790945911.647666:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638584832 00000100:00100000:3.0:1790945911.647717:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1790945911.647727:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638584832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790945911.647766:0:6526:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790945911.647814:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638584832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945911.647821:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1790945911.647863:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638584832:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1790945912.241750:0:13686:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1790945912.288308:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945912.671360:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790945912.671384:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83dee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638584960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790945912.671457:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945912.671529:0:11925:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638584960 00000100:00100000:2.0:1790945912.671538:0:11925:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638584960 00000100:00100000:2.0:1790945912.671612:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1790945912.671634:0:11925:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83dec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638584960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790945912.671666:0:11925:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790945912.671711:0:11925:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83dec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638584960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945912.671717:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:2.0:1790945912.671762:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f83dee300 x1877942638584960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945928 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945912.671782:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83dee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638584960:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1790945912.671817:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790945912.672266:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877942638585344:0@lo:400:kworker.0 00000100:00100000:1.0:1790945912.672323:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945912.672346:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1877942638585856:0@lo:400:kworker.0 00000100:00100000:1.0:1790945912.672385:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945912.672403:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f835eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1877942638586368:0@lo:400:kworker.0 00000100:00100000:1.0:1790945912.672421:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945912.672436:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1790945912.672440:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8841fcfb-fb47-4307-92c2-97500c1c82bd:3648:1877942638585216:0@lo:400:kworker.0 00000100:00100000:1.0:1790945912.672463:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945912.672502:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638585728:0@lo:400:kworker.0 00000100:00100000:1.0:1790945912.672539:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945912.672565:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f835e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638586240:0@lo:400:kworker.0 00000100:00100000:1.0:1790945912.672601:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945912.672630:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638585344 00000100:00100000:1.0:1790945912.672635:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638585344 00000100:00100000:1.0:1790945912.672686:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638585856 00000100:00100000:1.0:1790945912.672689:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638585856 00000100:00100000:1.0:1790945912.672711:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638586368 00000100:00100000:1.0:1790945912.672714:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638586368 00000100:00100000:1.0:1790945912.672728:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1790945912.672734:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1877942638585344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945912.672782:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1877942638585344:12345-0@lo:400:kworker.0 Request processed in 48us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945912.672789:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1790945912.672803:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1790945912.672809:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4081325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1877942638585856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945912.672835:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4081325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1877942638585856:12345-0@lo:400:kworker.0 Request processed in 27us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945912.672841:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1790945912.672852:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1790945912.672858:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4081326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1877942638586368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945912.672884:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4081326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1877942638586368:12345-0@lo:400:kworker.0 Request processed in 27us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945912.672889:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1790945912.672907:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638585216 00000100:00100000:2.0:1790945912.672908:0:12418:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638585728 00000100:00100000:1.0:1790945912.672910:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638585216 00000100:00100000:2.0:1790945912.672911:0:12418:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638585728 00000100:00100000:2.0:1790945912.672942:0:12418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1790945912.672948:0:12418:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4081324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638585728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945912.672955:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1790945912.672960:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087032450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3648:x1877942638585216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945912.672993:0:12418:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4081324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638585728:12345-0@lo:400:kworker.0 Request processed in 34us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945912.672995:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087032450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3648:x1877942638585216:12345-0@lo:400:kworker.0 Request processed in 35us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945912.673000:0:12418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1790945912.673000:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1790945912.673019:0:8436:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638586240 00000100:00100000:2.0:1790945912.673022:0:8436:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638586240 00000100:00100000:1.0:1790945912.673030:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638585472:0@lo:400:kworker.0 00000100:00100000:2.0:1790945912.673049:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1790945912.673053:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945912.673055:0:8436:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4081325500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638586240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945912.673070:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1877942638585984:0@lo:400:kworker.0 00000100:00100000:2.0:1790945912.673082:0:8436:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4081325500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638586240:12345-0@lo:400:kworker.0 Request processed in 28us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945912.673087:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945912.673088:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1790945912.673101:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f835eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1877942638586496:0@lo:400:kworker.0 00000100:00100000:2.0:1790945912.673104:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638585472 00000100:00100000:2.0:1790945912.673107:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638585472 00000100:00100000:1.0:1790945912.673120:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945912.673126:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1790945912.673131:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4081326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638585472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945912.673135:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1790945912.673140:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638585088:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790945912.673159:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4081326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638585472:12345-0@lo:400:kworker.0 Request processed in 28us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945912.673160:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945912.673183:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1790945912.673194:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638585600:0@lo:400:kworker.0 00000100:00100000:2.0:1790945912.673208:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638585984 00000100:00100000:2.0:1790945912.673212:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638585984 00000100:00100000:1.0:1790945912.673214:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945912.673229:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f835e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638586112:0@lo:400:kworker.0 00000100:00100000:2.0:1790945912.673232:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638586496 00000100:00100000:2.0:1790945912.673234:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638586496 00000100:00100000:1.0:1790945912.673249:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945912.673250:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638585600 00000100:00100000:2.0:1790945912.673252:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638585600 00000100:00100000:2.0:1790945912.673265:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1790945912.673265:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f835e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638586624:0@lo:400:kworker.0 00000100:00100000:2.0:1790945912.673271:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4081324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877942638585984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945912.673282:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945912.673303:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4081324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877942638585984:12345-0@lo:400:kworker.0 Request processed in 33us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945912.673306:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638585472:0@lo:400:kworker.0 00000100:00100000:2.0:1790945912.673309:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00010000:00080000:1.0:1790945912.673315:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bff72a00 x1877942638585984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945912.673320:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1790945912.673326:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4081327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877942638586496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945912.673326:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1877942638585984:0@lo:400:kworker.0 00000100:00100000:1.0:1790945912.673352:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638585088 00000100:00100000:2.0:1790945912.673357:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4081327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877942638586496:12345-0@lo:400:kworker.0 Request processed in 31us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945912.673360:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638585088 00000100:00100000:2.0:1790945912.673362:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1790945912.673373:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1790945912.673378:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4081326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638585600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945912.673400:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1790945912.673403:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4081326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638585600:12345-0@lo:400:kworker.0 Request processed in 25us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945912.673406:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4081326300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638585088:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790945912.673409:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00002000:00000024:1.0:1790945912.673420:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1790945912.673426:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790945912.673430:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790945912.673432:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790945912.673434:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790945912.673448:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4081326300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638585088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945912.673453:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1790945912.673466:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638586112 00000100:00100000:1.0:1790945912.673468:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638586624 00000100:00100000:2.0:1790945912.673469:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638586112 00000100:00100000:1.0:1790945912.673471:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638586624 00000100:00100000:1.0:1790945912.673489:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1790945912.673492:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1790945912.673494:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4081327800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638586624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945912.673497:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4081324380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638586112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945912.673522:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4081324380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638586112:12345-0@lo:400:kworker.0 Request processed in 24us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945912.673522:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4081327800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638586624:12345-0@lo:400:kworker.0 Request processed in 28us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945912.673528:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1790945912.673542:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790945912.673561:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8841fcfb-fb47-4307-92c2-97500c1c82bd:3648:1877942638585216:0@lo:400:kworker.0 00000100:00100000:2.0:1790945912.673594:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638585728:0@lo:400:kworker.0 00010000:00080000:2.0:1790945912.673605:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f835e8000 x1877942638586240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945912.673614:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f835e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638586240:0@lo:400:kworker.0 00000100:00100000:2.0:1790945912.673624:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877942638585344:0@lo:400:kworker.0 00000100:00100000:2.0:1790945912.673634:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1877942638585856:0@lo:400:kworker.0 00000100:00100000:2.0:1790945912.673642:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f835eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1877942638586368:0@lo:400:kworker.0 00000100:00100000:1.0:1790945912.673829:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:1.0:1790945912.673857:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f8265f100 x1877942638585088/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945928 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945912.673871:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638585088:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790945912.673881:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638585600:0@lo:400:kworker.0 00010000:00080000:1.0:1790945912.673889:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f835e8380 x1877942638586112/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945912.673897:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f835e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638586112:0@lo:400:kworker.0 00010000:00080000:1.0:1790945912.673905:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f835e8e00 x1877942638586624/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945912.673911:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f835e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638586624:0@lo:400:kworker.0 00010000:00080000:1.0:1790945912.673930:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f835eb480 x1877942638586496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945912.673938:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f835eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1877942638586496:0@lo:400:kworker.0 00010000:00010000:0.0:1790945913.311512:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790945913.480154:0:13735:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe7cfb38b0 20000000:00000080:1.0:1790945913.480487:0:13735:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d3f83da5800 uarg=0000000000000000 20000000:01000000:1.0:1790945913.480526:0:13735:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1790945913.480531:0:13735:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1790945913.480536:0:13735:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1790945913.481097:0:13736:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1790945913.481387:0:13735:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1790945913.488029:0:13735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1790945913.489882:0:13735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1790945913.489919:0:13735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1790945913.489937:0:13735:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1790945913.489956:0:13735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d40bcbe0400/0xd9f4181e0d27d3d0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945913.489975:0:13735:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d4086a4c200/0xd9f4181e0d27d25d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a87 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945913.489984:0:13735:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d4086a4ce00/0xd9f4181e0d27d264 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a8e expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945913.489991:0:13735:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40c21d6000/0xd9f4181e0d27d272 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d26b expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945913.489999:0:13735:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40813fea00/0xd9f4181e0d27d280 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d279 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945913.490005:0:13735:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d4086a4d000/0xd9f4181e0d27d28e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d287 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945913.490011:0:13735:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3f8363da00/0xd9f4181e0d27d29c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d295 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945913.490018:0:13735:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d40bcbe0400/0xd9f4181e0d27d3d0 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945913.490124:0:13735:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3f8363da00/0xd9f4181e0d27d29c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27d295 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945913.490139:0:13735:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d3f8363da00/0xd9f4181e0d27d29c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27d295 expref: 23 pid: 6515 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945913.490155:0:13735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83c37100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1877942638586752:0@lo:104: 00000100:00100000:0.0:1790945913.490310:0:13735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1790945913.490347:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:1.0:1790945913.490384:0:6500:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:1.0:1790945913.490394:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:0.0:1790945913.490416:0:13735:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d4086a4d000/0xd9f4181e0d27d28e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27d287 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945913.490427:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27d328 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x30bd2b02 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945913.490428:0:13735:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d4086a4d000/0xd9f4181e0d27d28e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27d287 expref: 23 pid: 6516 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945913.490445:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27d328 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x30bd2b02 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945913.490449:0:13735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83c36300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1877942638586880:0@lo:104: 00010000:00010000:1.0:1790945913.490458:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27d328 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x30bd2b02 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945913.490465:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0e00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:1.0:1790945913.490470:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27d328 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x30bd2b02 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945913.490478:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27d328 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x30bd2b02 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945913.490485:0:13735:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40813fea00/0xd9f4181e0d27d280 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27d279 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945913.490494:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x30bd2b02 (ffff9d40bc9af400) 00010000:00010000:0.0:1790945913.490495:0:13735:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40813fea00/0xd9f4181e0d27d280 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27d279 expref: 23 pid: 6516 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945913.490506:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790945913.490510:0:13735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83c36680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1877942638587008:0@lo:104: 00010000:00010000:1.0:1790945913.490512:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27d328 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x30bd2b02 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945913.490521:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27d328 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x30bd2b02 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945913.490542:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d33d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945913.490543:0:13735:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40c21d6000/0xd9f4181e0d27d272 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27d26b expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945913.490557:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d33d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945913.490574:0:13735:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40c21d6000/0xd9f4181e0d27d272 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27d26b expref: 23 pid: 6514 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945913.490580:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d33d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945913.490589:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080031400 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:1.0:1790945913.490593:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d33d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945913.490599:0:13735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83c34380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1877942638587136:0@lo:104: 00010000:00010000:1.0:1790945913.490600:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d33d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945913.490607:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9d408a8d4600) 00010000:00010000:1.0:1790945913.490612:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945913.490614:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d33d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945913.490621:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d33d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945913.490638:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030200/0xd9f4181e0d27d3a6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x30bd2b02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945913.490643:0:13735:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d4086a4ce00/0xd9f4181e0d27d264 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a8e expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945913.490659:0:13735:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d4086a4ce00/0xd9f4181e0d27d264 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a8e expref: 12 pid: 6515 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945913.490661:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030200/0xd9f4181e0d27d3a6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x30bd2b02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945913.490678:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030200/0xd9f4181e0d27d3a6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x30bd2b02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945913.490682:0:13735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83c37800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1877942638587264:192.168.204.20@tcp:104: 00010000:00010000:1.0:1790945913.490685:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080030200 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945913.490741:0:13735:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d4086a4c200/0xd9f4181e0d27d25d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a87 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945913.490750:0:13735:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d4086a4c200/0xd9f4181e0d27d25d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a87 expref: 12 pid: 6516 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945913.490759:0:13735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83c34e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1877942638587392:192.168.204.20@tcp:104: 00000100:00100000:0.0:1790945913.490782:0:13735:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f825a9e40 going to sleep for 11 seconds 00010000:00010000:1.0:1790945913.490868:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030200/0xd9f4181e0d27d3a6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x30bd2b02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945913.490875:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030200/0xd9f4181e0d27d3a6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x30bd2b02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945913.490883:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x30bd2b02 (ffff9d40bc9af400) 00010000:00010000:1.0:1790945913.490949:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945913.490954:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030200/0xd9f4181e0d27d3a6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x30bd2b02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945913.490960:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030200/0xd9f4181e0d27d3a6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x30bd2b02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945913.490978:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27d3c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945913.490984:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27d3c2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945913.490990:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27d3c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945913.490995:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d6800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:1.0:1790945913.491206:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27d3c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945913.491214:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27d3c2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945913.491222:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9d40928bd600) 00010000:00010000:1.0:1790945913.491225:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945913.491228:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27d3c2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945913.491232:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27d3c2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945913.491575:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790945913.491599:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638587520:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1790945913.491637:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945913.491780:0:10099:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638587520 00000100:00100000:1.0:1790945913.491789:0:10099:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638587520 00000100:00100000:1.0:1790945913.492757:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790945913.492772:0:10099:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408aa8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638587520:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1790945913.492803:0:10099:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00000100:00100000:0.0:1790945913.494876:0:13735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83c37800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1877942638587264:192.168.204.20@tcp:104: 00000100:00100000:0.0:1790945913.494892:0:13735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83c34e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1877942638587392:192.168.204.20@tcp:104: 00000100:00100000:3.0:1790945913.495548:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945913.495777:0:6505:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790945913.495806:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945913.495830:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945913.495839:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945913.495907:0:6505:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638586752 00000100:00100000:2.0:1790945913.495916:0:6505:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638586752 00000100:00100000:2.0:1790945913.495958:0:6505:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638586880 00000100:00100000:2.0:1790945913.495961:0:6505:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638586880 00000100:00100000:2.0:1790945913.495971:0:6505:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638587008 00000100:00100000:2.0:1790945913.495973:0:6505:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638587008 00000100:00100000:2.0:1790945913.495981:0:6505:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638587136 00000100:00100000:2.0:1790945913.495983:0:6505:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638587136 00000100:00100000:2.0:1790945913.495995:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790945913.496002:0:6505:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bca14850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+6:13735:x1877942638586752:12345-0@lo:104: 00010000:00010000:2.0:1790945913.496017:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d600/0xd9f4181e0d27d295 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27d29c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945913.496075:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790945913.496081:0:6505:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bca14850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+6:13735:x1877942638586752:12345-0@lo:104: Request processed in 80us (5773us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945913.496097:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790945913.496136:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790945913.496142:0:6505:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83dee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+5:13735:x1877942638586880:12345-0@lo:104: 00010000:00010000:2.0:1790945913.496150:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d3f8363d200/0xd9f4181e0d27d287 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27d28e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790945913.496240:0:10099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6abfaa74, atime: 0x6abfaa74, ctime: 0x6abfaa74, blocks: 0x0 00010000:00010000:1.0:1790945913.496249:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be4eb9a9/0xd9f4181e0d27d3d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945913.496265:0:10099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=364s v=(0 0) 00010000:00010000:1.0:1790945913.496269:0:10099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945913.496276:0:10099:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be4eb9a9/0xd9f4181e0d27d3d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945913.496292:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be4eb9a9/0xd9f4181e0d27d3d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945913.496315:0:10099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be4eb9a9/0xd9f4181e0d27d3d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945913.496321:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1790945913.496322:0:10099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be4eb9a9/0xd9f4181e0d27d3d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945913.496330:0:6505:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83dee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+5:13735:x1877942638586880:12345-0@lo:104: Request processed in 186us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945913.496338:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:1.0:1790945913.496344:0:10099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1790945913.496354:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790945913.496361:0:6505:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83def800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+4:13735:x1877942638587008:12345-0@lo:104: 00010000:00010000:2.0:1790945913.496369:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d3f8363de00/0xd9f4181e0d27d279 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27d280 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945913.496400:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1790945913.496406:0:6505:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83def800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+4:13735:x1877942638587008:12345-0@lo:104: Request processed in 46us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945913.496411:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790945913.496425:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790945913.496432:0:6505:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83dece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+3:13735:x1877942638587136:12345-0@lo:104: 00010000:00010000:2.0:1790945913.496440:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d40813ff800/0xd9f4181e0d27d26b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27d272 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945913.496470:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1790945913.496475:0:6505:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83dece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8841fcfb-fb47-4307-92c2-97500c1c82bd+3:13735:x1877942638587136:12345-0@lo:104: Request processed in 44us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945913.496487:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:2.0:1790945913.496507:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00000100:00100000:1.0:1790945913.496513:0:10099:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408aa8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3648:x1877942638587520:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3745us (4873us total) trans 4294967301 rc 0/0 00010000:00010000:2.0:1790945913.496514:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d600/0xd9f4181e0d27d295 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27d29c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945913.496528:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4086a4d600 already unused, calling callback (ffffffffc137ac20) 00000100:00100000:1.0:1790945913.496529:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 10000000:00010000:2.0:1790945913.496533:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d600/0xd9f4181e0d27d295 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27d29c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945913.496543:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d600/0xd9f4181e0d27d295 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27d29c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790945913.496551:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d600/0xd9f4181e0d27d295 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27d29c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945913.496555:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 10000000:01000000:2.0:1790945913.496557:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790945913.496576:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d3f8363d200/0xd9f4181e0d27d287 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27d28e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945913.496586:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f8363d200 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:1.0:1790945913.496589:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d3f8363d200/0xd9f4181e0d27d287 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27d28e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945913.496596:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d3f8363d200/0xd9f4181e0d27d287 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27d28e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790945913.496603:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d3f8363d200/0xd9f4181e0d27d287 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27d28e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945913.496608:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790945913.496632:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d3f8363d200/0xd9f4181e0d27d287 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d28e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945913.496647:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790945913.496665:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d3f8363d200/0xd9f4181e0d27d287 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d28e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945913.496673:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d3f8363d200/0xd9f4181e0d27d287 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d28e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945913.496685:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790945913.496726:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d600/0xd9f4181e0d27d295 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d29c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945913.496733:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790945913.496758:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d600/0xd9f4181e0d27d295 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d29c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945913.496764:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d4086a4d600/0xd9f4181e0d27d295 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d29c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945913.496774:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790945913.496777:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d3f8363de00/0xd9f4181e0d27d279 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27d280 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945913.496793:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f8363de00 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:2.0:1790945913.496796:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d3f8363de00/0xd9f4181e0d27d279 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27d280 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945913.496803:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d3f8363de00/0xd9f4181e0d27d279 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27d280 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790945913.496810:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d3f8363de00/0xd9f4181e0d27d279 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27d280 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945913.496815:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790945913.496830:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d3f8363de00/0xd9f4181e0d27d279 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d280 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945913.496836:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790945913.496842:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d3f8363de00/0xd9f4181e0d27d279 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d280 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945913.496849:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d3f8363de00/0xd9f4181e0d27d279 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d280 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945913.496857:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790945913.496860:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40813ff800/0xd9f4181e0d27d26b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27d272 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945913.496866:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40813ff800 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:2.0:1790945913.496869:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40813ff800/0xd9f4181e0d27d26b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27d272 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945913.496885:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40813ff800/0xd9f4181e0d27d26b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27d272 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790945913.496891:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40813ff800/0xd9f4181e0d27d26b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27d272 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945913.496897:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790945913.496909:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40813ff800/0xd9f4181e0d27d26b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d272 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945913.496915:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790945913.496921:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40813ff800/0xd9f4181e0d27d26b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d272 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945913.496928:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40813ff800/0xd9f4181e0d27d26b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27d272 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945913.496940:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945913.496942:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945913.496944:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945913.496949:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945913.496960:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638587904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790945913.497009:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945913.497041:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790945913.497047:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83ded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638587776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790945913.497065:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945913.497090:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616483712 00000100:00100000:2.0:1790945913.497096:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616483712 00010000:00010000:2.0:1790945913.497119:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d4086a4c200/0xd9f4181e0d27d25d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a87 expref: 13 pid: 6516 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945913.497145:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638587904 00000100:00100000:2.0:1790945913.497148:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638587904 00010000:00010000:2.0:1790945913.497161:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40813fea00/0xd9f4181e0d27d280 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27d279 expref: 24 pid: 6516 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945913.497365:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638587776 00000100:00100000:0.0:1790945913.497370:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638587776 00010000:00010000:0.0:1790945913.497385:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3f8363da00/0xd9f4181e0d27d29c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27d295 expref: 25 pid: 6515 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945913.497401:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 46 00000100:00100000:0.0:1790945913.497408:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408aa8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:2401:x1877942616483712:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790945913.497418:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945913.497423:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d4086a4c200/0xd9f4181e0d27d25d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a87 expref: 13 pid: 6516 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945913.497444:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d4086a4c200/0xd9f4181e0d27d25d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a87 expref: 13 pid: 6516 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945913.497458:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d4086a4c200/0xd9f4181e0d27d25d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a87 expref: 13 pid: 6516 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945913.497471:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945913.497512:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408aa8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+12:2401:x1877942616483712:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 104us (1965us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945913.497518:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 46 00000100:00100000:0.0:1790945913.497534:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790945913.497541:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8841fcfb-fb47-4307-92c2-97500c1c82bd+25:3650:x1877942638587776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790945913.497549:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945913.497553:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3f8363da00/0xd9f4181e0d27d29c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27d295 expref: 25 pid: 6515 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945913.497573:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3f8363da00/0xd9f4181e0d27d29c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27d295 expref: 25 pid: 6515 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945913.497583:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945913.497625:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8841fcfb-fb47-4307-92c2-97500c1c82bd+25:3650:x1877942638587776:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945913.497631:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:0.0:1790945913.497672:0:13735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3f8363da00/0xd9f4181e0d27d29c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27d295 expref: 24 pid: 6515 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945913.497681:0:13735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83c37100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1877942638586752:0@lo:104: 00000100:00100000:0.0:1790945913.497703:0:13735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83c36300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1877942638586880:0@lo:104: 00000100:00100000:0.0:1790945913.497710:0:13735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83c36680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1877942638587008:0@lo:104: 00000100:00100000:0.0:1790945913.497718:0:13735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83c34380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1877942638587136:0@lo:104: 00010000:00010000:0.0:1790945913.497741:0:13735:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d40bcbe0400/0xd9f4181e0d27d3d0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945913.497976:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945913.498069:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616483584 00000100:00100000:3.0:1790945913.498073:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616483584 00010000:00010000:3.0:1790945913.498091:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d4086a4ce00/0xd9f4181e0d27d264 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a8e expref: 12 pid: 6515 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945913.498106:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 48 00000100:00100000:3.0:1790945913.498113:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408aa8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+12:2402:x1877942616483584:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790945913.498120:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945913.498124:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d4086a4ce00/0xd9f4181e0d27d264 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a8e expref: 12 pid: 6515 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945913.498132:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d4086a4ce00/0xd9f4181e0d27d264 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a8e expref: 12 pid: 6515 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945913.498142:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d4086a4ce00/0xd9f4181e0d27d264 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a8e expref: 12 pid: 6515 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945913.498150:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945913.498208:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408aa8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+11:2402:x1877942616483584:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 85us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945913.498215:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 48 00010000:00010000:1.0:1790945913.498345:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be4eb9a9/0xd9f4181e0d27d3d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945913.498357:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d6a00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:1.0:1790945913.498361:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be4eb9a9/0xd9f4181e0d27d3d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945913.498370:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be4eb9a9/0xd9f4181e0d27d3d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945913.498384:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be4eb9a9/0xd9f4181e0d27d3d7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945913.498391:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be4eb9a9/0xd9f4181e0d27d3d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945913.498411:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945913.498412:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945913.498414:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945913.498436:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638588032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790945913.498470:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945913.498513:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790945913.498520:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4081324e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638587648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790945913.498541:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1790945913.498604:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d3f8265f100/2, rc 0, transno 4294967301 00000100:00100000:1.0:1790945913.498610:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638587520:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1790945913.498783:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638588032 00000100:00100000:2.0:1790945913.498787:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638588032 00010000:00010000:2.0:1790945913.498804:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40c21d6000/0xd9f4181e0d27d272 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27d26b expref: 24 pid: 6514 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945913.498816:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638587648 00000100:00100000:2.0:1790945913.498819:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638587648 00010000:00010000:2.0:1790945913.498832:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d4086a4d000/0xd9f4181e0d27d28e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27d287 expref: 25 pid: 6516 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945913.498845:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790945913.498852:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83def480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+25:3650:x1877942638587904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790945913.498862:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945913.498866:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40813fea00/0xd9f4181e0d27d280 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27d279 expref: 25 pid: 6516 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945913.498874:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40813fea00/0xd9f4181e0d27d280 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27d279 expref: 25 pid: 6516 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945913.498884:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40813fea00/0xd9f4181e0d27d280 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27d279 expref: 25 pid: 6516 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945913.498895:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945913.498924:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83def480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3650:x1877942638587904:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (1915us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945913.498939:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790945913.498957:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790945913.498963:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4081325180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:3647:x1877942638588032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790945913.498971:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945913.498975:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40c21d6000/0xd9f4181e0d27d272 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27d26b expref: 23 pid: 6514 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945913.498983:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40c21d6000/0xd9f4181e0d27d272 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27d26b expref: 23 pid: 6514 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945913.498993:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40c21d6000/0xd9f4181e0d27d272 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27d26b expref: 23 pid: 6514 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945913.499001:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945913.499038:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4081325180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:3647:x1877942638588032:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945913.499045:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790945913.499065:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790945913.499071:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4081324700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:3647:x1877942638587648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790945913.499078:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945913.499082:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d4086a4d000/0xd9f4181e0d27d28e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27d287 expref: 21 pid: 6516 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945913.499095:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d4086a4d000/0xd9f4181e0d27d28e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27d287 expref: 21 pid: 6516 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945913.499104:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d4086a4d000/0xd9f4181e0d27d28e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27d287 expref: 21 pid: 6516 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945913.499125:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d40bcbe0400/0xd9f4181e0d27d3d0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945913.499133:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40bcbe0400/0xd9f4181e0d27d3d0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945913.499148:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d40bcbe0400/0xd9f4181e0d27d3d0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945913.499156:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d40bcbe0400/0xd9f4181e0d27d3d0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945913.499164:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d40bcbe0400/0xd9f4181e0d27d3d0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945913.499686:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d40bcbe0400/0xd9f4181e0d27d3d0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945913.499695:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0400 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790945913.499699:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d40bcbe0400/0xd9f4181e0d27d3d0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945913.499708:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d40bcbe0400/0xd9f4181e0d27d3d0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945913.500260:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638588032:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790945913.500403:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83ded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638587776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790945913.500413:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638587904:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790945913.500547:0:13735:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d40bcbe0400/0xd9f4181e0d27d3d0 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945913.500558:0:13735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d40bcbe0400/0xd9f4181e0d27d3d0 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945913.501696:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d40bcbe0400/0xd9f4181e0d27d3d0 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945913.501711:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40bcbe0400/0xd9f4181e0d27d3d0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945913.501740:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945913.501855:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4081324700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+20:3647:x1877942638587648:12345-0@lo:103:ldlm_bl.0 Request processed in 2782us (3310us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945913.501865:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790945913.501936:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4081324e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638587648:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790945914.337328:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790945914.583878:0:13784:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffed76d56d0 20000000:00000080:1.0:1790945914.583898:0:13784:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d3f83da4800 uarg=0000000000000000 20000000:01000000:1.0:1790945914.583939:0:13784:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1790945914.583945:0:13784:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1790945914.583949:0:13784:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:3.0:1790945914.589624:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:1.0:1790945914.590155:0:13784:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:1.0:1790945914.590407:0:13784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:1.0:1790945914.590440:0:13784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:1.0:1790945914.590456:0:13784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:1.0:1790945914.590470:0:13784:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1790945914.590493:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27d3de lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945914.591024:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27d3de lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945914.591108:0:13784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27d3de lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945914.591131:0:13784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27d3de lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945914.591138:0:13784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27d3de lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945914.591146:0:13784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27d3de lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945914.591152:0:13784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d6800 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:1.0:1790945914.591157:0:13784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27d3de lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945914.591309:0:13784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27d3de lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945914.591325:0:13784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27d3de lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945914.591331:0:13784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27d3de lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945914.591337:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27d3de lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945914.693033:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945914.693163:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616483840 00000100:00100000:3.0:1790945914.693298:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616483840 00000100:00100000:3.0:1790945914.693370:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 337 00000100:00100000:3.0:1790945914.693380:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+11:6173:x1877942616483840:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790945914.693398:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945914.693417:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40813ff000/0xd9f4181e0d27d3e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330adb expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945914.693445:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40813ff000/0xd9f4181e0d27d3e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330adb expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945914.693456:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40813ff000/0xd9f4181e0d27d3e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330adb expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945914.693465:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40813ff000, rc 0) 00000100:00100000:3.0:1790945914.693668:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+12:6173:x1877942616483840:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 289us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945914.693675:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 337 00000100:00100000:0.0:1790945914.696765:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945914.696800:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616483968 00000100:00100000:0.0:1790945914.696812:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616483968 00000100:00100000:0.0:1790945914.696861:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 338 00000100:00100000:0.0:1790945914.696871:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+12:6173:x1877942616483968:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790945914.697047:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+12:6173:x1877942616483968:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 176us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945914.697055:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 338 00000100:00100000:3.0:1790945914.702357:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945914.704061:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616484096 00000100:00100000:2.0:1790945914.704077:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616484096 00000100:00100000:2.0:1790945914.704138:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 339 00000100:00100000:2.0:1790945914.704148:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+12:6173:x1877942616484096:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790945914.704303:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+12:6173:x1877942616484096:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 Request processed in 156us (1958us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945914.704311:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 339 00000100:00100000:0.0:1790945914.720220:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790945914.720247:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638588160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790945914.720327:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945914.720398:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638588160 00000100:00100000:0.0:1790945914.720406:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638588160 00000100:00100000:0.0:1790945914.720463:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790945914.720473:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1877942638588160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790945914.720518:0:8438:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790945914.720577:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1877942638588160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945914.720584:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790945914.720634:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638588160:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790945914.720743:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790945914.721602:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83dedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638588288:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790945914.721649:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945914.721717:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638588288 00000100:00100000:2.0:1790945914.721723:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638588288 00000100:00100000:2.0:1790945914.721771:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1790945914.721789:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ded880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638588288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790945914.721820:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790945914.721860:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ded880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638588288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945914.721867:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:2.0:1790945914.721892:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790945914.721919:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83dedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638588288:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790945914.728492:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945914.728713:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616484224 00000100:00100000:0.0:1790945914.728724:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616484224 00000100:00100000:0.0:1790945914.728791:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 340 00000100:00100000:0.0:1790945914.728800:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087031850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+12:10760:x1877942616484224:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790945914.729100:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087031850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+12:10760:x1877942616484224:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 299us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945914.729110:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 340 00000100:00100000:0.0:1790945914.755375:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945914.755457:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616484352 00000100:00100000:3.0:1790945914.755466:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616484352 00000100:00100000:3.0:1790945914.755517:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 341 00000100:00100000:3.0:1790945914.755526:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+12:10760:x1877942616484352:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790945914.755686:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+12:10760:x1877942616484352:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 161us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945914.755694:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 341 00000100:00100000:0.0:1790945914.771304:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945914.771423:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616484480 00000100:00100000:1.0:1790945914.771434:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616484480 00000100:00100000:1.0:1790945914.771496:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 342 00000100:00100000:1.0:1790945914.771642:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+12:6173:x1877942616484480:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790945914.771675:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945914.771698:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40c21d6000/0xd9f4181e0d27d3ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330ae2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945914.771727:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40c21d6000/0xd9f4181e0d27d3ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ae2 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945914.771737:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40c21d6000/0xd9f4181e0d27d3ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ae2 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945914.771747:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40c21d6000, rc 0) 00000100:00100000:1.0:1790945914.771812:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:6173:x1877942616484480:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 307us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945914.771819:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 342 00000100:00100000:3.0:1790945914.782515:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945914.783094:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616484608 00000100:00100000:0.0:1790945914.783108:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616484608 00000100:00100000:0.0:1790945914.783252:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 343 00000100:00100000:0.0:1790945914.783263:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087033c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:6173:x1877942616484608:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790945914.783425:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087033c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:6173:x1877942616484608:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 163us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945914.783432:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 343 00000100:00100000:0.0:1790945914.785258:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945914.785415:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616484736 00000100:00100000:2.0:1790945914.785432:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616484736 00000100:00100000:2.0:1790945914.785484:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 344 00000100:00100000:2.0:1790945914.785493:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af617450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:6173:x1877942616484736:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790945914.785646:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af617450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:6173:x1877942616484736:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 Request processed in 154us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945914.785654:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 344 00000100:00100000:3.0:1790945914.791736:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945914.792411:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616484864 00000100:00100000:1.0:1790945914.792421:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616484864 00000100:00100000:1.0:1790945914.792476:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 345 00000100:00100000:1.0:1790945914.792488:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af614050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:10764:x1877942616484864:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790945914.792845:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af614050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:10764:x1877942616484864:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 358us (1118us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945914.792854:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 345 00000100:00100000:3.0:1790945914.796280:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945914.796430:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616484992 00000100:00100000:0.0:1790945914.796441:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616484992 00000100:00100000:0.0:1790945914.796506:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 346 00000100:00100000:0.0:1790945914.796532:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af614450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:10764:x1877942616484992:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790945914.796823:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af614450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:10764:x1877942616484992:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 292us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945914.796831:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 346 10000000:01000000:3.0:1790945914.975286:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790945914.975295:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d3f8248e800 from 7 10000000:01000000:3.0:1790945914.975300:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790945914.975346:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40813ff200/0xd9f4181e0d27d3f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945914.975358:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40813ff200/0xd9f4181e0d27d3f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945914.975369:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40813ff200/0xd9f4181e0d27d3f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945914.975393:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb3b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638588416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790945914.975457:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945914.975523:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096fa8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790945914.975748:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638588416 00000100:00100000:2.0:1790945914.975757:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638588416 00000100:00100000:2.0:1790945914.975805:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1790945914.975813:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af615850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+20:6519:x1877942638588416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790945914.975825:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945914.975838:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3f8363de00/0xd9f4181e0d27d3fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27d3f3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945914.975858:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3f8363de00/0xd9f4181e0d27d3fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27d3f3 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945914.975868:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3f8363de00/0xd9f4181e0d27d3fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d3f3 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945914.975876:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f8363de00, rc 0) 00000100:00100000:2.0:1790945914.975918:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af615850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:6519:x1877942638588416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945914.975925:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1790945914.976258:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb3b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638588416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790945914.976273:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40813ff200/0xd9f4181e0d27d3f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d3fa expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945914.976282:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40813ff200/0xd9f4181e0d27d3f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d3fa expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945914.976334:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb3b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638588544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790945914.976359:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945914.976376:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096fa8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790945914.976431:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638588544 00000100:00100000:0.0:1790945914.976436:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638588544 00000100:00100000:0.0:1790945914.976465:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1790945914.976471:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af614c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:6519:x1877942638588544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790945914.976582:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af614c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:6519:x1877942638588544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945914.976589:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1790945914.976678:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb3b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638588544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790945914.976701:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb3b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638588672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790945914.976743:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945914.976761:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096fa8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790945914.976809:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638588672 00000100:00100000:2.0:1790945914.976813:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638588672 00000100:00100000:2.0:1790945914.976868:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1790945914.976874:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af616c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:6519:x1877942638588672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790945914.976959:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af616c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:6519:x1877942638588672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945914.976966:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1790945914.977038:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb3b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638588672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790945914.981485:0:13797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb3b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:13797:1877942638588800:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790945914.981615:0:13797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945914.988586:0:13797:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096fa8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790945914.988742:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638588800 00000100:00100000:0.0:1790945914.988753:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638588800 00000100:00100000:0.0:1790945914.988807:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1790945914.988817:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af617c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:13797:x1877942638588800:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790945914.989001:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af617c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:13797:x1877942638588800:12345-0@lo:502:llog_process_th.0 Request processed in 185us (7385us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945914.989010:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1790945914.992358:0:13797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb3b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:13797:1877942638588800:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790945914.992407:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790945914.992420:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945914.992423:0:13797:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790945914.992430:0:13797:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d3f8248e800 00000020:00000080:3.0:1790945914.992433:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790945914.992502:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790945914.992506:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945914.992508:0:13797:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790945914.992510:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790945914.992513:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945914.992514:0:13797:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1790945914.992518:0:13797:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d3f8248e800 00000020:00000080:3.0:1790945914.992520:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790945914.992585:0:13797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb3b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:13797:1877942638588928:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790945914.992663:0:13797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945914.992711:0:13797:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d409c65ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790945914.994313:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638588928 00000100:00100000:0.0:1790945914.994327:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638588928 00000100:00100000:0.0:1790945914.994394:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1790945914.994404:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af615450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:13797:x1877942638588928:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790945914.994577:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af615450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:13797:x1877942638588928:12345-0@lo:502:llog_process_th.0 Request processed in 173us (1914us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945914.994585:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1790945914.999339:0:13797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb3b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:13797:1877942638588928:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790945914.999384:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790945914.999391:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945914.999393:0:13797:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1790945914.999406:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1790945915.000243:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1790945915.000269:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790945915.000280:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40813ff200/0xd9f4181e0d27d3f3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d3fa expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945915.000292:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40813ff200/0xd9f4181e0d27d3f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d3fa expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945915.000311:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790945915.000313:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d40bc9be000 from 7 10000000:01000000:1.0:1790945915.000316:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790945915.000349:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27d401 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945915.000357:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27d401 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945915.000367:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27d401 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945915.000390:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4081324e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638589056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790945915.000455:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945915.000489:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638589056 00000100:00100000:1.0:1790945915.000493:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40baeabf00 going to sleep for 11 seconds 00000100:00100000:0.0:1790945915.000496:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638589056 00000100:00100000:0.0:1790945915.000558:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1790945915.000567:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af615c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:6519:x1877942638589056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790945915.000581:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945915.000592:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40bcbe1000/0xd9f4181e0d27d408 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27d401 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945915.000614:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40bcbe1000/0xd9f4181e0d27d408 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27d401 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945915.000623:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40bcbe1000/0xd9f4181e0d27d408 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d401 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945915.000631:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe1000, rc 0) 00000100:00100000:0.0:1790945915.000674:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af615c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:6519:x1877942638589056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945915.000681:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1790945915.001197:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4081324e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638589056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790945915.001213:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27d401 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d408 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945915.001222:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27d401 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d408 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945915.001282:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb3b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638589184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790945915.001316:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945915.001350:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096fa8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790945915.001567:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638589184 00000100:00100000:0.0:1790945915.001574:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638589184 00000100:00100000:0.0:1790945915.001612:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1790945915.001620:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af617050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:6519:x1877942638589184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790945915.001741:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af617050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:6519:x1877942638589184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945915.001749:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1790945915.001824:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb3b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638589184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790945915.001856:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4081327b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638589312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790945915.001902:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945915.001929:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40baeabf00 going to sleep for 11 seconds 00000100:00100000:0.0:1790945915.001973:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638589312 00000100:00100000:0.0:1790945915.001978:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638589312 00000100:00100000:0.0:1790945915.002006:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1790945915.002013:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af614850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:6519:x1877942638589312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790945915.002106:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af614850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:6519:x1877942638589312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945915.002114:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1790945915.002417:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4081327b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638589312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790945915.012930:0:13799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83c34380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:13799:1877942638589440:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790945915.013037:0:13799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945915.013088:0:13799:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bb00a900 going to sleep for 11 seconds 00000100:00100000:2.0:1790945915.013142:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638589440 00000100:00100000:2.0:1790945915.013150:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638589440 00000100:00100000:2.0:1790945915.013234:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1790945915.013245:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af616050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:13799:x1877942638589440:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790945915.013365:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af616050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:13799:x1877942638589440:12345-0@lo:502:llog_process_th.0 Request processed in 121us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945915.013374:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1790945915.013530:0:13799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83c34380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:13799:1877942638589440:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790945915.013571:0:13799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790945915.013581:0:13799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790945915.013584:0:13799:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790945915.013592:0:13799:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d40bc9be000 00000020:00000080:1.0:1790945915.013595:0:13799:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790945915.013660:0:13799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790945915.013664:0:13799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790945915.013672:0:13799:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790945915.013675:0:13799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790945915.013678:0:13799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790945915.013680:0:13799:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1790945915.013683:0:13799:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d40bc9be000 00000020:00000080:1.0:1790945915.013685:0:13799:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790945915.013722:0:13799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4081327480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:13799:1877942638589568:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790945915.013757:0:13799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945915.013783:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638589568 00000100:00100000:1.0:1790945915.013787:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638589568 00000100:00100000:1.0:1790945915.013812:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1790945915.013818:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af616850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:13799:x1877942638589568:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790945915.013878:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af616850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:13799:x1877942638589568:12345-0@lo:502:llog_process_th.0 Request processed in 60us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945915.013884:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1790945915.013917:0:13799:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40baeabf00 going to sleep for 11 seconds 00000100:00100000:1.0:1790945915.013929:0:13799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4081327480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:13799:1877942638589568:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790945915.013945:0:13799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790945915.013949:0:13799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790945915.013951:0:13799:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1790945915.013954:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1790945915.014009:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1790945915.014030:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790945915.014039:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27d401 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d408 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945915.014050:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27d401 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d408 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945915.014072:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790945915.014075:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d40bacd0800 from 7 10000000:01000000:1.0:1790945915.014078:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790945915.014100:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7c00/0xd9f4181e0d27d40f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945915.014108:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7c00/0xd9f4181e0d27d40f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945915.014117:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7c00/0xd9f4181e0d27d40f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945915.014131:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4081327480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638589696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790945915.014159:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945915.014210:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4091069300 going to sleep for 11 seconds 00000100:00100000:1.0:1790945915.014223:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638589696 00000100:00100000:1.0:1790945915.014226:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638589696 00000100:00100000:1.0:1790945915.014246:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1790945915.014252:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af615050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:6519:x1877942638589696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790945915.014262:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945915.014273:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40c21d6600/0xd9f4181e0d27d416 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27d40f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945915.014291:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40c21d6600/0xd9f4181e0d27d416 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27d40f expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945915.014300:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40c21d6600/0xd9f4181e0d27d416 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d40f expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945915.014318:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40c21d6600, rc 0) 00000100:00100000:1.0:1790945915.014349:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af615050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:6519:x1877942638589696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945915.014355:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1790945915.014384:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4081327480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638589696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790945915.014396:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7c00/0xd9f4181e0d27d40f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d416 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945915.014405:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7c00/0xd9f4181e0d27d40f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d416 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945915.014447:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4081327480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638589824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790945915.014474:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945915.014487:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4091069300 going to sleep for 11 seconds 00000100:00100000:1.0:1790945915.014498:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638589824 00000100:00100000:1.0:1790945915.014502:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638589824 00000100:00100000:1.0:1790945915.014518:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1790945915.014523:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af617850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:6519:x1877942638589824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790945915.014621:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af617850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:6519:x1877942638589824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 97us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945915.014628:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1790945915.014654:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4081327480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638589824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790945915.014680:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4081327480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638589952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790945915.014713:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945915.014734:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40baeab3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790945915.014745:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638589952 00000100:00100000:1.0:1790945915.014749:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638589952 00000100:00100000:1.0:1790945915.014765:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1790945915.014770:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40af616450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:6519:x1877942638589952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790945915.014837:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40af616450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:6519:x1877942638589952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945915.014843:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1790945915.014876:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4081327480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638589952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790945915.015146:0:13801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4081327480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:13801:1877942638590080:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790945915.015208:0:13801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945915.015228:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638590080 00000100:00100000:1.0:1790945915.015232:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638590080 00000100:00100000:1.0:1790945915.015253:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1790945915.015259:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:13801:x1877942638590080:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790945915.015325:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:13801:x1877942638590080:12345-0@lo:502:llog_process_th.0 Request processed in 65us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945915.015331:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1790945915.015362:0:13801:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bcac0240 going to sleep for 11 seconds 00000100:00100000:1.0:1790945915.015374:0:13801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4081327480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:13801:1877942638590080:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790945915.015394:0:13801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790945915.015401:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790945915.015403:0:13801:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790945915.015409:0:13801:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d40bacd0800 00000020:00000080:1.0:1790945915.015411:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790945915.015450:0:13801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790945915.015459:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790945915.015460:0:13801:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790945915.015464:0:13801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790945915.015466:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790945915.015467:0:13801:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1790945915.015471:0:13801:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d40bacd0800 00000020:00000080:1.0:1790945915.015473:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790945915.015506:0:13801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4081327480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:13801:1877942638590208:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790945915.015551:0:13801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945915.015568:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638590208 00000100:00100000:1.0:1790945915.015571:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638590208 00000100:00100000:1.0:1790945915.015591:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1790945915.015597:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:13801:x1877942638590208:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790945915.015652:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:13801:x1877942638590208:12345-0@lo:502:llog_process_th.0 Request processed in 55us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945915.015659:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1790945915.015688:0:13801:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bcac0240 going to sleep for 11 seconds 00000100:00100000:1.0:1790945915.015698:0:13801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4081327480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:13801:1877942638590208:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790945915.015712:0:13801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790945915.015716:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790945915.015717:0:13801:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1790945915.015720:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1790945915.015762:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1790945915.015780:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790945915.015787:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7c00/0xd9f4181e0d27d40f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d416 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945915.015795:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7c00/0xd9f4181e0d27d40f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d416 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945915.015815:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790945915.015817:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d4087223000 from 7 10000000:01000000:1.0:1790945915.015820:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790945915.015837:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7000/0xd9f4181e0d27d41d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945915.015844:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7000/0xd9f4181e0d27d41d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945915.015852:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7000/0xd9f4181e0d27d41d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945915.015864:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4081327480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638590336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790945915.015886:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945915.015897:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bcac0240 going to sleep for 11 seconds 00000100:00100000:1.0:1790945915.015907:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638590336 00000100:00100000:1.0:1790945915.015910:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638590336 00000100:00100000:1.0:1790945915.015926:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1790945915.015931:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:6519:x1877942638590336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790945915.015938:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945915.015947:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40c21d7800/0xd9f4181e0d27d424 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27d41d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945915.015964:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40c21d7800/0xd9f4181e0d27d424 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27d41d expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945915.015972:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40c21d7800/0xd9f4181e0d27d424 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27d41d expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945915.015989:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40c21d7800, rc 0) 00000100:00100000:1.0:1790945915.016017:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:6519:x1877942638590336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945915.016022:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1790945915.016049:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4081327480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638590336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790945915.016060:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7000/0xd9f4181e0d27d41d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d424 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945915.016068:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7000/0xd9f4181e0d27d41d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d424 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945915.016104:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4081327480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638590464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790945915.016125:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945915.016137:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bcac0240 going to sleep for 11 seconds 00000100:00100000:1.0:1790945915.016148:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638590464 00000100:00100000:1.0:1790945915.016151:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638590464 00000100:00100000:1.0:1790945915.016192:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1790945915.016198:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:6519:x1877942638590464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790945915.016273:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:6519:x1877942638590464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 75us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945915.016279:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1790945915.016303:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4081327480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638590464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790945915.016324:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4081327480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638590592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790945915.019915:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945915.020002:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bcac0240 going to sleep for 11 seconds 00000100:00100000:2.0:1790945915.022346:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638590592 00000100:00100000:2.0:1790945915.022365:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638590592 00000100:00100000:2.0:1790945915.022439:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1790945915.022449:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:6519:x1877942638590592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790945915.022657:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:6519:x1877942638590592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 209us (2749us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945915.022664:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1790945915.023244:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4081327480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8841fcfb-fb47-4307-92c2-97500c1c82bd:6519:1877942638590592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790945915.027203:0:13802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4081327480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:13802:1877942638590720:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790945915.027304:0:13802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945915.027349:0:13802:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bcac0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790945915.028008:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638590720 00000100:00100000:2.0:1790945915.028018:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638590720 00000100:00100000:2.0:1790945915.028071:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1790945915.028080:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:13802:x1877942638590720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790945915.028498:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:13802:x1877942638590720:12345-0@lo:502:llog_process_th.0 Request processed in 418us (1192us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945915.028507:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1790945915.028641:0:13802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4081327480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:13802:1877942638590720:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790945915.028672:0:13802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790945915.028681:0:13802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790945915.028684:0:13802:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790945915.028693:0:13802:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d4087223000 00000020:00000080:1.0:1790945915.028696:0:13802:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790945915.028763:0:13802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790945915.028767:0:13802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790945915.028769:0:13802:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790945915.028771:0:13802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790945915.028774:0:13802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790945915.028775:0:13802:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1790945915.028779:0:13802:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d4087223000 00000020:00000080:1.0:1790945915.028781:0:13802:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790945915.028822:0:13802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4081327480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:13802:1877942638590848:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790945915.028864:0:13802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945915.028892:0:13802:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bcac0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790945915.030060:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638590848 00000100:00100000:1.0:1790945915.030071:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638590848 00000100:00100000:1.0:1790945915.030121:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1790945915.030130:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:13802:x1877942638590848:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790945915.030477:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:13802:x1877942638590848:12345-0@lo:502:llog_process_th.0 Request processed in 347us (1611us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945915.030495:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1790945915.030589:0:13802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4081327480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8841fcfb-fb47-4307-92c2-97500c1c82bd:13802:1877942638590848:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790945915.030619:0:13802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790945915.030626:0:13802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945915.030629:0:13802:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1790945915.030633:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1790945915.031499:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1790945915.031553:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790945915.031572:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7000/0xd9f4181e0d27d41d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d424 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945915.031583:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7000/0xd9f4181e0d27d41d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d424 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790945915.046506:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1790945915.064876:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790945915.359508:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790945916.063835:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1790945916.130820:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790945916.255484:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790945916.258458:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83dedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638590976:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790945916.258559:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945916.261196:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638590976 00000100:00100000:2.0:1790945916.261210:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638590976 00000100:00100000:2.0:1790945916.261291:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1790945916.261300:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638590976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790945916.261387:0:6526:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1790945916.261472:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638590976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 173us (2913us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945916.261479:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1790945916.275420:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83dedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638590976:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1790945916.387100:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945916.487490:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945916.487543:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945916.487560:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616485120 00000100:00100000:2.0:1790945916.487572:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616485120 00000100:00100000:2.0:1790945916.487661:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 367 00000100:00100000:2.0:1790945916.487672:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:2404:x1877942616485120:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945916.487683:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945916.487710:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945916.487799:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616485376 00000100:00100000:3.0:1790945916.487809:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616485376 00000100:00100000:0.0:1790945916.487841:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616485632 00000100:00100000:0.0:1790945916.487846:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616485632 00000100:00100000:3.0:1790945916.487858:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616485248 00000100:00100000:3.0:1790945916.487863:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616485248 00000100:00100000:0.0:1790945916.487884:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 213 00000100:00100000:3.0:1790945916.487892:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 214 00000100:00100000:0.0:1790945916.487897:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4081325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2404:x1877942616485376:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790945916.487907:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4081325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2404:x1877942616485632:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790945916.487969:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:2404:x1877942616485120:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 298us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945916.487992:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 367 00000100:00080000:2.0:1790945916.488030:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790945916.488035:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790945916.488047:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 215 00000100:00100000:2.0:1790945916.488055:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4081327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2404:x1877942616485248:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945916.490690:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945916.490848:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4081325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2404:x1877942616485376:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 2953us (3302us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945916.490860:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 213 00000100:00100000:0.0:1790945916.490919:0:8436:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616485504 00000100:00100000:0.0:1790945916.490925:0:8436:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616485504 00000100:00100000:0.0:1790945916.490982:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 85 00000100:00100000:0.0:1790945916.490990:0:8436:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4081327b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2404:x1877942616485504:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945916.492952:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945916.493117:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616485760 00000100:00100000:1.0:1790945916.493126:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616485760 00000100:00100000:0.0:1790945916.493384:0:8436:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4081327b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2404:x1877942616485504:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 2394us (2701us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945916.493394:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 85 00000100:00100000:1.0:1790945916.493645:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 216 00000100:00100000:1.0:1790945916.493655:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4081324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2404:x1877942616485760:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945916.493685:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4081324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2404:x1877942616485760:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 32us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945916.493692:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 216 00000100:00080000:0.0:1790945916.494395:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790945916.494402:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790945916.495668:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4081327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2404:x1877942616485248:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 7606us (7950us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945916.495669:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4081325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2404:x1877942616485632:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 7754us (7974us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945916.495685:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 214 00000100:00100000:2.0:1790945916.495698:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 215 00000100:00100000:1.0:1790945916.770013:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790945916.770041:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638591104:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790945916.770116:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945916.770771:0:12418:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638591104 00000100:00100000:2.0:1790945916.770781:0:12418:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638591104 00000100:00100000:2.0:1790945916.770843:0:12418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1790945916.770853:0:12418:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638591104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790945916.770889:0:12418:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790945916.771019:0:12418:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638591104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 167us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945916.771027:0:12418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1790945916.771216:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638591104:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1790945917.407428:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945917.791652:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877942638591360:0@lo:400:kworker.0 00000100:00100000:1.0:1790945917.791753:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945917.791839:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1877942638591872:0@lo:400:kworker.0 00000100:00100000:1.0:1790945917.791900:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945917.791972:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1877942638592384:0@lo:400:kworker.0 00000100:00100000:1.0:1790945917.792021:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945917.792047:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1790945917.792053:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638591488:0@lo:400:kworker.0 00000100:00100000:1.0:1790945917.792102:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945917.792118:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1877942638592000:0@lo:400:kworker.0 00000100:00100000:1.0:1790945917.792139:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945917.792196:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1877942638592512:0@lo:400:kworker.0 00000100:00100000:1.0:1790945917.792217:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945917.792252:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638591360 00000100:00100000:1.0:1790945917.792260:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638591360 00000100:00100000:1.0:1790945917.792311:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638591872 00000100:00100000:1.0:1790945917.792314:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638591872 00000100:00100000:1.0:1790945917.792335:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638592384 00000100:00100000:1.0:1790945917.792338:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638592384 00000100:00100000:1.0:1790945917.792349:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638592000 00000100:00100000:1.0:1790945917.792352:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638592000 00000100:00100000:1.0:1790945917.792377:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638592512 00000100:00100000:1.0:1790945917.792381:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638592512 00000100:00100000:1.0:1790945917.792399:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1790945917.792407:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877942638591360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945917.792464:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877942638591360:12345-0@lo:400:kworker.0 Request processed in 58us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945917.792471:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1790945917.792690:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1790945917.792696:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877942638591872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945917.792734:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877942638591872:12345-0@lo:400:kworker.0 Request processed in 38us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945917.792740:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1790945917.792751:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1790945917.792757:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1877942638592384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945917.792781:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1877942638592384:12345-0@lo:400:kworker.0 Request processed in 25us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945917.792787:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1790945917.792797:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1790945917.792803:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877942638592000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945917.792829:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877942638592000:12345-0@lo:400:kworker.0 Request processed in 26us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945917.792834:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1790945917.792845:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1790945917.792850:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877942638592512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945917.792875:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877942638592512:12345-0@lo:400:kworker.0 Request processed in 26us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945917.792881:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00010000:00080000:1.0:1790945917.792922:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bff74380 x1877942638592000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945917.792936:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1877942638592000:0@lo:400:kworker.0 00010000:00080000:1.0:1790945917.792948:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bff74700 x1877942638592512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945917.792956:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1877942638592512:0@lo:400:kworker.0 00000100:00100000:1.0:1790945917.792975:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877942638591360:0@lo:400:kworker.0 00000100:00100000:1.0:1790945917.792983:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1877942638591872:0@lo:400:kworker.0 00000100:00100000:1.0:1790945917.792990:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1877942638592384:0@lo:400:kworker.0 00000100:00100000:0.0:1790945917.793197:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638591488 00000100:00100000:0.0:1790945917.793203:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638591488 00000100:00100000:0.0:1790945917.793237:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1790945917.793243:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638591488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945917.793284:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638591488:12345-0@lo:400:kworker.0 Request processed in 41us (1181us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945917.793289:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1790945917.793309:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1877942638591616:0@lo:400:kworker.0 00000100:00100000:0.0:1790945917.793368:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945917.793388:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638592128:0@lo:400:kworker.0 00000100:00100000:0.0:1790945917.793411:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945917.793427:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638592640:0@lo:400:kworker.0 00000100:00100000:0.0:1790945917.793445:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945917.793492:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1790945917.793499:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638591232:0@lo:400:kworker.0 00000100:00100000:0.0:1790945917.793529:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945917.793551:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638591744:0@lo:400:kworker.0 00000100:00100000:0.0:1790945917.793573:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945917.793587:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638592256:0@lo:400:kworker.0 00000100:00100000:0.0:1790945917.793623:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945917.793650:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638592768:0@lo:400:kworker.0 00000100:00100000:0.0:1790945917.793672:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945917.793697:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638592128 00000100:00100000:0.0:1790945917.793701:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638592128 00000100:00100000:0.0:1790945917.793727:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638592640 00000100:00100000:0.0:1790945917.793730:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638592640 00000100:00100000:0.0:1790945917.793741:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638592256 00000100:00100000:0.0:1790945917.793743:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638592256 00000100:00100000:0.0:1790945917.793752:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638592768 00000100:00100000:0.0:1790945917.793754:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638592768 00000100:00100000:0.0:1790945917.793765:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790945917.793771:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638592128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945917.793800:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638592128:12345-0@lo:400:kworker.0 Request processed in 29us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945917.793805:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790945917.793814:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790945917.793819:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638592640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945917.793838:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638592640:12345-0@lo:400:kworker.0 Request processed in 19us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945917.793843:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790945917.793852:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790945917.793857:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4f2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1877942638592256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945917.793877:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4f2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1877942638592256:12345-0@lo:400:kworker.0 Request processed in 21us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945917.793882:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790945917.794074:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790945917.794080:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638592768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945917.794115:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638592768:12345-0@lo:400:kworker.0 Request processed in 36us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945917.794122:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790945917.794140:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638591232 00000100:00100000:0.0:1790945917.794144:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638591232 00000100:00100000:0.0:1790945917.794166:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1790945917.794196:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3647:x1877942638591232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945917.794222:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3647:x1877942638591232:12345-0@lo:400:kworker.0 Request processed in 27us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945917.794229:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00080000:0.0:1790945917.794255:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790945917.794259:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790945917.794262:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790945917.794265:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790945917.794288:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638591232:0@lo:400:kworker.0 00000100:00100000:0.0:1790945917.794300:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638592256:0@lo:400:kworker.0 00010000:00080000:0.0:1790945917.794310:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bff77480 x1877942638592768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945917.794319:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638592768:0@lo:400:kworker.0 00000100:00100000:0.0:1790945917.794328:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638592128:0@lo:400:kworker.0 00010000:00080000:0.0:1790945917.794335:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bff77b80 x1877942638592640/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945917.794341:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638592640:0@lo:400:kworker.0 00000100:00100000:0.0:1790945917.794367:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638591616 00000100:00100000:0.0:1790945917.794376:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638591616 00000100:00100000:0.0:1790945917.794399:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1790945917.794405:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1877942638591616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945917.794445:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1877942638591616:12345-0@lo:400:kworker.0 Request processed in 39us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945917.794451:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1790945917.794474:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1877942638591616:0@lo:400:kworker.0 00000100:00100000:0.0:1790945917.794506:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638591488:0@lo:400:kworker.0 00000100:00100000:3.0:1790945917.794903:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790945917.794925:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638592896:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790945917.794999:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945917.795035:0:11925:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638592896 00000100:00100000:3.0:1790945917.795039:0:11925:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638592896 00000100:00100000:3.0:1790945917.795067:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1790945917.795074:0:11925:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638592896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790945917.795097:0:11925:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790945917.795134:0:11925:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638592896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945917.795140:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:3.0:1790945917.795196:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcb39c00 x1877942638592896/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945933 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945917.795210:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638592896:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790945917.795230:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638591744 00000100:00100000:3.0:1790945917.795234:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638591744 00000100:00100000:3.0:1790945917.795261:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1790945917.795268:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638591744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945917.795303:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638591744:12345-0@lo:400:kworker.0 Request processed in 36us (1729us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945917.795309:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1790945917.795337:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638591744:0@lo:400:kworker.0 00000100:00100000:0.0:1790945917.797115:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638593024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790945917.797200:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945917.797308:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638593024 00000100:00100000:2.0:1790945917.797316:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638593024 00000100:00100000:2.0:1790945917.797370:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790945917.797379:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638593024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790945917.797399:0:8438:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790945917.797448:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638593024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945917.797455:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:0.0:1790945917.797811:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcb39c00 x1877942638593024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945933 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945917.797828:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638593024:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790945918.431359:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790945919.331906:0:8429:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:1.0:1790945919.455634:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945919.839612:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638593280:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790945919.839641:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83c34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638593152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790945919.839689:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945919.839721:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638593280 00000100:00100000:3.0:1790945919.839728:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638593280 00000100:00100000:3.0:1790945919.839785:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1790945919.839797:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638593280:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1790945919.839824:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1790945919.839842:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790945919.847391:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945919.847848:0:11925:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638593152 00000100:00100000:1.0:1790945919.847858:0:11925:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638593152 00000100:00100000:1.0:1790945919.847939:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790945919.847948:0:11925:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83deca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638593152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790945919.847974:0:11925:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790945919.848047:0:11925:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83deca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638593152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945919.848054:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790945919.848124:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1790945919.848130:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d3f8265f100, transno 4294967301 00000100:00100000:1.0:1790945919.848150:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83c34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638593152:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790945919.848552:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790945919.856409:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638593280:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790945919.860279:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638593280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 16228us (16333us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945919.860296:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00010000:1.0:1790945920.480053:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945921.375488:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790945921.375516:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83ded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638593408:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790945921.375585:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945921.375737:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638593408 00000100:00100000:3.0:1790945921.375746:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638593408 00000100:00100000:3.0:1790945921.375805:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1790945921.375814:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638593408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790945921.376152:0:6526:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1790945921.376249:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638593408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 435us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945921.376257:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1790945921.376355:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83ded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638593408:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1790945921.503436:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945921.604475:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945921.604531:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945921.604568:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945921.604603:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945921.604623:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945921.604668:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945921.604702:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616486016 00000100:00100000:0.0:1790945921.604714:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616486016 00000100:00100000:0.0:1790945921.604768:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616486528 00000100:00100000:0.0:1790945921.604771:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616486528 00000100:00100000:0.0:1790945921.604786:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616486144 00000100:00100000:0.0:1790945921.604788:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616486144 00000100:00100000:0.0:1790945921.604800:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616486400 00000100:00100000:0.0:1790945921.604802:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616486400 00000100:00100000:0.0:1790945921.604819:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 223 00000100:00100000:0.0:1790945921.604829:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2401:x1877942616486016:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790945921.604927:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2401:x1877942616486016:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 99us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945921.604935:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 223 00000100:00100000:0.0:1790945921.604953:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 224 00000100:00100000:0.0:1790945921.604959:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2401:x1877942616486528:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790945921.604985:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2401:x1877942616486528:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 27us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945921.604992:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 224 00000100:00100000:0.0:1790945921.605004:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 225 00000100:00100000:0.0:1790945921.605010:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2401:x1877942616486144:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790945921.605034:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2401:x1877942616486144:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 24us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945921.605040:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 225 00000100:00100000:2.0:1790945921.605523:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616486272 00000100:00100000:2.0:1790945921.605530:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616486272 00000100:00100000:2.0:1790945921.605573:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 90 00000100:00100000:2.0:1790945921.605582:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2401:x1877942616486272:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790945921.605626:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2401:x1877942616486272:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 46us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945921.605633:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 90 00000100:00100000:2.0:1790945921.605658:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616485888 00000100:00100000:2.0:1790945921.605662:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616485888 00000100:00100000:2.0:1790945921.605687:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 369 00000100:00100000:2.0:1790945921.605693:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:2401:x1877942616485888:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790945921.605718:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:2401:x1877942616485888:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 26us (1115us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945921.605724:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 369 00000100:00080000:2.0:1790945921.605753:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790945921.605758:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790945921.605759:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790945921.607157:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 226 00000100:00100000:3.0:1790945921.607191:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2401:x1877942616486400:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790945921.607250:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2401:x1877942616486400:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 83us (2581us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945921.607258:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 226 00000100:00100000:2.0:1790945921.891409:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638593536:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790945921.891485:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945921.891724:0:12418:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638593536 00000100:00100000:0.0:1790945921.891733:0:12418:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638593536 00000100:00100000:0.0:1790945921.891785:0:12418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1790945921.891807:0:12418:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ded500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638593536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790945921.891840:0:12418:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790945921.891970:0:12418:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ded500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638593536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 163us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945921.891978:0:12418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1790945921.892421:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638593536:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1790945922.527777:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945922.911621:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638593664:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790945922.911692:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945922.912226:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638594048:0@lo:400:kworker.0 00000100:00100000:3.0:1790945922.912262:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945922.912285:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4db1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1877942638594560:0@lo:400:kworker.0 00000100:00100000:3.0:1790945922.912311:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945922.912336:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1877942638595072:0@lo:400:kworker.0 00000100:00100000:3.0:1790945922.912359:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945922.912396:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1790945922.912403:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877942638593920:0@lo:400:kworker.0 00000100:00100000:3.0:1790945922.912436:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945922.912456:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4db0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1877942638594432:0@lo:400:kworker.0 00000100:00100000:3.0:1790945922.912477:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945922.912493:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1877942638594944:0@lo:400:kworker.0 00000100:00100000:3.0:1790945922.912526:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945922.912556:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638594048 00000100:00100000:3.0:1790945922.912563:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638594048 00000100:00100000:3.0:1790945922.912625:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1790945922.912635:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638594048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945922.912688:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638594048:12345-0@lo:400:kworker.0 Request processed in 55us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945922.912695:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1790945922.912717:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638594560 00000100:00100000:3.0:1790945922.912721:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638594560 00000100:00100000:3.0:1790945922.912748:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638595072 00000100:00100000:3.0:1790945922.912751:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638595072 00000100:00100000:3.0:1790945922.912764:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638593920 00000100:00100000:3.0:1790945922.912766:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638593920 00000100:00100000:3.0:1790945922.912776:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638594432 00000100:00100000:3.0:1790945922.912778:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638594432 00000100:00100000:3.0:1790945922.912788:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638594944 00000100:00100000:3.0:1790945922.912790:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638594944 00000100:00100000:3.0:1790945922.912801:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1790945922.912807:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1877942638594560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945922.912838:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1877942638594560:12345-0@lo:400:kworker.0 Request processed in 32us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945922.912843:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1790945922.912854:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1790945922.912865:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877942638595072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945922.913332:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877942638595072:12345-0@lo:400:kworker.0 Request processed in 466us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945922.913339:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1790945922.913366:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1790945922.913373:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877942638593920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945922.913486:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1877942638594176:0@lo:400:kworker.0 00000100:00100000:1.0:1790945922.913532:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945922.913548:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638594688:0@lo:400:kworker.0 00000100:00100000:1.0:1790945922.913580:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945922.913610:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638595200:0@lo:400:kworker.0 00000100:00100000:1.0:1790945922.913632:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945922.913657:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1790945922.913663:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638593792:0@lo:400:kworker.0 00000100:00100000:1.0:1790945922.913685:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945922.913707:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4db2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638594304:0@lo:400:kworker.0 00000100:00100000:1.0:1790945922.913725:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945922.913739:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638594816:0@lo:400:kworker.0 00000100:00100000:1.0:1790945922.913758:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945922.913785:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638594688 00000100:00100000:1.0:1790945922.913790:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638594688 00000100:00100000:1.0:1790945922.913820:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638595200 00000100:00100000:1.0:1790945922.913823:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638595200 00000100:00100000:1.0:1790945922.913840:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638594816 00000100:00100000:1.0:1790945922.913843:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638594816 00000100:00100000:1.0:1790945922.913855:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1790945922.913861:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638594688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945922.913913:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638594688:12345-0@lo:400:kworker.0 Request processed in 51us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945922.914245:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877942638593920:12345-0@lo:400:kworker.0 Request processed in 872us (1807us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945922.914252:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1790945922.914266:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638594176 00000100:00100000:3.0:1790945922.914269:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638594176 00000100:00100000:3.0:1790945922.914283:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1790945922.914288:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877942638594432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945922.914317:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877942638594432:12345-0@lo:400:kworker.0 Request processed in 28us (1838us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945922.914322:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1790945922.914334:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1790945922.914339:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877942638594944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945922.914648:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1790945922.914662:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1790945922.914670:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638595200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945922.914703:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638595200:12345-0@lo:400:kworker.0 Request processed in 36us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945922.914709:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1790945922.914719:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790945922.914724:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638594816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945922.914771:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638594816:12345-0@lo:400:kworker.0 Request processed in 46us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945922.914779:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790945922.914826:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638594816:0@lo:400:kworker.0 00000100:00100000:1.0:1790945922.914842:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638594688:0@lo:400:kworker.0 00010000:00080000:1.0:1790945922.914856:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bff79880 x1877942638595200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945922.914859:0:11925:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638593664 00000100:00100000:2.0:1790945922.914868:0:11925:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638593664 00000100:00100000:2.0:1790945922.914949:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1790945922.914957:0:11925:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638593664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790945922.914979:0:11925:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790945922.915020:0:11925:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638593664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (3327us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945922.915027:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1790945922.915085:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638594304 00000100:00100000:2.0:1790945922.915095:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638594304 00000100:00100000:2.0:1790945922.915128:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1790945922.915135:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638594304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945922.915201:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638594304:12345-0@lo:400:kworker.0 Request processed in 66us (1474us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945922.915207:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1790945922.915229:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1790945922.915236:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1877942638594176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945922.915281:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1877942638594176:12345-0@lo:400:kworker.0 Request processed in 46us (1749us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945922.915287:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00080000:2.0:1790945922.915321:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790945922.915325:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790945922.915327:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790945922.915330:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790945922.915353:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877942638593920:0@lo:400:kworker.0 00000100:00100000:2.0:1790945922.915365:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4db0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1877942638594432:0@lo:400:kworker.0 00000100:00100000:2.0:1790945922.915388:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1877942638594944:0@lo:400:kworker.0 00000100:00100000:2.0:1790945922.915400:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638594048:0@lo:400:kworker.0 00000100:00100000:3.0:1790945922.915501:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877942638594944:12345-0@lo:400:kworker.0 Request processed in 1155us (2967us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945922.915589:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638593792 00000100:00100000:0.0:1790945922.915595:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638593792 00000100:00100000:0.0:1790945922.915627:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1790945922.915633:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3647:x1877942638593792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945922.915670:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3647:x1877942638593792:12345-0@lo:400:kworker.0 Request processed in 37us (1983us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945922.915676:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1790945922.915754:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638595328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790945922.915787:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945922.915828:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638595328 00000100:00100000:0.0:1790945922.915832:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638595328 00000100:00100000:0.0:1790945922.915873:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1790945922.915881:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40baced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638595328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790945922.915896:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790945922.915929:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40baced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638595328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945922.915935:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:0.0:1790945922.915963:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f83c34380 x1877942638595328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945938 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945922.915978:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638595328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790945922.916021:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1790945922.916102:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638595200:0@lo:400:kworker.0 00010000:00080000:1.0:1790945922.916122:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcb3b100 x1877942638593664/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945938 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945922.916136:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638593664:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790945922.916161:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638593792:0@lo:400:kworker.0 00000100:00100000:1.0:1790945922.916205:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4db2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638594304:0@lo:400:kworker.0 00000100:00100000:1.0:1790945922.916217:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1877942638594176:0@lo:400:kworker.0 00010000:00080000:2.0:1790945922.916264:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40b4db1880 x1877942638594560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945922.916278:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4db1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1877942638594560:0@lo:400:kworker.0 00010000:00080000:2.0:1790945922.916296:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bff79c00 x1877942638595072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945922.916322:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1877942638595072:0@lo:400:kworker.0 00010000:00010000:1.0:1790945923.551380:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945924.576386:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945924.959661:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790945924.959685:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638595456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790945924.959756:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945924.959856:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638595456 00000100:00100000:1.0:1790945924.959864:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638595456 00000100:00100000:1.0:1790945924.959929:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790945924.959939:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638595456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790945924.959968:0:8438:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790945924.960014:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638595456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945924.960037:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790945924.960091:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638595456:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790945924.960146:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790945924.960815:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638595584:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790945924.960868:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945924.961374:0:11925:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638595584 00000100:00100000:1.0:1790945924.961382:0:11925:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638595584 00000100:00100000:1.0:1790945924.961434:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1790945924.961443:0:11925:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638595584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790945924.961460:0:11925:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1790945924.961481:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790945924.961505:0:11925:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638595584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945924.961514:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1790945924.962232:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638595584:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1790945925.599542:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790945926.304025:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1790945926.368106:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790945926.496596:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83deed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638595712:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790945926.496680:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945926.498439:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638595712 00000100:00100000:2.0:1790945926.498456:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638595712 00000100:00100000:2.0:1790945926.498545:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1790945926.498556:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638595712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790945926.498617:0:6526:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1790945926.499479:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638595712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 918us (2792us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945926.499489:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1790945926.504949:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83deed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638595712:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1790945926.625588:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945926.735882:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945926.735991:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945926.736020:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945926.736076:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945926.736139:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616486784 00000100:00100000:0.0:1790945926.736152:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616486784 00000100:00100000:0.0:1790945926.736268:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616487296 00000100:00100000:0.0:1790945926.736272:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616487296 00000100:00100000:0.0:1790945926.736297:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 233 00000100:00100000:0.0:1790945926.736320:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2401:x1877942616486784:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790945926.736399:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2401:x1877942616486784:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 94us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945926.736407:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 233 00000100:00100000:0.0:1790945926.736425:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 234 00000100:00100000:0.0:1790945926.736431:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2401:x1877942616487296:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790945926.736457:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2401:x1877942616487296:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 26us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945926.736463:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 234 00000100:00080000:0.0:1790945926.736595:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790945926.736600:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790945926.737389:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945926.737467:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616486912 00000100:00100000:3.0:1790945926.737475:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616486912 00000100:00100000:3.0:1790945926.737529:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 235 00000100:00100000:3.0:1790945926.737537:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bad28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2402:x1877942616486912:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790945926.737585:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bad28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2402:x1877942616486912:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 49us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945926.737592:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 235 00000100:00100000:2.0:1790945926.738538:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616486656 00000100:00100000:1.0:1790945926.739061:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616487040 00000100:00100000:1.0:1790945926.739070:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616487040 00000100:00100000:1.0:1790945926.739140:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 94 00000100:00100000:1.0:1790945926.739150:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2401:x1877942616487040:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790945926.739153:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616486656 00000100:00100000:2.0:1790945926.739205:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 371 00000100:00100000:2.0:1790945926.739213:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:2402:x1877942616486656:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790945926.739248:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:2402:x1877942616486656:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 35us (3382us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945926.739255:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 371 00000100:00100000:1.0:1790945926.739293:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2401:x1877942616487040:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 145us (3272us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945926.739300:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 94 00000100:00080000:0.0:1790945926.739783:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790945926.739790:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790945926.743427:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945926.743588:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616487168 00000100:00100000:2.0:1790945926.743600:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616487168 00000100:00100000:2.0:1790945926.743689:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 236 00000100:00080000:0.0:1790945926.743760:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790945926.744124:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bfef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2402:x1877942616487168:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790945926.744257:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bfef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2402:x1877942616487168:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 558us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945926.744266:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 236 00000100:00100000:0.0:1790945927.008103:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638595840:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790945927.008209:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945927.008553:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638595840 00000100:00100000:3.0:1790945927.008562:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638595840 00000100:00100000:3.0:1790945927.008617:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1790945927.008626:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bfef3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638595840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790945927.008661:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790945927.008717:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bfef3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638595840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945927.008725:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1790945927.009043:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638595840:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1790945927.647419:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945928.031491:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790945928.031515:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638595968:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790945928.031586:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945928.031782:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638595968 00000100:00100000:3.0:1790945928.031791:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638595968 00000100:00100000:3.0:1790945928.031854:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1790945928.031864:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638595968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790945928.031895:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790945928.031945:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638595968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945928.031952:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00080000:3.0:1790945928.031991:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bff7b800 x1877942638595968/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945944 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945928.032021:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638595968:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1790945928.032206:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790945928.034496:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bfef0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638596352:0@lo:400:kworker.0 00000100:00100000:0.0:1790945928.034564:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945928.034604:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1877942638596864:0@lo:400:kworker.0 00000100:00100000:0.0:1790945928.034628:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945928.034649:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83cd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1877942638597376:0@lo:400:kworker.0 00000100:00100000:0.0:1790945928.034667:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945928.034694:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1790945928.034700:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bfef0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877942638596224:0@lo:400:kworker.0 00000100:00100000:0.0:1790945928.034719:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945928.034738:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1877942638596736:0@lo:400:kworker.0 00000100:00100000:0.0:1790945928.034758:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945928.034786:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83cd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1877942638597248:0@lo:400:kworker.0 00000100:00100000:0.0:1790945928.034809:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945928.034841:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638596864 00000100:00100000:0.0:1790945928.034848:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638596864 00000100:00100000:0.0:1790945928.034893:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638597376 00000100:00100000:0.0:1790945928.034897:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638597376 00000100:00100000:0.0:1790945928.034911:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638596224 00000100:00100000:0.0:1790945928.034914:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638596224 00000100:00100000:0.0:1790945928.034924:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638596736 00000100:00100000:0.0:1790945928.034927:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638596736 00000100:00100000:0.0:1790945928.034937:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638597248 00000100:00100000:0.0:1790945928.034939:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638597248 00000100:00100000:0.0:1790945928.034972:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1790945928.034980:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1877942638596864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945928.034998:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1790945928.035005:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1877942638597376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945928.035027:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1877942638596864:12345-0@lo:400:kworker.0 Request processed in 48us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945928.035032:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1877942638597376:12345-0@lo:400:kworker.0 Request processed in 29us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945928.035034:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1790945928.035037:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1790945928.035050:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1790945928.035055:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1877942638596224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945928.035101:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bfef2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638596480:0@lo:400:kworker.0 00000100:00100000:2.0:1790945928.035132:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945928.035146:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83cd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638596992:0@lo:400:kworker.0 00000100:00100000:2.0:1790945928.035187:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945928.035205:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8301b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638597504:0@lo:400:kworker.0 00000100:00100000:2.0:1790945928.035226:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945928.035244:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1790945928.035250:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bfef2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638596096:0@lo:400:kworker.0 00000100:00100000:2.0:1790945928.035292:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945928.035316:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bfef1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638596608:0@lo:400:kworker.0 00000100:00100000:2.0:1790945928.035338:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945928.035356:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638597120:0@lo:400:kworker.0 00000100:00100000:2.0:1790945928.035376:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945928.035396:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638597632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790945928.035416:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945928.035441:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638596992 00000100:00100000:2.0:1790945928.035445:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638596992 00000100:00100000:2.0:1790945928.035468:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638597504 00000100:00100000:2.0:1790945928.035471:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638597504 00000100:00100000:2.0:1790945928.035492:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638597120 00000100:00100000:2.0:1790945928.035495:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638597120 00000100:00100000:2.0:1790945928.035508:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790945928.035513:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83deed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638596992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945928.035549:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83deed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638596992:12345-0@lo:400:kworker.0 Request processed in 36us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945928.035564:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790945928.035581:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790945928.035587:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83deea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638597504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945928.035617:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83deea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638597504:12345-0@lo:400:kworker.0 Request processed in 31us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945928.035623:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790945928.035634:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790945928.035640:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83dec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638597120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945928.035666:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83dec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638597120:12345-0@lo:400:kworker.0 Request processed in 26us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945928.035672:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790945928.035690:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638596096 00000100:00100000:2.0:1790945928.035693:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638596096 00000100:00100000:2.0:1790945928.035716:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1790945928.035722:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3649:x1877942638596096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945928.035750:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3649:x1877942638596096:12345-0@lo:400:kworker.0 Request processed in 28us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945928.035756:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1790945928.035803:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638596480 00000100:00100000:2.0:1790945928.035806:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638596480 00000100:00100000:1.0:1790945928.037003:0:11925:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638597632 00000100:00100000:1.0:1790945928.037017:0:11925:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638597632 00000100:00100000:1.0:1790945928.037070:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790945928.037080:0:11925:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ded180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638597632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790945928.037104:0:11925:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790945928.037212:0:11925:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ded180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638597632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (1793us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945928.037220:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:1.0:1790945928.037592:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790945928.037598:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790945928.037602:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790945928.037605:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790945928.039756:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1877942638596224:12345-0@lo:400:kworker.0 Request processed in 4694us (5029us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945928.041545:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1790945928.041572:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1877942638596736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945928.041659:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1877942638596736:12345-0@lo:400:kworker.0 Request processed in 101us (6900us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945928.041668:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1790945928.043461:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1790945928.043484:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1877942638597248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945928.043563:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1877942638597248:12345-0@lo:400:kworker.0 Request processed in 88us (8751us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945928.043570:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1790945928.043611:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638596352 00000100:00100000:3.0:1790945928.043619:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638596352 00000100:00100000:3.0:1790945928.043667:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638596608 00000100:00100000:3.0:1790945928.043671:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638596608 00000100:00100000:3.0:1790945928.043763:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1790945928.043771:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8301bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638596352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945928.043810:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8301bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638596352:12345-0@lo:400:kworker.0 Request processed in 40us (9246us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945928.043833:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1790945928.043846:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1790945928.043851:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638596608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945928.043887:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638596608:12345-0@lo:400:kworker.0 Request processed in 36us (8548us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945928.043892:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1790945928.043962:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bfef2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638596096:0@lo:400:kworker.0 00000100:00100000:3.0:1790945928.043976:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bfef1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638596608:0@lo:400:kworker.0 00000100:00100000:3.0:1790945928.043989:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638597120:0@lo:400:kworker.0 00010000:00080000:3.0:1790945928.044003:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bff7b800 x1877942638597632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945944 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945928.044020:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638597632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790945928.044033:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83cd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638596992:0@lo:400:kworker.0 00010000:00080000:3.0:1790945928.044043:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f8301b480 x1877942638597504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945928.044050:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8301b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638597504:0@lo:400:kworker.0 00000100:00100000:3.0:1790945928.044128:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bfef0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877942638596224:0@lo:400:kworker.0 00000100:00100000:3.0:1790945928.044139:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1877942638596736:0@lo:400:kworker.0 00000100:00100000:3.0:1790945928.044149:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83cd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1877942638597248:0@lo:400:kworker.0 00000100:00100000:3.0:1790945928.044158:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bfef0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638596352:0@lo:400:kworker.0 00010000:00080000:3.0:1790945928.044205:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f833f0000 x1877942638596864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945928.044214:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1877942638596864:0@lo:400:kworker.0 00010000:00080000:3.0:1790945928.044226:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f83cd6680 x1877942638597376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945928.044233:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83cd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1877942638597376:0@lo:400:kworker.0 00000100:00100000:2.0:1790945928.044738:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1790945928.044750:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638596480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945928.044832:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638596480:12345-0@lo:400:kworker.0 Request processed in 85us (9698us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945928.044838:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1790945928.044897:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bfef2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638596480:0@lo:400:kworker.0 00000100:00100000:0.0:1790945928.047733:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00010000:00010000:1.0:1790945928.672898:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945929.695509:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945930.079640:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638597760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790945930.079718:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945930.080271:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638597760 00000100:00100000:1.0:1790945930.080280:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638597760 00000100:00100000:1.0:1790945930.080349:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790945930.080373:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638597760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790945930.080405:0:8438:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790945930.080459:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638597760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945930.080467:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:0.0:1790945930.081159:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790945930.081223:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638597760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790945930.081255:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790945930.081263:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638597888:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790945930.081300:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945930.083824:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638597888 00000100:00100000:3.0:1790945930.083841:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638597888 00000100:00100000:3.0:1790945930.083934:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1790945930.083946:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638597888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790945930.083978:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790945930.084153:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638597888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 209us (2852us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945930.084161:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790945930.084206:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638597888:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1790945930.084473:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790945930.724012:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945931.615858:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790945931.620871:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638598016:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790945931.620973:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945931.621228:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638598016 00000100:00100000:3.0:1790945931.621238:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638598016 00000100:00100000:3.0:1790945931.621306:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1790945931.621317:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638598016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790945931.621375:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1790945931.621442:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638598016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945931.621451:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1790945931.621855:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638598016:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1790945931.743453:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945931.843461:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945931.843494:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945931.843530:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945931.843575:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616487680 00000100:00100000:3.0:1790945931.843585:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616487680 00000100:00100000:3.0:1790945931.843645:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616487552 00000100:00100000:3.0:1790945931.843648:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616487552 00000100:00100000:3.0:1790945931.843673:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 243 00000100:00100000:3.0:1790945931.843686:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2402:x1877942616487680:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790945931.843790:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2402:x1877942616487680:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 107us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945931.843799:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 243 00000100:00100000:3.0:1790945931.843819:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 244 00000100:00100000:3.0:1790945931.843826:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2402:x1877942616487552:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790945931.843867:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2402:x1877942616487552:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 41us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945931.843873:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 244 00000100:00100000:2.0:1790945931.844498:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616487424 00000100:00100000:2.0:1790945931.844513:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616487424 00000100:00100000:2.0:1790945931.844565:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 373 00000100:00100000:2.0:1790945931.844573:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:2402:x1877942616487424:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790945931.844634:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:2402:x1877942616487424:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 61us (1194us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945931.844641:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 373 00000100:00080000:0.0:1790945931.845273:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790945931.845280:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790945931.868650:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945931.868696:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945931.868731:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945931.868832:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616487808 00000100:00100000:2.0:1790945931.868842:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616487808 00000100:00100000:2.0:1790945931.868929:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 27 00000100:00100000:2.0:1790945931.868942:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2400:x1877942616487808:12345-192.168.204.20@tcp:9:kworker.0 00000020:00000080:2.0:1790945931.868981:0:8435:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27d34b 00000100:00080000:2.0:1790945931.868991:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9d3f83d26000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790945931.869056:0:8435:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:2.0:1790945931.869316:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+2:2400:x1877942616487808:12345-192.168.204.20@tcp:9:kworker.0 Request processed in 377us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945931.869325:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 27 00000100:00100000:0.0:1790945931.869640:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616487936 00000100:00100000:0.0:1790945931.869646:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616487936 00000100:00100000:0.0:1790945931.869692:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616488064 00000100:00100000:0.0:1790945931.869696:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616488064 00000100:00100000:0.0:1790945931.869717:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 245 00000100:00100000:0.0:1790945931.869724:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2401:x1877942616487936:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790945931.869779:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2401:x1877942616487936:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 55us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945931.869786:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 245 00000100:00100000:0.0:1790945931.869798:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 246 00000100:00100000:0.0:1790945931.869804:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2401:x1877942616488064:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790945931.869829:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2401:x1877942616488064:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 26us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945931.869836:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 246 00010000:00010000:1.0:1790945931.869964:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790945931.870024:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790945931.870028:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790945931.870031:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790945932.127471:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790945932.133383:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638598144:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790945932.133663:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945932.135989:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638598144 00000100:00100000:3.0:1790945932.136007:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638598144 00000100:00100000:3.0:1790945932.136094:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1790945932.136106:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638598144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790945932.136146:0:6526:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790945932.136419:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638598144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 315us (2756us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945932.136444:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1790945932.137115:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638598144:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1790945932.767458:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945933.151657:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638598400:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790945933.151743:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945933.151834:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790945933.151842:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638598272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790945933.151867:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945933.152007:0:11925:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638598400 00000100:00100000:2.0:1790945933.152016:0:11925:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638598400 00000100:00100000:2.0:1790945933.152076:0:11925:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638598272 00000100:00100000:2.0:1790945933.152079:0:11925:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638598272 00000100:00100000:2.0:1790945933.152098:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1790945933.152107:0:11925:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638598400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790945933.152135:0:11925:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790945933.152221:0:11925:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638598400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 115us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945933.152228:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1790945933.152248:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790945933.152255:0:11925:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638598272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790945933.152268:0:11925:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790945933.152292:0:11925:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638598272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945933.152297:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790945933.152517:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877942638598656:0@lo:400:kworker.0 00000100:00100000:2.0:1790945933.152547:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945933.152566:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83647480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1877942638599168:0@lo:400:kworker.0 00000100:00100000:2.0:1790945933.152587:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945933.152605:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83645f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1877942638599680:0@lo:400:kworker.0 00000100:00100000:2.0:1790945933.152626:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945933.152650:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1790945933.152656:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638598528:0@lo:400:kworker.0 00000100:00100000:2.0:1790945933.152684:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945933.152704:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83647b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638599040:0@lo:400:kworker.0 00000100:00100000:2.0:1790945933.152741:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945933.152758:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83647100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638599552:0@lo:400:kworker.0 00000100:00100000:2.0:1790945933.152780:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945933.152803:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638598784:0@lo:400:kworker.0 00000100:00100000:2.0:1790945933.152843:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945933.152861:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83644e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1877942638599296:0@lo:400:kworker.0 00000100:00100000:2.0:1790945933.152881:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945933.152894:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83647800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1877942638599808:0@lo:400:kworker.0 00000100:00100000:2.0:1790945933.152909:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945933.152924:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1790945933.152928:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1877942638598912:0@lo:400:kworker.0 00000100:00100000:2.0:1790945933.152945:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945933.152954:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83645c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638599424:0@lo:400:kworker.0 00000100:00100000:2.0:1790945933.152970:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945933.152992:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638598656 00000100:00100000:2.0:1790945933.152995:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638598656 00000100:00100000:2.0:1790945933.153016:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638599168 00000100:00100000:2.0:1790945933.153018:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638599168 00000100:00100000:2.0:1790945933.153027:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638599680 00000100:00100000:2.0:1790945933.153029:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638599680 00000100:00100000:2.0:1790945933.153039:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638599296 00000100:00100000:2.0:1790945933.153041:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638599296 00000100:00100000:2.0:1790945933.153049:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638599808 00000100:00100000:2.0:1790945933.153051:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638599808 00000100:00100000:2.0:1790945933.153061:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638598912 00000100:00100000:2.0:1790945933.153063:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638598912 00000100:00100000:2.0:1790945933.153073:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1790945933.153079:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877942638598656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945933.153123:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877942638598656:12345-0@lo:400:kworker.0 Request processed in 44us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945933.153130:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1790945933.153145:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1790945933.153150:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877942638599168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945933.153209:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877942638599168:12345-0@lo:400:kworker.0 Request processed in 59us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945933.153216:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1790945933.153228:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1790945933.153235:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877942638599680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945933.153264:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877942638599680:12345-0@lo:400:kworker.0 Request processed in 30us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945933.153269:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1790945933.153280:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1790945933.153286:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1877942638599296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945933.153317:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1877942638599296:12345-0@lo:400:kworker.0 Request processed in 31us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945933.153322:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1790945933.153334:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1790945933.153340:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1877942638599808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945933.153367:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1877942638599808:12345-0@lo:400:kworker.0 Request processed in 28us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945933.153373:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1790945933.153391:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1790945933.153396:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1877942638598912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945933.153430:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1877942638598912:12345-0@lo:400:kworker.0 Request processed in 34us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945933.153435:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1790945933.153471:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1877942638598912:0@lo:400:kworker.0 00010000:00080000:2.0:1790945933.153484:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f83644e00 x1877942638599296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945933.153493:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83644e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1877942638599296:0@lo:400:kworker.0 00010000:00080000:2.0:1790945933.153502:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f83647800 x1877942638599808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945933.153509:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83647800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1877942638599808:0@lo:400:kworker.0 00000100:00100000:2.0:1790945933.153538:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877942638598656:0@lo:400:kworker.0 00000100:00100000:2.0:1790945933.153548:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83647480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1877942638599168:0@lo:400:kworker.0 00000100:00100000:2.0:1790945933.153556:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83645f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1877942638599680:0@lo:400:kworker.0 00000100:00100000:0.0:1790945933.153707:0:12418:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638599040 00000100:00100000:0.0:1790945933.153712:0:12418:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638599040 00000100:00100000:0.0:1790945933.153751:0:12418:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638598784 00000100:00100000:0.0:1790945933.153754:0:12418:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638598784 00000100:00100000:0.0:1790945933.153770:0:12418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1790945933.153777:0:12418:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638599040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945933.153833:0:12418:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638599040:12345-0@lo:400:kworker.0 Request processed in 57us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945933.153839:0:12418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1790945933.153851:0:12418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1790945933.153856:0:12418:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638598784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945933.153890:0:12418:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638598784:12345-0@lo:400:kworker.0 Request processed in 34us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945933.153896:0:12418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1790945933.153923:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638598784:0@lo:400:kworker.0 00000100:00080000:1.0:1790945933.154049:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790945933.154055:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790945933.154058:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790945933.154080:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638599552 00000100:00100000:1.0:1790945933.154085:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638599552 00000100:00100000:1.0:1790945933.154126:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638599424 00000100:00100000:1.0:1790945933.154129:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638599424 00000100:00100000:1.0:1790945933.154148:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1790945933.154154:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638599552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945933.154229:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638599552:12345-0@lo:400:kworker.0 Request processed in 75us (1448us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945933.154236:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1790945933.154248:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1790945933.154253:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638599424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945933.154285:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638599424:12345-0@lo:400:kworker.0 Request processed in 32us (1313us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945933.154290:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:1.0:1790945933.154318:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bff79c00 x1877942638598272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945949 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945933.154333:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638598272:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1790945933.154344:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f83defb80 x1877942638598400/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945949 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945933.154355:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638598400:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790945933.154445:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638598528 00000100:00100000:3.0:1790945933.154449:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638598528 00000100:00100000:3.0:1790945933.154486:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1790945933.154494:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3650:x1877942638598528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945933.154530:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3650:x1877942638598528:12345-0@lo:400:kworker.0 Request processed in 36us (1844us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945933.154536:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1790945933.156008:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638598528:0@lo:400:kworker.0 00000100:00100000:2.0:1790945933.156026:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83647b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638599040:0@lo:400:kworker.0 00000100:00100000:2.0:1790945933.156038:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83647100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638599552:0@lo:400:kworker.0 00000100:00080000:0.0:1790945933.156218:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790945933.156246:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83645c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638599424:0@lo:400:kworker.0 00010000:00010000:1.0:1790945933.791389:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945934.816387:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945935.200427:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790945935.200444:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638599936:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790945935.200503:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945935.200638:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638600064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790945935.200658:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945935.200701:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638599936 00000100:00100000:1.0:1790945935.200711:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638599936 00000100:00100000:2.0:1790945935.200745:0:11925:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638600064 00000100:00100000:2.0:1790945935.200753:0:11925:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638600064 00000100:00100000:1.0:1790945935.200775:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790945935.200787:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638599936:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790945935.200788:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1790945935.200794:0:11925:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 3 min 2 max 16 00000100:00100000:3.0:1790945935.200797:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638600064:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790945935.200806:0:11925:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_003' 00002000:00000024:1.0:1790945935.200822:0:8438:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:3.0:1790945935.200832:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790945935.200874:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638600064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945935.200876:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638599936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945935.200882:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790945935.200886:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:1.0:1790945935.200907:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790945935.200933:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638600064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790945935.200963:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638599936:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1790945935.840592:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790945936.544844:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1790945936.609882:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790945936.735562:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f835e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638600192:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790945936.735691:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945936.735877:0:12418:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638600192 00000100:00100000:2.0:1790945936.735886:0:12418:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638600192 00000100:00100000:2.0:1790945936.735944:0:12418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1790945936.735954:0:12418:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638600192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790945936.735989:0:12418:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1790945936.736059:0:12418:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638600192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945936.736067:0:12418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1790945936.736140:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f835e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638600192:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1790945936.865128:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945936.967405:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945936.967451:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945936.967473:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945936.967490:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945936.967517:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945936.967548:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616488448 00000100:00100000:1.0:1790945936.967558:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616488448 00000100:00100000:1.0:1790945936.967626:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616488704 00000100:00100000:1.0:1790945936.967630:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616488704 00000100:00100000:1.0:1790945936.967645:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616488320 00000100:00100000:1.0:1790945936.967647:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616488320 00000100:00100000:1.0:1790945936.967659:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616488576 00000100:00100000:1.0:1790945936.967661:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616488576 00000100:00100000:1.0:1790945936.967678:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 253 00000100:00100000:1.0:1790945936.967688:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2404:x1877942616488448:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945936.967881:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2404:x1877942616488448:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 194us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945936.967902:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 253 00000100:00100000:1.0:1790945936.967922:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 254 00000100:00100000:1.0:1790945936.967929:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2404:x1877942616488704:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945936.967959:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2404:x1877942616488704:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 30us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945936.967965:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 254 00000100:00100000:1.0:1790945936.967977:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 255 00000100:00100000:1.0:1790945936.967983:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4db1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2404:x1877942616488320:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945936.968006:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4db1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2404:x1877942616488320:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 24us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945936.968011:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 255 00000100:00100000:1.0:1790945936.968022:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 256 00000100:00100000:1.0:1790945936.968028:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4db0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2404:x1877942616488576:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945936.968049:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4db0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2404:x1877942616488576:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 21us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945936.968055:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 256 00000100:00080000:1.0:1790945936.968077:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790945936.968080:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790945936.968421:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616488192 00000100:00100000:3.0:1790945936.968432:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616488192 00000100:00100000:3.0:1790945936.968475:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 375 00000100:00100000:3.0:1790945936.968482:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a714d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:2404:x1877942616488192:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790945936.968835:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a714d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:2404:x1877942616488192:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 353us (1440us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945936.968843:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 375 00000100:00100000:0.0:1790945937.250752:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638600320:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790945937.250832:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945937.250947:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638600320 00000100:00100000:0.0:1790945937.250957:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638600320 00000100:00100000:0.0:1790945937.251013:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1790945937.251022:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638600320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790945937.251056:0:6526:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790945937.251140:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638600320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945937.251148:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1790945937.251206:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638600320:0@lo:41:osp-pre-1-0.0 00000001:00100000:2.0:1790945937.253592:0:8429:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0cadc7a5-c0ba-4320-984f-d871ffb3a3ef 00000020:00000080:2.0:1790945937.253600:0:8429:0:(genops.c:885:class_export_put()) final put ffff9d3f83d22000/0cadc7a5-c0ba-4320-984f-d871ffb3a3ef 00000020:00000080:0.0:1790945937.254475:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f83d22000/0cadc7a5-c0ba-4320-984f-d871ffb3a3ef for lustre-OST0000 00000020:00000080:0.0:1790945937.254537:0:1365:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d3f83d26000 for lustre-OST0000 00010000:00010000:1.0:1790945937.887821:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945938.271438:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790945938.271465:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f835e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638600448:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790945938.271557:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4db2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638600576:0@lo:400:kworker.0 00000100:00100000:2.0:1790945938.271587:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945938.271606:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945938.271653:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638600832:0@lo:400:kworker.0 00000100:00100000:2.0:1790945938.271694:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945938.271713:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1877942638601344:0@lo:400:kworker.0 00000100:00100000:2.0:1790945938.271736:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945938.271779:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1877942638601856:0@lo:400:kworker.0 00000100:00100000:2.0:1790945938.271801:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945938.271824:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1790945938.271830:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1877942638600960:0@lo:400:kworker.0 00000100:00100000:2.0:1790945938.271866:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945938.271883:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638601472:0@lo:400:kworker.0 00000100:00100000:2.0:1790945938.271919:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945938.271951:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638601984:0@lo:400:kworker.0 00000100:00100000:2.0:1790945938.271971:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945938.271999:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638600832 00000100:00100000:2.0:1790945938.272007:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638600832 00000100:00100000:2.0:1790945938.272053:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1790945938.272062:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638600832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945938.272133:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638600832:12345-0@lo:400:kworker.0 Request processed in 71us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945938.272141:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1790945938.272192:0:8436:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638601472 00000100:00100000:2.0:1790945938.272196:0:8436:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638601472 00000100:00100000:2.0:1790945938.272229:0:8436:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638601984 00000100:00100000:2.0:1790945938.272232:0:8436:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638601984 00000100:00100000:2.0:1790945938.272251:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1790945938.272257:0:8436:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83647800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638601472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945938.272288:0:8436:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83647800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638601472:12345-0@lo:400:kworker.0 Request processed in 31us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945938.272294:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1790945938.272306:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790945938.272311:0:8436:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83644e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638601984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945938.272338:0:8436:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83644e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638601984:12345-0@lo:400:kworker.0 Request processed in 27us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945938.272343:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790945938.272382:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638601472:0@lo:400:kworker.0 00010000:00080000:2.0:1790945938.272395:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcbbc380 x1877942638601984/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945938.272415:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638601984:0@lo:400:kworker.0 00000100:00100000:2.0:1790945938.272427:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638600832:0@lo:400:kworker.0 00000100:00100000:2.0:1790945938.272481:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638601344 00000100:00100000:2.0:1790945938.272485:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638601344 00000100:00100000:2.0:1790945938.272512:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638601856 00000100:00100000:2.0:1790945938.272514:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638601856 00000100:00100000:2.0:1790945938.272529:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638600960 00000100:00100000:2.0:1790945938.272532:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638600960 00000100:00100000:2.0:1790945938.272543:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1790945938.272549:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83647b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1877942638601344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945938.272584:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83647b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1877942638601344:12345-0@lo:400:kworker.0 Request processed in 35us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945938.272590:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1790945938.272602:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1790945938.272609:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1877942638601856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945938.272634:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1877942638601856:12345-0@lo:400:kworker.0 Request processed in 26us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945938.272639:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1790945938.272650:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1790945938.272656:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83647480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1877942638600960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945938.272681:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83647480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1877942638600960:12345-0@lo:400:kworker.0 Request processed in 26us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945938.272686:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1790945938.272703:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638600576 00000100:00100000:2.0:1790945938.272706:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638600576 00000100:00100000:2.0:1790945938.272736:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1790945938.272741:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408397d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3649:x1877942638600576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945938.272769:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408397d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3649:x1877942638600576:12345-0@lo:400:kworker.0 Request processed in 29us (1166us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945938.272775:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1790945938.272801:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638600448 00000100:00100000:2.0:1790945938.272804:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638600448 00000100:00100000:2.0:1790945938.272825:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1790945938.272831:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83645c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638600448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790945938.272850:0:8438:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790945938.272880:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83645c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638600448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (1295us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945938.272886:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1790945938.272905:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877942638600704:0@lo:400:kworker.0 00000100:00100000:2.0:1790945938.272929:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945938.272948:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1877942638601216:0@lo:400:kworker.0 00000100:00100000:2.0:1790945938.272968:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945938.272978:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1877942638601728:0@lo:400:kworker.0 00000100:00100000:2.0:1790945938.272996:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945938.273017:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638600704 00000100:00100000:2.0:1790945938.273020:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638600704 00000100:00100000:2.0:1790945938.273034:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638601216 00000100:00100000:2.0:1790945938.273035:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638601216 00000100:00100000:2.0:1790945938.273045:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638601728 00000100:00100000:2.0:1790945938.273047:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638601728 00000100:00100000:2.0:1790945938.273057:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1790945938.273062:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877942638600704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945938.273116:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877942638600704:12345-0@lo:400:kworker.0 Request processed in 52us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945938.273121:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1790945938.273133:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1790945938.273139:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877942638601216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945938.273165:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877942638601216:12345-0@lo:400:kworker.0 Request processed in 27us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945938.273203:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1790945938.273215:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1790945938.273221:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877942638601728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945938.273246:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877942638601728:12345-0@lo:400:kworker.0 Request processed in 26us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945938.273251:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1790945938.273279:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877942638600704:0@lo:400:kworker.0 00000100:00100000:2.0:1790945938.273289:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1877942638601216:0@lo:400:kworker.0 00000100:00100000:2.0:1790945938.273296:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1877942638601728:0@lo:400:kworker.0 00000100:00100000:2.0:1790945938.273324:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1877942638600960:0@lo:400:kworker.0 00010000:00080000:2.0:1790945938.273335:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcbbdc00 x1877942638601344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945938.273344:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1877942638601344:0@lo:400:kworker.0 00010000:00080000:2.0:1790945938.273355:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcbbca80 x1877942638601856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945938.273375:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1877942638601856:0@lo:400:kworker.0 00010000:00080000:2.0:1790945938.273387:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f835e8000 x1877942638600448/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945954 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945938.273399:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f835e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638600448:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1790945938.273460:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790945938.273464:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790945938.273466:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790945938.273468:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790945938.276758:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4db2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638600576:0@lo:400:kworker.0 00000100:00100000:1.0:1790945938.276775:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638601088:0@lo:400:kworker.0 00000100:00100000:1.0:1790945938.276869:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945938.277003:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638601600:0@lo:400:kworker.0 00000100:00100000:1.0:1790945938.277028:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945938.277047:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638602112:0@lo:400:kworker.0 00000100:00100000:0.0:1790945938.277052:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638601088 00000100:00100000:0.0:1790945938.277061:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638601088 00000100:00100000:1.0:1790945938.277067:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945938.277113:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790945938.277121:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638602240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790945938.277128:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1790945938.277139:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638601088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945938.277147:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945938.277191:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638601600 00000100:00100000:1.0:1790945938.277195:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638601600 00000100:00100000:1.0:1790945938.277235:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638602112 00000100:00100000:1.0:1790945938.277240:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638602112 00000100:00100000:0.0:1790945938.277240:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638601088:12345-0@lo:400:kworker.0 Request processed in 101us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945938.277250:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1790945938.277267:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790945938.277275:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638601600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945938.277305:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638601600:12345-0@lo:400:kworker.0 Request processed in 32us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945938.277311:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790945938.277323:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790945938.277328:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638602112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945938.277349:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638602112:12345-0@lo:400:kworker.0 Request processed in 22us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945938.277354:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790945938.277372:0:11925:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638602240 00000100:00100000:1.0:1790945938.277375:0:11925:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638602240 00000100:00100000:1.0:1790945938.277397:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1790945938.277403:0:11925:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638602240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790945938.277426:0:11925:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790945938.277459:0:11925:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638602240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945938.277465:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:0.0:1790945938.277469:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790945938.277475:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790945938.277505:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bff7b480 x1877942638602240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945954 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945938.277524:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638602240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790945938.277547:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638601088:0@lo:400:kworker.0 00000100:00100000:0.0:1790945938.277556:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638601600:0@lo:400:kworker.0 00010000:00080000:0.0:1790945938.277565:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bcbbdf80 x1877942638602112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945938.277572:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638602112:0@lo:400:kworker.0 00010000:00010000:2.0:1790945938.913398:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790945939.252925:0:14064:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 08:58:58 (1790945938) 00010000:00010000:1.0:1790945939.935775:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945940.319410:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638602368:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790945940.319488:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945940.319611:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638602368 00000100:00100000:0.0:1790945940.319621:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638602368 00000100:00100000:0.0:1790945940.319697:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1790945940.319707:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638602368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790945940.319738:0:8438:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1790945940.319882:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790945940.319899:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638602496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790945940.319927:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945940.319978:0:11925:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638602496 00000100:00100000:3.0:1790945940.319983:0:11925:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638602496 00000100:00100000:3.0:1790945940.320013:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1790945940.320019:0:11925:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638602496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790945940.320030:0:11925:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790945940.320071:0:11925:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638602496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945940.320078:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:3.0:1790945940.320096:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790945940.320131:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638602496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790945940.325348:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638602368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5631us (5847us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945940.325366:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1790945940.325498:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638602368:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790945940.766326:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945940.766438:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616488832 00000100:00100000:2.0:1790945940.766449:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616488832 00000100:00080000:3.0:1790945940.766542:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790945940.766583:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 40 00000100:00100000:2.0:1790945940.766594:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:11053:x1877942616488832:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790945940.766613:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945940.766699:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27d42b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330ae9 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.766768:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27d432 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.766783:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27d432 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.766814:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27d432 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945940.766884:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790945940.766888:0:6523:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790945940.766925:0:6523:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27d432 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.766949:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27d42b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ae9 expref: 7 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.766967:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27d432 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ae9 expref: 6 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.766975:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3f824ec500) 00010000:00010000:2.0:1790945940.766978:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790945940.766981:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f8363c600, rc 0) 00000100:00100000:2.0:1790945940.767052:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:11053:x1877942616488832:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 460us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945940.767059:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 40 00000100:00100000:1.0:1790945940.780933:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945940.781070:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616488960 00000100:00100000:2.0:1790945940.781080:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616488960 00000100:00100000:2.0:1790945940.781143:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 41 00000100:00100000:2.0:1790945940.781154:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:11054:x1877942616488960:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790945940.781204:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945940.781224:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27d439 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330af0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.781302:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d440 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.781316:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d440 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.781326:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d440 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.781339:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d447 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.781345:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d447 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.781351:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d447 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.781407:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d200/0xd9f4181e0d27d44e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.781415:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d200/0xd9f4181e0d27d44e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.781421:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d200/0xd9f4181e0d27d44e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945940.781459:0:6522:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790945940.781462:0:6522:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790945940.781494:0:6522:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d200/0xd9f4181e0d27d44e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.781514:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d440 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.781520:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d440 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.781526:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d440 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.781531:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f8363ce00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945940.781535:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d440 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.781543:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d440 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.781553:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3f824ec500) 00010000:00010000:2.0:1790945940.781555:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945940.781559:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d440 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.781564:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d440 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.781577:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d447 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.781583:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d447 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.781588:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d447 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.781599:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f8363da00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945940.781601:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d447 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.781606:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d447 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.781613:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9d3f824ec900) 00010000:00010000:2.0:1790945940.781615:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945940.781617:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d447 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.781622:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d447 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.781653:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27d439 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330af0 expref: 8 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.781665:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d200/0xd9f4181e0d27d44e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330af0 expref: 7 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.781671:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d3f824ecd00) 00010000:00010000:2.0:1790945940.781674:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790945940.781676:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f8363d200, rc 0) 00000100:00100000:2.0:1790945940.782332:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:11054:x1877942616488960:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 1178us (1405us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945940.782340:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 41 00000100:00100000:1.0:1790945940.789580:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945940.789667:0:6533:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616489088 00000100:00100000:2.0:1790945940.789688:0:6533:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616489088 00000100:00100000:2.0:1790945940.789760:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:2.0:1790945940.789770:0:6533:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:11054:x1877942616489088:12345-192.168.204.20@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1790945940.789871:0:6533:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:11054:x1877942616489088:12345-192.168.204.20@tcp:900:lhsmtool_posix.0 Request processed in 103us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945940.789879:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:3.0:1790945940.801926:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945940.802910:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616489344 00000100:00100000:2.0:1790945940.802923:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616489344 00000100:00100000:2.0:1790945940.802993:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 42 00000100:00100000:2.0:1790945940.803015:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:11054:x1877942616489344:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790945940.803047:0:8457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945940.803068:0:8457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27d455 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330af7 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.803141:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d45c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.803203:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d45c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.803215:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d45c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.803355:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d463 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.803365:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d463 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.803372:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d463 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.803490:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363dc00/0xd9f4181e0d27d46a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.803499:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363dc00/0xd9f4181e0d27d46a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.803505:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363dc00/0xd9f4181e0d27d46a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945940.803514:0:8457:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1790945940.803596:0:8457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d45c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.803604:0:8457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d45c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.803610:0:8457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d45c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.803616:0:8457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f8363da00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945940.803621:0:8457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d45c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.803628:0:8457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d45c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.803640:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d3f824ecd00) 00010000:00010000:2.0:1790945940.803643:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945940.803647:0:8457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d45c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.803664:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d45c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.803678:0:8457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d463 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.803684:0:8457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d463 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.803689:0:8457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d463 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.803694:0:8457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f8363ce00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945940.803697:0:8457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d463 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.803702:0:8457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d463 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.803709:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9d3f824ec900) 00010000:00010000:2.0:1790945940.803712:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945940.803715:0:8457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d463 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.803721:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d463 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.805149:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27d455 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330af7 expref: 10 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.805211:0:8457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363dc00/0xd9f4181e0d27d46a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330af7 expref: 9 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945940.805229:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3f824ec400) 00010000:00010000:2.0:1790945940.805231:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945940.805234:0:8457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f8363dc00, rc 0) 00000100:00100000:2.0:1790945940.805376:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+9:11054:x1877942616489344:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 2362us (3459us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1790945940.805384:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 42 00000100:00100000:1.0:1790945940.814503:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945940.814626:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616489472 00000100:00100000:2.0:1790945940.814636:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616489472 00000100:00100000:2.0:1790945940.814705:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 43 00000100:00100000:2.0:1790945940.814715:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+9:11054:x1877942616489472:12345-192.168.204.20@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1790945940.814822:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+9:11054:x1877942616489472:12345-192.168.204.20@tcp:59:lhsmtool_posix.0 Request processed in 109us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945940.814830:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 43 00000100:00100000:1.0:1790945940.818686:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945940.818918:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616489600 00000100:00100000:2.0:1790945940.818928:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616489600 00000100:00100000:2.0:1790945940.819010:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 44 00000100:00100000:2.0:1790945940.819022:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:11054:x1877942616489600:12345-192.168.204.20@tcp:59:lhsmtool_posix.0 00000100:00080000:3.0:1790945940.819518:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:2.0:1790945940.822341:0:6522:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3265us 00000100:00100000:1.0:1790945940.839630:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:11054:x1877942616489600:12345-192.168.204.20@tcp:59:lhsmtool_posix.0 Request processed in 20600us (20952us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945940.839646:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 44 00010000:00010000:1.0:1790945940.959562:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790945941.667969:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1790945941.743257:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790945941.856309:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790945941.856331:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638602624:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790945941.856395:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945941.856478:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638602624 00000100:00100000:3.0:1790945941.856486:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638602624 00000100:00100000:3.0:1790945941.856533:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1790945941.856541:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638602624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790945941.856573:0:6526:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1790945941.856618:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638602624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945941.856624:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1790945941.857017:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638602624:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1790945941.985532:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945942.085578:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945942.085751:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945942.085777:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945942.085797:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945942.086039:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945942.086064:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616489856 00000100:00100000:2.0:1790945942.086074:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616489856 00000100:00100000:2.0:1790945942.086126:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616490112 00000100:00100000:2.0:1790945942.086129:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616490112 00000100:00100000:2.0:1790945942.086144:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616489984 00000100:00100000:2.0:1790945942.086147:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616489984 00000100:00100000:2.0:1790945942.086159:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616490240 00000100:00100000:2.0:1790945942.086161:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616490240 00000100:00100000:2.0:1790945942.086330:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 263 00000100:00100000:2.0:1790945942.086340:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+9:2401:x1877942616489856:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790945942.086416:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+9:2401:x1877942616489856:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 76us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945942.086425:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 263 00000100:00100000:2.0:1790945942.086446:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 264 00000100:00100000:2.0:1790945942.086452:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2402:x1877942616490112:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790945942.086477:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2402:x1877942616490112:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 25us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945942.086483:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 264 00000100:00100000:2.0:1790945942.086495:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 265 00000100:00100000:2.0:1790945942.086500:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2402:x1877942616489984:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790945942.086549:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616489728 00000100:00100000:3.0:1790945942.086556:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616489728 00000100:00100000:3.0:1790945942.086592:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 377 00000100:00100000:3.0:1790945942.086599:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408397fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:2401:x1877942616489728:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790945942.086628:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408397fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:2401:x1877942616489728:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 30us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945942.086634:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 377 00000100:00080000:3.0:1790945942.086661:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790945942.086666:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790945942.087020:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2402:x1877942616489984:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 518us (1220us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945942.087029:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 265 00000100:00100000:2.0:1790945942.087046:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 266 00000100:00100000:2.0:1790945942.087054:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2402:x1877942616490240:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790945942.087090:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2402:x1877942616490240:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 38us (1052us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945942.087097:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 266 00000100:00100000:0.0:1790945942.367393:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcbbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638602752:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790945942.367466:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945942.367577:0:12418:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638602752 00000100:00100000:1.0:1790945942.367585:0:12418:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638602752 00000100:00100000:1.0:1790945942.367655:0:12418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1790945942.367666:0:12418:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638602752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790945942.367698:0:12418:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790945942.367854:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcbbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638602752:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790945942.367959:0:12418:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638602752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 294us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945942.367967:0:12418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1790945942.594969:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945942.595073:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616490368 00000100:00100000:2.0:1790945942.595084:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616490368 00000100:00100000:2.0:1790945942.595151:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 45 00000100:00100000:2.0:1790945942.595161:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+9:11096:x1877942616490368:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1790945942.595215:0:13005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945942.595235:0:13005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d478 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330afe expref: -99 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945942.595304:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27d47f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945942.595320:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27d47f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945942.595335:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27d47f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945942.595348:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c400/0xd9f4181e0d27d486 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945942.595355:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c400/0xd9f4181e0d27d486 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945942.595361:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c400/0xd9f4181e0d27d486 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945942.595405:0:13005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27d47f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945942.595420:0:13005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27d47f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945942.595428:0:13005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27d47f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945942.595435:0:13005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f8363ca00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945942.595440:0:13005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27d47f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945942.595448:0:13005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27d47f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945942.595460:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3f824ec500) 00010000:00010000:2.0:1790945942.595463:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945942.595469:0:13005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27d47f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945942.595474:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27d47f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945942.595487:0:13005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c400/0xd9f4181e0d27d486 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945942.595494:0:13005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c400/0xd9f4181e0d27d486 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945942.595513:0:13005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c400/0xd9f4181e0d27d486 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945942.595519:0:13005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f8363c400 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945942.595529:0:13005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c400/0xd9f4181e0d27d486 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945942.595536:0:13005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c400/0xd9f4181e0d27d486 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945942.595544:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9d3f824ef800) 00010000:00010000:2.0:1790945942.595546:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945942.595549:0:13005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c400/0xd9f4181e0d27d486 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945942.595554:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c400/0xd9f4181e0d27d486 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945942.595593:0:13005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d478 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330afe expref: 10 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945942.595603:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3f824ec500) 00010000:00010000:2.0:1790945942.595605:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945942.595609:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d478 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330afe expref: 10 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945942.595617:0:13005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f8363d400, rc 0) 00000100:00100000:2.0:1790945942.595683:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+9:11096:x1877942616490368:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 523us (724us total) trans 0 rc 301/301 00000100:00100000:2.0:1790945942.595690:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 45 00000100:00100000:1.0:1790945942.603064:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945942.603205:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616490624 00000100:00100000:0.0:1790945942.603216:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616490624 00000100:00100000:0.0:1790945942.603268:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 46 00000100:00100000:0.0:1790945942.603276:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4db2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+9:11096:x1877942616490624:12345-192.168.204.20@tcp:36:lfs.0 00010000:00010000:0.0:1790945942.603338:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945942.603364:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27d432 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ae9 expref: 9 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.603399:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3f824ec500) 00010000:00010000:0.0:1790945942.603413:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790945942.603483:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27d48d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.605790:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27d48d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.605915:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27d48d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.605943:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27d494 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.605955:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27d494 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.605962:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27d494 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.607132:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27d49b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.607151:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27d49b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.607161:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27d49b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790945942.607241:0:8457:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005b6effa8 reply state 00000000d932c8c5 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27d49b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.607277:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27d49b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.607286:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d40bc9ad200) 00010000:00010000:0.0:1790945942.607289:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790945942.607295:0:8457:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1790945942.607303:0:8457:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1790945942.607314:0:8457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27d48d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.607322:0:8457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27d48d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.607329:0:8457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27d48d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.607336:0:8457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe1800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945942.607341:0:8457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27d48d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.607349:0:8457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27d48d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.607358:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d40bc9ad600) 00010000:00010000:0.0:1790945942.607361:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945942.607365:0:8457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27d48d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.607371:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27d48d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790945942.607471:0:8457:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005b6effa8 reply state 00000000d932c8c5 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27d494 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.607482:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27d494 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.607488:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9d40bc9ad100) 00010000:00010000:0.0:1790945942.607491:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790945942.607493:0:8457:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1790945942.607613:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4db2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+10:11096:x1877942616490624:12345-192.168.204.20@tcp:36:lfs.0 Request processed in 4332us (4551us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1790945942.607622:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 46 00000100:00100000:0.0:1790945942.705326:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945942.705437:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616490752 00000100:00100000:2.0:1790945942.705447:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616490752 00000100:00100000:2.0:1790945942.705556:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 47 00000100:00100000:2.0:1790945942.705567:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+10:11104:x1877942616490752:12345-192.168.204.20@tcp:101:lctl.0 00010000:00010000:2.0:1790945942.705607:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945942.705632:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d4a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330b05 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945942.705708:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c400/0xd9f4181e0d27d4a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945942.705723:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c400/0xd9f4181e0d27d4a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945942.705735:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c400/0xd9f4181e0d27d4a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945942.705788:0:6521:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790945942.705792:0:6521:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790945942.705833:0:6521:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c400/0xd9f4181e0d27d4a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945942.705860:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d4a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b05 expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945942.705880:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c400/0xd9f4181e0d27d4a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b05 expref: 11 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945942.705889:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3f824ef800) 00010000:00010000:2.0:1790945942.705892:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790945942.705896:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f8363c400, rc 0) 00000100:00100000:2.0:1790945942.705968:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+11:11104:x1877942616490752:12345-192.168.204.20@tcp:101:lctl.0 Request processed in 403us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945942.705975:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 47 00000100:00100000:1.0:1790945942.778758:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945942.781729:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616490880 00000100:00100000:2.0:1790945942.781751:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616490880 00000100:00100000:3.0:1790945942.781969:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 48 00000100:00100000:3.0:1790945942.781979:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+11:11110:x1877942616490880:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:3.0:1790945942.782013:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945942.782034:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27d4b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330b0c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945942.782099:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27d4b7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945942.782131:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27d4b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945942.782144:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27d4b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945942.782156:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d4be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945942.782164:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d4be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945942.782190:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d4be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945942.782275:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030200/0xd9f4181e0d27d4c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945942.782283:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030200/0xd9f4181e0d27d4c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945942.782290:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030200/0xd9f4181e0d27d4c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945942.782325:0:6522:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1790945942.782329:0:6522:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790945942.782368:0:6522:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030200/0xd9f4181e0d27d4c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945942.782381:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27d4b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945942.782398:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27d4b7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945942.782405:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27d4b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945942.782410:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40813fea00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945942.782415:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27d4b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945942.782422:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27d4b7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945942.782435:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3f824ef800) 00010000:00010000:3.0:1790945942.782438:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945942.782442:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27d4b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945942.782448:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27d4b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945942.782462:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d4be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945942.782468:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d4be lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945942.782473:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d4be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945942.782479:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40813fe800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945942.782488:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d4be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945942.782507:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d4be lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945942.782516:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9d40bc9ad100) 00010000:00010000:3.0:1790945942.782519:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945942.782522:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d4be lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945942.782537:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d4be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945942.782564:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27d4b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b0c expref: 13 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945942.782578:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030200/0xd9f4181e0d27d4c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b0c expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945942.782586:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d40bc9ad200) 00010000:00010000:3.0:1790945942.782588:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1790945942.782591:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4080030200, rc 0) 00000100:00100000:3.0:1790945942.782658:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+12:11110:x1877942616490880:12345-192.168.204.20@tcp:101:bash.0 Request processed in 680us (3909us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945942.782666:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 48 00000100:00100000:3.0:1790945942.785725:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945942.785876:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616491136 00000100:00100000:0.0:1790945942.785887:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616491136 00000100:00100000:0.0:1790945942.785948:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 49 00000100:00100000:0.0:1790945942.785958:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+12:11110:x1877942616491136:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:0.0:1790945942.785979:0:8457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945942.786011:0:8457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27d4cc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330b13 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.786136:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27d4d3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.786152:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27d4d3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.786164:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27d4d3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.786279:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27d4da lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.786289:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27d4da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.786296:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27d4da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790945942.786736:0:8457:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:0.0:1790945942.786928:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27d4e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.786938:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27d4e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.786947:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27d4e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.786976:0:8457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27d4d3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.786984:0:8457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27d4d3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.787004:0:8457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27d4d3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.787011:0:8457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945942.787015:0:8457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27d4d3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.787035:0:8457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27d4d3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.787048:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d40bc9ad200) 00010000:00010000:0.0:1790945942.787051:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945942.787056:0:8457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27d4d3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.787063:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27d4d3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790945942.787076:0:8457:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c96c0f50 reply state 0000000053abce9e transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27d4da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.787209:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27d4da lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.787216:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d40bc9ad600) 00010000:00010000:0.0:1790945942.787219:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790945942.787222:0:8457:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790945942.787255:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27d4cc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b13 expref: 15 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.787270:0:8457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27d4e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b13 expref: 14 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.787276:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d40bc9ad400) 00010000:00010000:0.0:1790945942.787278:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790945942.787281:0:8457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe0600, rc 0) 00000100:00100000:0.0:1790945942.787408:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+15:11110:x1877942616491136:12345-192.168.204.20@tcp:101:bash.0 Request processed in 1450us (1695us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1790945942.787423:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 49 00000100:00100000:0.0:1790945942.793875:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945942.794038:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616491264 00000100:00100000:2.0:1790945942.794048:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616491264 00000100:00100000:2.0:1790945942.794110:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 28 00000100:00100000:2.0:1790945942.794118:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2400:x1877942616491264:12345-192.168.204.20@tcp:8:bash.0 00010000:00080000:2.0:1790945942.794154:0:8916:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 0cadc7a5-c0ba-4320-984f-d871ffb3a3ef@192.168.204.20@tcp t0 exp 0000000000000000 cur 393 last 0 00000020:00000080:2.0:1790945942.794227:0:8916:0:(genops.c:1384:class_connect()) connect: client 0cadc7a5-c0ba-4320-984f-d871ffb3a3ef, cookie 0xd9f4181e0d27d4ef 00002000:00100000:2.0:1790945942.794240:0:8916:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0cadc7a5-c0ba-4320-984f-d871ffb3a3ef/ffff9d40914e7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790945942.794257:0:8916:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790945942.794661:0:8916:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790945942.794692:0:8916:0:(import.c:65:import_set_state_nolock()) ffff9d40914e7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790945942.794764:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2400:x1877942616491264:12345-192.168.204.20@tcp:8:bash.0 Request processed in 645us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945942.794773:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 28 00000100:00100000:1.0:1790945942.802420:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945942.802600:0:8436:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616491392 00000100:00100000:0.0:1790945942.802609:0:8436:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616491392 00000100:00100000:0.0:1790945942.802693:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 29 00000100:00100000:0.0:1790945942.802703:0:8436:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408723ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:0:x1877942616491392:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:0.0:1790945942.802724:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945942.802752:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016e3a5ef/0xd9f4181e0d27d4f6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330b1a expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790945942.802780:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790945942.802798:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=393s v=(0 0) 00010000:00010000:0.0:1790945942.802803:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790945942.802812:0:8436:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016e3a5ef/0xd9f4181e0d27d4f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b1a expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.802831:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000016e3a5ef/0xd9f4181e0d27d4f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b1a expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.802844:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe0a00, rc 0) 00000100:00100000:0.0:1790945942.802898:0:8436:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408723ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:0:x1877942616491392:12345-192.168.204.20@tcp:101:bash.0 Request processed in 196us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945942.802905:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 29 00000100:00080000:3.0:1790945942.803118:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790945942.811331:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945942.815792:0:10099:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616491520 00000100:00100000:1.0:1790945942.815809:0:10099:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616491520 00000100:00100000:0.0:1790945942.816253:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 30 00000100:00100000:0.0:1790945942.816265:0:10099:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8301b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:11110:x1877942616491520:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:0.0:1790945942.816301:0:10099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945942.816321:0:10099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae9ccdc9/0xd9f4181e0d27d4fd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330b21 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.816356:0:10099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000016e3a5ef/0xd9f4181e0d27d4f6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b1a expref: 8 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.816365:0:10099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790945942.816370:0:10099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790945942.816375:0:10099:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae9ccdc9/0xd9f4181e0d27d4fd lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b21 expref: 8 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.816413:0:10099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000016e3a5ef/0xd9f4181e0d27d4f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b1a expref: 8 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.816428:0:10099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000016e3a5ef/0xd9f4181e0d27d4f6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b1a expref: 8 pid: 8436 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945942.816443:0:10099:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40accd3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:10099:1877942638602880:192.168.204.20@tcp:104: 00000100:00100000:0.0:1790945942.817254:0:10099:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40854e59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790945942.825744:0:10099:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40accd3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:10099:1877942638602880:192.168.204.20@tcp:104: 00010000:00010000:2.0:1790945942.825785:0:10099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ae9ccdc9/0xd9f4181e0d27d4fd lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b21 expref: 8 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945942.825808:0:10099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe1a00, rc 0) 00000100:00100000:3.0:1790945942.825844:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945942.825879:0:10099:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8301b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+8:11110:x1877942616491520:12345-192.168.204.20@tcp:101:bash.0 Request processed in 9614us (14555us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945942.825888:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 30 00000100:00100000:0.0:1790945942.826027:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616491648 00000100:00100000:0.0:1790945942.826035:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616491648 00010000:00010000:0.0:1790945942.826065:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000016e3a5ef/0xd9f4181e0d27d4f6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b1a expref: 8 pid: 8436 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945942.826105:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 52 00000100:00100000:0.0:1790945942.826123:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4096cbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+8:2403:x1877942616491648:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790945942.826139:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945942.826160:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000016e3a5ef/0xd9f4181e0d27d4f6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b1a expref: 8 pid: 8436 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.826211:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000016e3a5ef/0xd9f4181e0d27d4f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b1a expref: 8 pid: 8436 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.826234:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016e3a5ef/0xd9f4181e0d27d4f6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b1a expref: 8 pid: 8436 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.826247:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790945942.826252:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790945942.826259:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ae9ccdc9/0xd9f4181e0d27d4fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b21 expref: 7 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.826269:0:6507:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae9ccdc9/0xd9f4181e0d27d4fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b21 expref: 7 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945942.826304:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ae9ccdc9/0xd9f4181e0d27d4fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b21 expref: 7 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945942.826318:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40accd2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6507:1877942638603008:192.168.204.20@tcp:105: 00000100:00100000:0.0:1790945942.826371:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40854e59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790945942.833605:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945942.833751:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616491904 00000100:00100000:2.0:1790945942.833761:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616491904 00000100:00100000:2.0:1790945942.833812:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00100000:2.0:1790945942.833836:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+15:11110:x1877942616491904:12345-192.168.204.20@tcp:35:bash.0 00000100:00100000:2.0:1790945942.834620:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+16:11110:x1877942616491904:12345-192.168.204.20@tcp:35:bash.0 Request processed in 783us (1021us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1790945942.834631:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00100000:0.0:1790945942.834745:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40accd2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6507:1877942638603008:192.168.204.20@tcp:105: 00010000:00010000:0.0:1790945942.834780:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945942.834805:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4096cbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:2403:x1877942616491648:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 8684us (8963us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945942.834813:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 52 00000100:00100000:1.0:1790945942.957185:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945942.958025:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616492160 00000100:00100000:2.0:1790945942.958037:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616492160 00000100:00100000:2.0:1790945942.958147:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 50 00000100:00100000:2.0:1790945942.958158:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408723b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+16:11120:x1877942616492160:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1790945942.958220:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945942.958256:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d504 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330b28 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945942.958361:0:6521:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1790945942.958477:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d504 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b28 expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945942.958492:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3f824ef800) 00010000:00010000:2.0:1790945942.958495:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790945942.958500:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d504 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b28 expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945942.958515:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f8363d400, rc 0) 00000100:00100000:2.0:1790945942.958577:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408723b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+17:11120:x1877942616492160:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 421us (1417us total) trans 4294967315 rc 301/301 00000100:00100000:2.0:1790945942.958585:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 50 00000100:00100000:0.0:1790945942.969267:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945942.970084:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616492416 00000100:00100000:2.0:1790945942.970112:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616492416 00000100:00100000:2.0:1790945942.970182:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:2.0:1790945942.970195:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40accd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+17:11120:x1877942616492416:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:2.0:1790945942.970584:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40accd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+18:11120:x1877942616492416:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 391us (1325us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1790945942.970708:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 7 00010000:00010000:1.0:1790945943.014086:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945943.065266:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945943.065370:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616492544 00000100:00100000:2.0:1790945943.065382:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616492544 00000100:00100000:2.0:1790945943.065449:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 51 00000100:00100000:2.0:1790945943.065460:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408723a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+18:11126:x1877942616492544:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1790945943.065492:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945943.065515:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d512 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330b2f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.065596:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d000/0xd9f4181e0d27d519 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.065610:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d000/0xd9f4181e0d27d519 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.065621:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d000/0xd9f4181e0d27d519 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945943.065685:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1790945943.065689:0:6523:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790945943.065711:0:6523:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d000/0xd9f4181e0d27d519 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.065737:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d512 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b2f expref: 20 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.065776:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d000/0xd9f4181e0d27d519 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b2f expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.065784:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d40bc9ad200) 00010000:00010000:2.0:1790945943.065787:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790945943.065790:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f8363d000, rc 0) 00000100:00100000:2.0:1790945943.065851:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408723a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+19:11126:x1877942616492544:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 393us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945943.065859:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 51 00000100:00100000:2.0:1790945943.071267:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945943.072089:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616492800 00000100:00100000:0.0:1790945943.072101:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616492800 00000100:00100000:0.0:1790945943.072206:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 52 00000100:00100000:0.0:1790945943.072217:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+19:11126:x1877942616492800:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1790945943.072239:0:8457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945943.072262:0:8457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27d520 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330b36 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.072371:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27d527 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.072387:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27d527 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.072399:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27d527 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945943.072413:0:8457:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1790945943.072522:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27d520 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b36 expref: 22 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.072540:0:8457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27d527 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b36 expref: 21 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.072567:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d40bc9ad400) 00010000:00010000:0.0:1790945943.072570:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790945943.072573:0:8457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe0800, rc 0) 00000100:00100000:0.0:1790945943.072635:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+21:11126:x1877942616492800:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 420us (1377us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1790945943.072642:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 52 00000100:00100000:0.0:1790945943.077493:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945943.077540:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945943.077617:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616493184 00000100:00100000:3.0:1790945943.077639:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616493184 00000100:00100000:3.0:1790945943.077706:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 3 00000100:00100000:3.0:1790945943.077716:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40accd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+21:2402:x1877942616493184:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790945943.077731:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945943.077756:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27d527 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b36 expref: 21 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945943.077777:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d40bc9ad400) 00010000:00010000:3.0:1790945943.077782:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945943.077845:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40accd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+20:2402:x1877942616493184:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 131us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945943.077855:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 3 00000100:00100000:2.0:1790945943.078265:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616493056 00000100:00100000:2.0:1790945943.078272:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616493056 00000100:00100000:2.0:1790945943.078385:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 53 00000100:00100000:2.0:1790945943.078395:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40accd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+20:11126:x1877942616493056:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1790945943.078419:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945943.078436:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d535 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330b3d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.078555:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27d53c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.078570:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27d53c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.078581:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27d53c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945943.078626:0:6521:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1790945943.078752:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d535 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b3d expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.078768:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27d53c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b3d expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.078778:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d40bc9ad400) 00010000:00010000:2.0:1790945943.078780:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790945943.078783:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f8363ca00, rc 0) 00000100:00100000:2.0:1790945943.078830:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40accd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+22:11126:x1877942616493056:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 437us (1347us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1790945943.078836:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 53 00000100:00100000:0.0:1790945943.084213:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945943.084686:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616493312 00000100:00100000:2.0:1790945943.084698:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616493312 00000100:00100000:2.0:1790945943.084756:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 31 00000100:00100000:2.0:1790945943.084768:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:2403:x1877942616493312:12345-192.168.204.20@tcp:1:lfs.0 00010000:00010000:2.0:1790945943.084820:0:8916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d4a5bc9/0xd9f4181e0d27d54a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.084843:0:8916:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ae9ccdc9/0xd9f4181e0d27d4fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b21 expref: 7 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.084852:0:8916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790945943.084858:0:8916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790945943.084863:0:8916:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d4a5bc9/0xd9f4181e0d27d54a lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.084913:0:8916:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ae9ccdc9/0xd9f4181e0d27d4fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b21 expref: 7 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.084929:0:8916:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ae9ccdc9/0xd9f4181e0d27d4fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b21 expref: 7 pid: 10099 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945943.084944:0:8916:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb39f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8916:1877942638603136:192.168.204.20@tcp:104: 00000100:00100000:2.0:1790945943.085255:0:8916:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bb00a900 going to sleep for 11 seconds 00000100:00100000:2.0:1790945943.087674:0:8916:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb39f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8916:1877942638603136:192.168.204.20@tcp:104: 00010000:00010000:2.0:1790945943.087705:0:8916:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009d4a5bc9/0xd9f4181e0d27d54a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945943.089708:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945943.089798:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616493440 00000100:00100000:1.0:1790945943.089809:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616493440 00002000:00100000:1.0:1790945943.089860:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9d3f83def480 x1877942616493440/t0(0) o4->0cadc7a5-c0ba-4320-984f-d871ffb3a3ef@192.168.204.20@tcp:639/0 lens 504/0 e 0 to 0 dl 1790945954 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790945943.089873:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3f83def480 with x1877942616493440 ext(0->12) 00010000:00010000:1.0:1790945943.089883:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ae9ccdc9/0xd9f4181e0d27d4fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b21 expref: 8 pid: 10099 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945943.089901:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ae9ccdc9/0xd9f4181e0d27d4fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b21 expref: 8 pid: 10099 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790945943.089910:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9d3f83def480 00000100:00100000:1.0:1790945943.089945:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:1.0:1790945943.089960:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83def480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+8:2404:x1877942616493440:12345-192.168.204.20@tcp:4:lfs.0 00000001:00100000:0.0:1790945943.095591:0:9515:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0cadc7a5-c0ba-4320-984f-d871ffb3a3ef 00000100:00100000:1.0:1790945943.098068:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83def480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+9:2404:x1877942616493440:12345-192.168.204.20@tcp:4:lfs.0 Request processed in 8100us (8356us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1790945943.098080:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 0 00002000:00100000:1.0:1790945943.098094:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9d3f83def480 x1877942616493440/t4294967300(0) o4->0cadc7a5-c0ba-4320-984f-d871ffb3a3ef@192.168.204.20@tcp:639/0 lens 504/448 e 0 to 0 dl 1790945954 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790945943.098105:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3f83def480 with x1877942616493440 ext(0->12) 00010000:00010000:1.0:1790945943.098133:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ae9ccdc9/0xd9f4181e0d27d4fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b21 expref: 9 pid: 10099 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945943.098154:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ae9ccdc9/0xd9f4181e0d27d4fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b21 expref: 9 pid: 10099 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790945943.098164:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9d3f83def480 00000100:00100000:1.0:1790945943.101657:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945943.102073:0:7471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616493568 00000100:00100000:2.0:1790945943.102083:0:7471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616493568 00010000:00010000:2.0:1790945943.102120:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ae9ccdc9/0xd9f4181e0d27d4fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b21 expref: 9 pid: 10099 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945943.102239:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 53 00000100:00100000:2.0:1790945943.102261:0:7471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408723a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+9:2403:x1877942616493568:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790945943.102284:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1790945943.102302:0:7471:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1790945943.102305:0:7471:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1790945943 00002000:00010000:2.0:1790945943.102308:0:7471:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1790945943 00002000:00010000:2.0:1790945943.102310:0:7471:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1790945943 00002000:00010000:2.0:1790945943.102326:0:7471:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1790945943.102334:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ae9ccdc9/0xd9f4181e0d27d4fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b21 expref: 9 pid: 10099 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.102350:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ae9ccdc9/0xd9f4181e0d27d4fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b21 expref: 9 pid: 10099 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.102379:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae9ccdc9/0xd9f4181e0d27d4fd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b21 expref: 9 pid: 10099 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.102397:0:7471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790945943.102401:0:7471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790945943.102408:0:7471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009d4a5bc9/0xd9f4181e0d27d54a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.102419:0:7471:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d4a5bc9/0xd9f4181e0d27d54a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.102445:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945943.102511:0:7471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408723a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+8:2403:x1877942616493568:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 252us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945943.102519:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 53 00010000:00010000:1.0:1790945943.105637:0:8916:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009d4a5bc9/0xd9f4181e0d27d54a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945943.105660:0:8916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d4a5bc9/0xd9f4181e0d27d54a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945943.105692:0:8916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d4a5bc9/0xd9f4181e0d27d54a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945943.105702:0:8916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d4a5bc9/0xd9f4181e0d27d54a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945943.105711:0:8916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d4a5bc9/0xd9f4181e0d27d54a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945943.105719:0:8916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f8363c600 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:1.0:1790945943.105724:0:8916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d4a5bc9/0xd9f4181e0d27d54a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945943.105758:0:8916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d4a5bc9/0xd9f4181e0d27d54a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945943.105783:0:8916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d4a5bc9/0xd9f4181e0d27d54a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945943.105792:0:8916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d4a5bc9/0xd9f4181e0d27d54a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945943.105913:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:2403:x1877942616493312:12345-192.168.204.20@tcp:1:lfs.0 Request processed in 21142us (21705us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945943.105924:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 31 00000100:00100000:1.0:1790945943.113642:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945943.113788:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616493824 00000100:00100000:2.0:1790945943.113798:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616493824 00000100:00100000:2.0:1790945943.113861:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 8 00000100:00100000:2.0:1790945943.113872:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+22:11126:x1877942616493824:12345-192.168.204.20@tcp:35:lfs.0 00000004:00010000:2.0:1790945943.113942:0:6525:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27d53c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b3d expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790945943.114264:0:6525:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:2.0:1790945943.114321:0:6525:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1790945943.114615:0:6525:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:2.0:1790945943.114664:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d551 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.114678:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27d4e1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b13 expref: 26 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.114687:0:6525:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d551 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.114721:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27d4e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b13 expref: 26 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.114737:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27d4e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b13 expref: 26 pid: 8457 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945943.114752:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb39f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6525:1877942638603264:192.168.204.20@tcp:104: 00000100:00100000:2.0:1790945943.114854:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40af660d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790945943.120248:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb39f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6525:1877942638603264:192.168.204.20@tcp:104: 00010000:00010000:2.0:1790945943.120283:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d551 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945943.121867:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945943.123806:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616493952 00000100:00100000:3.0:1790945943.123820:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616493952 00010000:00010000:3.0:1790945943.123868:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27d4e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b13 expref: 27 pid: 8457 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945943.123917:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 54 00000100:00100000:3.0:1790945943.123928:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408723b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+27:2404:x1877942616493952:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790945943.123946:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945943.124057:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27d4e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b13 expref: 27 pid: 8457 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945943.124082:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27d4e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b13 expref: 27 pid: 8457 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945943.124125:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27d4e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b13 expref: 27 pid: 8457 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945943.124141:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d40bc9ad400) 00010000:00010000:3.0:1790945943.124147:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d551 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945943.124156:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d551 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945943.124164:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d551 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945943.124612:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945943.124688:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408723b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+26:2404:x1877942616493952:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 760us (2827us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945943.124696:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 54 00010000:00010000:2.0:1790945943.125733:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d551 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.125746:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d551 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790945943.125884:0:6525:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:2.0:1790945943.126033:0:6525:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1790945943.126150:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bcb39f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1877942638603392:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790945943.127468:0:6525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945943.127509:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4082f95840 going to sleep for 11 seconds 00000100:00100000:3.0:1790945943.127608:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638603392 00000100:00100000:3.0:1790945943.127617:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638603392 00000100:00100000:3.0:1790945943.127697:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1790945943.127708:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4083516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6525:x1877942638603392:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790945943.127808:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4083516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6525:x1877942638603392:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 103us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945943.127816:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:2.0:1790945943.128848:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790945943.128894:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bcb39f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1877942638603392:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1790945943.129110:0:6525:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:2.0:1790945943.129213:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4083514380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1877942638603520:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790945943.129261:0:6525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945943.129291:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4088c76c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790945943.129421:0:12418:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638603520 00000100:00100000:3.0:1790945943.129428:0:12418:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638603520 00000100:00100000:3.0:1790945943.129468:0:12418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1790945943.129476:0:12418:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4083517800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6525:x1877942638603520:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790945943.129640:0:12418:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4083517800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6525:x1877942638603520:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 165us (378us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1790945943.129648:0:12418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1790945943.130334:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4083514380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1877942638603520:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1790945943.130389:0:6525:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:2.0:1790945943.130428:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d551 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.130438:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d551 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.130445:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d551 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.130451:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f8363d600 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945943.130455:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d551 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.130463:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d551 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.130487:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d40bc9ad400) 00010000:00010000:2.0:1790945943.130489:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1790945943.130494:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d551 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.130500:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d551 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790945943.130603:0:6525:0:(mdd_object.c:4180:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1790945943.130673:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1790945943.130683:0:6525:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 393946514806ns, next at 394946512790ns, rc = 0 00000001:00080000:2.0:1790945943.130689:0:6525:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:2.0:1790945943.130709:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d40bc9ad400) 00010000:00010000:2.0:1790945943.130712:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790945943.130719:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27d53c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b3d expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945943.130823:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+29:11126:x1877942616493824:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 16953us (17200us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1790945943.130831:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 8 00000020:00080000:2.0:1790945943.130835:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1790945943.133766:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945943.133940:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616494080 00000100:00100000:2.0:1790945943.133958:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616494080 00000100:00100000:2.0:1790945943.134018:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 54 00000100:00100000:2.0:1790945943.134027:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087238e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+29:11126:x1877942616494080:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1790945943.134052:0:13005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945943.134086:0:13005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363cc00/0xd9f4181e0d27d558 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330b44 expref: -99 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.134195:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363cc00/0xd9f4181e0d27d558 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b44 expref: 30 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.134211:0:13005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363cc00/0xd9f4181e0d27d558 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b44 expref: 30 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.134230:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:2.0:1790945943.134233:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790945943.134238:0:13005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f8363cc00, rc 0) 00000100:00100000:2.0:1790945943.134296:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087238e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+30:11126:x1877942616494080:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 269us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945943.134303:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 54 00000100:00100000:3.0:1790945943.143726:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945943.143823:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616494336 00000100:00100000:0.0:1790945943.143833:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616494336 00000100:00100000:0.0:1790945943.143885:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:0.0:1790945943.143894:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4096dda850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+30:11126:x1877942616494336:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:0.0:1790945943.144537:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4096dda850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+31:11126:x1877942616494336:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 642us (818us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1790945943.144546:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:3.0:1790945943.223141:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945943.223966:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616494592 00000100:00100000:1.0:1790945943.223989:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616494592 00000100:00100000:1.0:1790945943.224063:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 55 00000100:00100000:1.0:1790945943.224074:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83cd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+31:11136:x1877942616494592:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:1.0:1790945943.224104:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945943.224127:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27d55f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330b4b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790945943.224289:0:6522:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1790945943.224612:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27d55f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b4b expref: 33 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945943.224641:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3f824ef800) 00010000:00010000:1.0:1790945943.224644:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790945943.224650:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27d55f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b4b expref: 33 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945943.224665:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40c21d6800, rc 0) 00000100:00100000:1.0:1790945943.224741:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83cd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+32:11136:x1877942616494592:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 668us (1609us total) trans 4294967329 rc 301/301 00000100:00100000:1.0:1790945943.224749:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 55 00000100:00100000:1.0:1790945943.236689:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945943.237048:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616494720 00000100:00100000:2.0:1790945943.237060:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616494720 00000100:00100000:2.0:1790945943.237899:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 56 00000100:00100000:2.0:1790945943.237925:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087239180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+32:11136:x1877942616494720:12345-192.168.204.20@tcp:34:lfs.0 00010000:00010000:2.0:1790945943.238024:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d56d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.238041:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d56d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.238056:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d56d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.238067:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d574 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.238093:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d574 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.238100:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d574 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.238210:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d57b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.238220:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d57b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.238228:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d57b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790945943.238276:0:6521:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d57b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.238290:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d56d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.238298:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d56d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.238305:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d56d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.238312:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f8363d600 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945943.238316:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d56d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.238324:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d56d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.238343:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d40bc9ad200) 00010000:00010000:2.0:1790945943.238346:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945943.238351:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d56d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.238358:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d56d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.238372:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d574 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.238378:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d574 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.238384:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d574 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.238388:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f8363c000 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945943.238391:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d574 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.238397:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d574 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.238403:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d40bc9ad600) 00010000:00010000:2.0:1790945943.238406:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945943.238409:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d574 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.238415:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d574 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.238448:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d57b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.238455:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d57b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.238460:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d57b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.238466:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f8363da00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945943.238469:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d57b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.238475:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d57b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.238483:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:2.0:1790945943.238485:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945943.238488:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d57b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.238494:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d57b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945943.238579:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087239180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+32:11136:x1877942616494720:12345-192.168.204.20@tcp:34:lfs.0 Request processed in 670us (1961us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945943.238587:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 56 00000100:00100000:3.0:1790945943.241513:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945943.241925:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616494976 00000100:00100000:0.0:1790945943.241935:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616494976 00000100:00100000:0.0:1790945943.242004:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:0.0:1790945943.242015:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+32:11136:x1877942616494976:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:0.0:1790945943.243000:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+33:11136:x1877942616494976:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 980us (1490us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1790945943.243027:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:3.0:1790945943.298408:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945943.298528:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616495232 00000100:00100000:0.0:1790945943.298539:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616495232 00000100:00100000:0.0:1790945943.298601:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 57 00000100:00100000:0.0:1790945943.298613:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83cd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+33:11139:x1877942616495232:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1790945943.298659:0:8457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945943.298681:0:8457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27d582 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330b52 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.298763:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d589 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.298785:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d589 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.298798:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d589 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.298809:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27d590 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.298817:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27d590 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.298822:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27d590 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.298924:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d597 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.298951:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d597 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.298959:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d597 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945943.298970:0:8457:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1790945943.299060:0:8457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d589 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.299068:0:8457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d589 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.299075:0:8457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d589 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.299081:0:8457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0400 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945943.299085:0:8457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d589 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.299093:0:8457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d589 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.299106:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d40bc9ad200) 00010000:00010000:0.0:1790945943.300010:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945943.300017:0:8457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d589 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.300024:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d589 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.300039:0:8457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27d590 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.300055:0:8457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27d590 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.300061:0:8457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27d590 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.300065:0:8457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0e00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945943.300069:0:8457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27d590 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.300075:0:8457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27d590 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.300083:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d40bc9ad600) 00010000:00010000:0.0:1790945943.300087:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945943.300090:0:8457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27d590 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.300095:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27d590 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.300142:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27d582 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b52 expref: 36 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.300155:0:8457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d597 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b52 expref: 35 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.300162:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:0.0:1790945943.300164:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790945943.301043:0:8457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe1600, rc 0) 00000100:00100000:0.0:1790945943.301121:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83cd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+35:11139:x1877942616495232:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 2509us (2725us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1790945943.301130:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 57 00000100:00100000:1.0:1790945943.310848:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945943.313405:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616495360 00000100:00100000:3.0:1790945943.313421:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616495360 00000100:00100000:3.0:1790945943.313503:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 58 00000100:00100000:3.0:1790945943.313514:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+35:11139:x1877942616495360:12345-192.168.204.20@tcp:54:lfs.0 00010000:00010000:3.0:1790945943.313581:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d5a5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945943.313600:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d5a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945943.313613:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d5a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945943.313676:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d5a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945943.313683:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d5a5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945943.313691:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d5a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945943.313698:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080031400 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945943.313717:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d5a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945943.313727:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d5a5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945943.313739:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:3.0:1790945943.313742:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790945943.313747:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d5a5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945943.313768:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d5a5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945943.313862:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+35:11139:x1877942616495360:12345-192.168.204.20@tcp:54:lfs.0 Request processed in 350us (3021us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945943.313871:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 58 00000100:00100000:2.0:1790945943.317524:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945943.317777:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616495616 00000100:00100000:0.0:1790945943.317787:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616495616 00000100:00100000:0.0:1790945943.317850:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:0.0:1790945943.317861:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4083514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+35:11139:x1877942616495616:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:0.0:1790945943.318287:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4083514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+36:11139:x1877942616495616:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 426us (769us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1790945943.318296:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:2.0:1790945943.392006:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4083517b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638603904:0@lo:400:kworker.0 00000100:00100000:1.0:1790945943.392048:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4083514700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877942638603776:0@lo:400:kworker.0 00000100:00100000:2.0:1790945943.392091:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945943.392110:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945943.392218:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4083515180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638603648:0@lo:400:kworker.0 00000100:00100000:3.0:1790945943.392369:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4083517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877942638604032:0@lo:400:kworker.0 00000100:00100000:2.0:1790945943.392456:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4083515880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1877942638604416:0@lo:400:kworker.0 00000100:00100000:1.0:1790945943.392479:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4083515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1877942638604288:0@lo:400:kworker.0 00000100:00100000:2.0:1790945943.392487:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945943.392513:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4083516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1877942638604928:0@lo:400:kworker.0 00000100:00100000:1.0:1790945943.392542:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945943.392581:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4083515500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1877942638604800:0@lo:400:kworker.0 00000100:00100000:1.0:1790945943.392609:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945943.393130:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945943.393159:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4083515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638604160:0@lo:400:kworker.0 00000100:00100000:0.0:1790945943.393276:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945943.393298:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4083514a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638604672:0@lo:400:kworker.0 00000100:00100000:0.0:1790945943.393323:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945943.393342:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4083517100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638605184:0@lo:400:kworker.0 00000100:00100000:2.0:1790945943.394508:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638603776 00000100:00100000:2.0:1790945943.394520:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638603776 00000100:00100000:2.0:1790945943.394594:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638604416 00000100:00100000:2.0:1790945943.394598:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638604416 00000100:00100000:2.0:1790945943.394630:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638604288 00000100:00100000:2.0:1790945943.394633:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638604288 00000100:00100000:2.0:1790945943.394652:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1790945943.394663:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408723bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1877942638603776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945943.394797:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638603904 00000100:00100000:3.0:1790945943.394803:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638603904 00000100:00100000:3.0:1790945943.394852:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638604160 00000100:00100000:3.0:1790945943.394855:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638604160 00000100:00100000:3.0:1790945943.394873:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1790945943.394881:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4083516300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638603904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945943.394945:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4083516300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638603904:12345-0@lo:400:kworker.0 Request processed in 65us (2868us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945943.394953:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1790945943.394973:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1790945943.395001:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40accd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638604160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945943.395054:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40accd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638604160:12345-0@lo:400:kworker.0 Request processed in 55us (1778us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945943.395061:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1790945943.395109:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408723bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1877942638603776:12345-0@lo:400:kworker.0 Request processed in 447us (3000us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945943.395311:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1790945943.395323:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcb39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877942638604416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945943.395359:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcb39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877942638604416:12345-0@lo:400:kworker.0 Request processed in 41us (2876us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945943.396148:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638605312:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790945943.396225:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945943.396273:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4083514700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877942638603776:0@lo:400:kworker.0 00000100:00100000:0.0:1790945943.396289:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945943.396327:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638605312 00000100:00100000:1.0:1790945943.396334:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638605312 00000100:00100000:0.0:1790945943.396339:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4083515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638604160:0@lo:400:kworker.0 00000100:00100000:2.0:1790945943.396402:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1790945943.396411:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1790945943.396430:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638604800 00000100:00100000:2.0:1790945943.396435:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638604800 00000100:00100000:3.0:1790945943.396439:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1790945943.396456:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408723b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1877942638604288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945943.396468:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1790945943.396479:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087239f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1877942638604800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945943.396482:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1790945943.396584:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408723b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1877942638604288:12345-0@lo:400:kworker.0 Request processed in 137us (4044us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945943.396592:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1790945943.396595:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087239c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638605312:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790945943.396595:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638603648 00000100:00100000:0.0:1790945943.396600:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638603648 00002000:00000024:1.0:1790945943.396641:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790945943.396650:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1790945943.396661:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408397e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3647:x1877942638603648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945943.396662:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638604672 00000100:00100000:3.0:1790945943.396669:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638604672 00000100:00100000:1.0:1790945943.396696:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087239c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638605312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 200us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945943.396706:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638605184 00000100:00100000:1.0:1790945943.396707:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1790945943.396717:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638605184 00000100:00100000:0.0:1790945943.396723:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408397e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3647:x1877942638603648:12345-0@lo:400:kworker.0 Request processed in 62us (3592us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945943.396747:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1790945943.396756:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40accd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638604672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945943.396762:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790945943.396775:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4cee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1877942638605184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945943.396803:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40accd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638604672:12345-0@lo:400:kworker.0 Request processed in 48us (3478us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945943.396811:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1790945943.396830:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087239f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1877942638604800:12345-0@lo:400:kworker.0 Request processed in 352us (4217us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945943.396837:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4cee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1877942638605184:12345-0@lo:400:kworker.0 Request processed in 64us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945943.396844:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1790945943.396850:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945943.396866:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638604928 00000100:00100000:2.0:1790945943.396871:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638604928 00000100:00100000:3.0:1790945943.396886:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bfef2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638605440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790945943.396896:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1790945943.396903:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bfef0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877942638604928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945943.396925:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945943.396950:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bfef0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877942638604928:12345-0@lo:400:kworker.0 Request processed in 47us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945943.396961:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4083517b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638603904:0@lo:400:kworker.0 00000100:00100000:2.0:1790945943.396968:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00010000:00080000:3.0:1790945943.397002:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d4083515880 x1877942638604416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945943.397012:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4083515880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1877942638604416:0@lo:400:kworker.0 00010000:00080000:3.0:1790945943.397024:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d4083516d80 x1877942638604928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945943.397032:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4083516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1877942638604928:0@lo:400:kworker.0 00000100:00100000:0.0:1790945943.397047:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1790945943.397104:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4083515180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638603648:0@lo:400:kworker.0 00000100:00100000:0.0:1790945943.397121:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4083514a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638604672:0@lo:400:kworker.0 00000100:00100000:0.0:1790945943.397131:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4083517100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638605184:0@lo:400:kworker.0 00000100:00100000:1.0:1790945943.397239:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790945943.397276:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945943.397299:0:13838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638605440 00000100:00100000:3.0:1790945943.397306:0:13838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638605440 00000100:00100000:2.0:1790945943.397306:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638604032 00000100:00100000:2.0:1790945943.397314:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638604032 00000100:00100000:1.0:1790945943.397322:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4083516a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638604544:0@lo:400:kworker.0 00000100:00100000:2.0:1790945943.397341:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1790945943.397347:0:13838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1790945943.397353:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087239880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877942638604032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945943.397359:0:13838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bfef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1877942638605440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790945943.397398:0:13838:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790945943.397408:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087239880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877942638604032:12345-0@lo:400:kworker.0 Request processed in 59us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945943.397416:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00080000:2.0:1790945943.397438:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790945943.397442:0:13838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bfef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1877942638605440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (516us total) trans 0 rc 0/0 00000100:00080000:2.0:1790945943.397444:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790945943.397450:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790945943.397453:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790945943.397455:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790945943.397459:0:13838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1790945943.397491:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4083514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638605056:0@lo:400:kworker.0 00000100:00100000:3.0:1790945943.397585:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bfef2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638605440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790945943.397601:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945943.397604:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638605312:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790945943.397629:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4083515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1877942638604288:0@lo:400:kworker.0 00000100:00100000:0.0:1790945943.397642:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4083515500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1877942638604800:0@lo:400:kworker.0 00000100:00100000:2.0:1790945943.397936:0:10099:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638604544 00000100:00100000:2.0:1790945943.397941:0:10099:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638604544 00000100:00100000:3.0:1790945943.397942:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638605056 00000100:00100000:3.0:1790945943.397948:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638605056 00000100:00100000:1.0:1790945943.397968:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4083517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877942638604032:0@lo:400:kworker.0 00000100:00100000:3.0:1790945943.397989:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1790945943.397996:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087238a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638605056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945943.398026:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087238a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638605056:12345-0@lo:400:kworker.0 Request processed in 32us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945943.398035:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1790945943.398049:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4083514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638605056:0@lo:400:kworker.0 00000100:00100000:3.0:1790945943.398054:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1790945943.398072:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408723aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638604544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945943.398876:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408723aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638604544:12345-0@lo:400:kworker.0 Request processed in 812us (1511us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945943.398884:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:3.0:1790945943.399715:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790945943.399738:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4083516a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638604544:0@lo:400:kworker.0 00000100:00100000:0.0:1790945943.568256:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945943.568360:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616495872 00000100:00100000:2.0:1790945943.568371:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616495872 00000100:00100000:2.0:1790945943.568437:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 59 00000100:00100000:2.0:1790945943.568447:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+36:11170:x1877942616495872:12345-192.168.204.20@tcp:101:cat.0 00010000:00010000:2.0:1790945943.568472:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945943.568491:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d5ac lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330b59 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.568598:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d5b3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.568614:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d5b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.568624:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d5b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945943.568647:0:6521:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1790945943.568784:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d5ac lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b59 expref: 39 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.568803:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d5b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b59 expref: 38 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.568811:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:2.0:1790945943.568813:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790945943.568817:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f8363d600, rc 0) 00000100:00100000:2.0:1790945943.568997:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+38:11170:x1877942616495872:12345-192.168.204.20@tcp:101:cat.0 Request processed in 549us (748us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1790945943.569005:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 59 00000100:00100000:1.0:1790945943.573346:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945943.573404:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945943.573418:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616496000 00000100:00100000:0.0:1790945943.573452:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616496000 00000100:00100000:3.0:1790945943.573486:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616496256 00000100:00100000:3.0:1790945943.573492:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616496256 00000100:00100000:0.0:1790945943.573531:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4 00000100:00100000:3.0:1790945943.573537:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:0.0:1790945943.573545:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087238000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+39:2403:x1877942616496000:12345-192.168.204.20@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1790945943.573561:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+39:11170:x1877942616496256:12345-192.168.204.20@tcp:35:cat.0 00010000:00010000:0.0:1790945943.573562:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945943.573591:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d5b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b59 expref: 39 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.573617:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:0.0:1790945943.573622:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945943.573686:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087238000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+38:2403:x1877942616496000:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 145us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945943.573694:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4 00000100:00100000:3.0:1790945943.573764:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+38:11170:x1877942616496256:12345-192.168.204.20@tcp:35:cat.0 Request processed in 219us (360us total) trans 4294967334 rc 0/0 00000100:00100000:3.0:1790945943.573772:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:3.0:1790945943.641034:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945943.641208:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616496512 00000100:00100000:0.0:1790945943.641221:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616496512 00000100:00100000:0.0:1790945943.641284:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 60 00000100:00100000:0.0:1790945943.641294:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bfef2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+38:11176:x1877942616496512:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:0.0:1790945943.641325:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945943.641329:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790945943.641360:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d000/0xd9f4181e0d27d519 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b2f expref: 38 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.641383:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d40bc9ad200) 00010000:00010000:0.0:1790945943.641389:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790945943.641402:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27d5c1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330b60 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.641525:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d5c8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.641540:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d597 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b52 expref: 38 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.641549:0:6522:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d5c8 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.641595:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d597 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b52 expref: 38 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.641609:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d597 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b52 expref: 38 pid: 8457 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945943.641652:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d408aa8f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1877942638605568:192.168.204.20@tcp:104: 00000100:00100000:0.0:1790945943.641916:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4d05f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790945943.657329:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d408aa8f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1877942638605568:192.168.204.20@tcp:104: 00010000:00010000:0.0:1790945943.657368:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d5c8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945943.660486:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945943.661082:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616496640 00000100:00100000:2.0:1790945943.661094:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616496640 00010000:00010000:2.0:1790945943.661147:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d597 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b52 expref: 39 pid: 8457 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945943.661249:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 55 00000100:00100000:0.0:1790945943.661262:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bfef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+39:2403:x1877942616496640:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790945943.661280:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945943.661287:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d597 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b52 expref: 39 pid: 8457 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.661303:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d597 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b52 expref: 39 pid: 8457 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.661327:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d597 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b52 expref: 39 pid: 8457 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.661344:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:0.0:1790945943.661350:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d5c8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.661360:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d5c8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.661368:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d5c8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.661411:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945943.661494:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bfef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+38:2403:x1877942616496640:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 234us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945943.661511:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 55 00010000:00010000:1.0:1790945943.661558:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d5c8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945943.661568:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d5c8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790945943.661590:0:6522:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1790945943.661751:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27d5c1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b60 expref: 39 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945943.661777:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d5c8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b60 expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945943.661785:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:1.0:1790945943.661787:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790945943.661790:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe0400, rc 0) 00000100:00100000:1.0:1790945943.661820:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bfef2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+38:11176:x1877942616496512:12345-192.168.204.20@tcp:101:dd.0 Request processed in 20528us (20798us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1790945943.661827:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 60 00000100:00100000:2.0:1790945943.664008:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945943.664116:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616496768 00000100:00100000:3.0:1790945943.664127:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616496768 00000100:00100000:3.0:1790945943.664214:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 61 00000100:00100000:3.0:1790945943.664224:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+38:11176:x1877942616496768:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:3.0:1790945943.664248:0:8457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945943.664264:0:8457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27d5d6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330b67 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945943.664299:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d5dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945943.664312:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d5dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945943.664323:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d5dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945943.664437:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27d5d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b67 expref: 40 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945943.664455:0:8457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d5dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b67 expref: 39 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945943.664464:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:3.0:1790945943.664467:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790945943.664470:0:8457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4080031400, rc 0) 00000100:00100000:3.0:1790945943.664816:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+39:11176:x1877942616496768:12345-192.168.204.20@tcp:101:dd.0 Request processed in 592us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945943.664824:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 61 00000100:00100000:3.0:1790945943.666725:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945943.666980:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616497024 00000100:00100000:2.0:1790945943.666990:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616497024 00000100:00100000:2.0:1790945943.667357:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 62 00000100:00100000:2.0:1790945943.667369:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bfef2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+39:11176:x1877942616497024:12345-192.168.204.20@tcp:36:dd.0 00010000:00010000:2.0:1790945943.667926:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d5e4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.668345:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d5e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.668373:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d5e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790945943.668424:0:6521:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:2.0:1790945943.668450:0:6521:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f50eec7e reply state 000000000bf7d6ce transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d5e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.668464:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d5e4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945943.668470:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:2.0:1790945943.668473:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790945943.668476:0:6521:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790945943.668648:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bfef2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+42:11176:x1877942616497024:12345-192.168.204.20@tcp:36:dd.0 Request processed in 1280us (1926us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1790945943.668657:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 62 00000020:00080000:2.0:1790945943.668662:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1790945943.941261:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945943.941359:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616497152 00000100:00100000:1.0:1790945943.941370:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616497152 00000100:00100000:1.0:1790945943.941434:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 63 00000100:00100000:1.0:1790945943.941444:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+42:11191:x1877942616497152:12345-192.168.204.20@tcp:101:stat.0 00010000:00010000:1.0:1790945943.941468:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945943.941487:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27d5eb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330b6e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945943.941550:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6a00/0xd9f4181e0d27d5f2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945943.941575:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6a00/0xd9f4181e0d27d5f2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945943.941587:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6a00/0xd9f4181e0d27d5f2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945943.941618:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27d5f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945943.941642:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27d5f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945943.941650:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27d5f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945943.941725:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afcc00/0xd9f4181e0d27d600 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945943.941736:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d5c8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b60 expref: 43 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945943.941745:0:6522:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afcc00/0xd9f4181e0d27d600 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945943.941780:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d5c8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b60 expref: 43 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945943.941794:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d5c8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b60 expref: 43 pid: 6522 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945943.941808:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4083516a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1877942638605696:192.168.204.20@tcp:104: 00000100:00100000:1.0:1790945943.941917:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f824d8600 going to sleep for 11 seconds 00000100:00100000:0.0:1790945943.944892:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945943.945010:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4083516a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1877942638605696:192.168.204.20@tcp:104: 00000100:00100000:2.0:1790945943.945027:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616497408 00000100:00100000:2.0:1790945943.945034:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616497408 00010000:00010000:1.0:1790945943.945037:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afcc00/0xd9f4181e0d27d600 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945943.945125:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:2.0:1790945943.945136:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408aa8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+44:6171:x1877942616497408:12345-192.168.204.20@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1790945943.945477:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408aa8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+45:6171:x1877942616497408:12345-192.168.204.20@tcp:35:ldlm_bl.0 Request processed in 342us (594us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1790945943.945486:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:3.0:1790945943.947533:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945943.947722:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616497536 00000100:00100000:0.0:1790945943.947731:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616497536 00010000:00010000:0.0:1790945943.947766:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d5c8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b60 expref: 45 pid: 6522 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945943.947795:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 56 00000100:00100000:0.0:1790945943.947803:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+45:2404:x1877942616497536:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790945943.947816:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945943.947822:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d5c8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b60 expref: 45 pid: 6522 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.947834:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d5c8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b60 expref: 45 pid: 6522 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.947854:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d5c8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b60 expref: 45 pid: 6522 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.947872:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:0.0:1790945943.947877:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afcc00/0xd9f4181e0d27d600 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.947886:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afcc00/0xd9f4181e0d27d600 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.947901:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afcc00/0xd9f4181e0d27d600 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945943.947938:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945943.948000:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+44:2404:x1877942616497536:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 196us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945943.948008:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 56 00010000:00010000:3.0:1790945943.948880:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afcc00/0xd9f4181e0d27d600 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945943.948891:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afcc00/0xd9f4181e0d27d600 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945943.948955:0:6522:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1790945943.948959:0:6522:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790945943.949010:0:6522:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afcc00/0xd9f4181e0d27d600 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945943.949024:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afcc00/0xd9f4181e0d27d600 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945943.949034:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6a00/0xd9f4181e0d27d5f2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945943.949049:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6a00/0xd9f4181e0d27d5f2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945943.949055:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6a00/0xd9f4181e0d27d5f2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945943.949061:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d6a00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945943.949065:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6a00/0xd9f4181e0d27d5f2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945943.949073:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6a00/0xd9f4181e0d27d5f2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945943.949085:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d40bc9ad200) 00010000:00010000:3.0:1790945943.949088:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945943.949091:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6a00/0xd9f4181e0d27d5f2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945943.949097:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6a00/0xd9f4181e0d27d5f2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945943.949109:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27d5f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945943.949115:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27d5f9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945943.949122:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27d5f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945943.949127:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afd600 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945943.949135:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27d5f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945943.949154:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27d5f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945943.949165:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d40bc9ad600) 00010000:00010000:3.0:1790945943.949194:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945943.949198:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27d5f9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945943.949203:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27d5f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945943.949392:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27d5eb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b6e expref: 44 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945943.949408:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afcc00/0xd9f4181e0d27d600 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b6e expref: 43 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945943.949415:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:3.0:1790945943.949417:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790945943.949420:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4092afcc00, rc 0) 00000100:00100000:3.0:1790945943.949478:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+43:11191:x1877942616497152:12345-192.168.204.20@tcp:101:stat.0 Request processed in 8035us (8228us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945943.949485:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 63 00000100:00100000:3.0:1790945944.030156:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945944.030300:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616497792 00000100:00100000:0.0:1790945944.030311:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616497792 00000100:00100000:0.0:1790945944.030381:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 64 00000100:00100000:0.0:1790945944.030392:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+43:11197:x1877942616497792:12345-192.168.204.20@tcp:36:truncate.0 00010000:00010000:0.0:1790945944.030447:0:13005:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945944.030472:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afcc00/0xd9f4181e0d27d600 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b6e expref: 43 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945944.030490:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:0.0:1790945944.030495:0:13005:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790945944.030671:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d607 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945944.030685:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d607 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945944.030695:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d607 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790945944.030736:0:13005:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:0.0:1790945944.030758:0:13005:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000255bf34a reply state 0000000097cc60dc transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d607 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945944.030783:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d607 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945944.030790:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:0.0:1790945944.030792:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790945944.030795:0:13005:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00080000:3.0:1790945944.030991:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790945944.031083:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+45:11197:x1877942616497792:12345-192.168.204.20@tcp:36:truncate.0 Request processed in 692us (940us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1790945944.031091:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 64 00000020:00080000:0.0:1790945944.031096:0:13005:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790945944.031836:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945944.206298:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945944.206576:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616497920 00000100:00100000:2.0:1790945944.206590:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616497920 00000100:00100000:2.0:1790945944.206785:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 65 00000100:00100000:2.0:1790945944.206813:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408aa8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+45:11211:x1877942616497920:12345-192.168.204.20@tcp:101:stat.0 00010000:00010000:2.0:1790945944.206843:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945944.206866:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d60e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330b75 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.206947:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27d615 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.206973:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27d615 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.206988:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27d615 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.207001:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d61c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.207008:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d61c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.207014:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d61c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.207088:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d623 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.207097:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d623 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.207103:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d623 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945944.207153:0:6521:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1790945944.207211:0:6521:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790945944.207238:0:6521:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d623 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.207320:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d623 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.207330:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27d615 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.207337:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27d615 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.207344:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27d615 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.207350:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f8363c200 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945944.207355:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27d615 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.207363:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27d615 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.207375:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d40bc9ad200) 00010000:00010000:2.0:1790945944.207378:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945944.207382:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27d615 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.207388:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27d615 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.207412:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d61c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.207418:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d61c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.207425:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d61c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.207430:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f8363ce00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945944.207433:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d61c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.207439:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d61c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.207445:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d40bc9ad600) 00010000:00010000:2.0:1790945944.207447:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945944.207526:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d61c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.207532:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d61c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.207559:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d60e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b75 expref: 47 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.207571:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d623 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b75 expref: 46 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.207589:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:2.0:1790945944.207591:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790945944.207594:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f8363da00, rc 0) 00000100:00100000:2.0:1790945944.207864:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408aa8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+46:11211:x1877942616497920:12345-192.168.204.20@tcp:101:stat.0 Request processed in 1051us (1645us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945944.207872:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 65 00000100:00100000:2.0:1790945944.308512:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945944.308730:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616498176 00000100:00100000:3.0:1790945944.308754:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616498176 00000100:00100000:3.0:1790945944.308872:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 66 00000100:00100000:3.0:1790945944.308883:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+46:11221:x1877942616498176:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1790945944.308903:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945944.308924:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27d62a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330b7c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945944.309036:0:6522:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1790945944.309151:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27d62a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b7c expref: 48 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.309213:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3f824ef800) 00010000:00010000:3.0:1790945944.309216:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790945944.309222:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27d62a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b7c expref: 48 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.309237:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4080030a00, rc 0) 00000100:00100000:3.0:1790945944.309308:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+47:11221:x1877942616498176:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 426us (805us total) trans 4294967341 rc 301/301 00000100:00100000:3.0:1790945944.309316:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 66 00000100:00100000:1.0:1790945944.312309:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945944.312375:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616498432 00000100:00100000:3.0:1790945944.312385:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616498432 00000100:00100000:3.0:1790945944.312464:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 14 00000100:00100000:3.0:1790945944.312474:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4083516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+47:11221:x1877942616498432:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:3.0:1790945944.312739:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4083516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+48:11221:x1877942616498432:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 259us (432us total) trans 4294967342 rc 0/0 00000100:00100000:3.0:1790945944.312747:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 14 00000100:00100000:2.0:1790945944.391917:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945944.392511:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616498688 00000100:00100000:1.0:1790945944.392522:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616498688 00000100:00100000:1.0:1790945944.392743:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 67 00000100:00100000:1.0:1790945944.392755:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+48:11227:x1877942616498688:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:1.0:1790945944.392783:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945944.392803:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afdc00/0xd9f4181e0d27d638 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330b83 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945944.392918:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d63f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945944.392946:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d623 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b75 expref: 49 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945944.392965:0:6523:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d63f lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945944.393000:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d623 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b75 expref: 49 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945944.393014:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d623 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b75 expref: 49 pid: 6521 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945944.393027:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4083514000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1877942638605824:192.168.204.20@tcp:104: 00000100:00100000:1.0:1790945944.393210:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f824d8600 going to sleep for 11 seconds 00000100:00100000:0.0:1790945944.397923:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945944.398033:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616498816 00000100:00100000:2.0:1790945944.398044:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616498816 00010000:00010000:2.0:1790945944.398084:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d623 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b75 expref: 50 pid: 6521 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945944.398126:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 57 00000100:00100000:2.0:1790945944.398136:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4096cbf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+50:2404:x1877942616498816:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790945944.398150:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945944.398191:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d623 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b75 expref: 50 pid: 6521 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.398205:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d623 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b75 expref: 50 pid: 6521 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.398243:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:2.0:1790945944.398250:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d63f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.398278:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d63f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.398287:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d63f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.398309:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945944.398368:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4096cbf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+50:2404:x1877942616498816:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 233us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945944.398376:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 57 00010000:00010000:1.0:1790945944.402349:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d623 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b75 expref: 49 pid: 6521 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945944.402375:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4083514000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1877942638605824:192.168.204.20@tcp:104: 00010000:00010000:1.0:1790945944.402417:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d63f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945944.402428:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d63f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945944.402435:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d63f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790945944.402719:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1790945944.402857:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afdc00/0xd9f4181e0d27d638 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b83 expref: 50 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945944.402874:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d63f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b83 expref: 49 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945944.402883:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:1.0:1790945944.402886:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790945944.402889:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4092afc000, rc 0) 00000100:00100000:1.0:1790945944.403108:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+49:11227:x1877942616498688:12345-192.168.204.20@tcp:101:bash.0 Request processed in 10354us (11199us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1790945944.403117:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 67 00000100:00100000:0.0:1790945944.407769:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945944.407869:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616499072 00000100:00100000:2.0:1790945944.407879:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616499072 00000100:00100000:2.0:1790945944.408041:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 68 00000100:00100000:2.0:1790945944.408052:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408aa8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+49:11227:x1877942616499072:12345-192.168.204.20@tcp:36:bash.0 00010000:00010000:2.0:1790945944.408423:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27d64d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.408442:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27d64d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.408530:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27d64d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790945944.408575:0:6521:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:2.0:1790945944.408834:0:6521:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002def6ccb reply state 000000008023378e transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27d64d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.408849:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27d64d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.408878:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:2.0:1790945944.408881:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790945944.408885:0:6521:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790945944.409122:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408aa8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+52:11227:x1877942616499072:12345-192.168.204.20@tcp:36:bash.0 Request processed in 1070us (1359us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1790945944.409132:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 68 00000020:00080000:2.0:1790945944.409137:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1790945944.418117:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945944.418265:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616499200 00000100:00100000:3.0:1790945944.418275:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616499200 00000100:00100000:3.0:1790945944.418336:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 69 00000100:00100000:3.0:1790945944.418346:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+52:11227:x1877942616499200:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:3.0:1790945944.418369:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945944.418388:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27d654 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330b8a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.418821:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d65b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.418838:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d63f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b83 expref: 53 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.418846:0:6522:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d65b lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.418879:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d63f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b83 expref: 53 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.418894:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d63f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b83 expref: 53 pid: 6523 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945944.418907:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff96d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1877942638605952:192.168.204.20@tcp:104: 00000100:00100000:3.0:1790945944.419089:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408fc76600 going to sleep for 11 seconds 00000100:00100000:3.0:1790945944.422809:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff96d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1877942638605952:192.168.204.20@tcp:104: 00010000:00010000:3.0:1790945944.422840:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d65b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945944.423987:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945944.426063:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616499328 00000100:00100000:0.0:1790945944.426078:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616499328 00010000:00010000:1.0:1790945944.426425:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d63f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b83 expref: 54 pid: 6523 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945944.426609:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 58 00000100:00100000:1.0:1790945944.426758:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+54:2404:x1877942616499328:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790945944.426777:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945944.426799:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d63f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b83 expref: 54 pid: 6523 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945944.426814:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d63f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b83 expref: 54 pid: 6523 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945944.426838:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d63f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b83 expref: 54 pid: 6523 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945944.426854:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:1.0:1790945944.426860:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d65b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945944.426869:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d65b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945944.426877:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d65b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945944.426910:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945944.426995:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+53:2404:x1877942616499328:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 242us (3011us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945944.427003:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 58 00010000:00010000:3.0:1790945944.427068:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d65b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.427077:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d65b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945944.427129:0:6522:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1790945944.427134:0:6522:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790945944.427164:0:6522:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d65b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.427216:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27d654 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b8a expref: 53 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.427252:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d65b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b8a expref: 52 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.427260:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:3.0:1790945944.427263:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790945944.427266:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4080031800, rc 0) 00000100:00100000:3.0:1790945944.427294:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+52:11227:x1877942616499200:12345-192.168.204.20@tcp:101:bash.0 Request processed in 8950us (9187us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945944.427302:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 69 00000100:00100000:0.0:1790945944.430874:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945944.431856:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616499584 00000100:00100000:2.0:1790945944.431868:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616499584 00000100:00100000:2.0:1790945944.432039:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15 00000100:00100000:2.0:1790945944.432050:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4096dd9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+52:11227:x1877942616499584:12345-192.168.204.20@tcp:35:bash.0 00000100:00100000:2.0:1790945944.432322:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4096dd9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+53:11227:x1877942616499584:12345-192.168.204.20@tcp:35:bash.0 Request processed in 274us (1455us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1790945944.432330:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15 00000100:00100000:0.0:1790945944.511838:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945944.513608:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616499840 00000100:00100000:1.0:1790945944.513624:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616499840 00000100:00100000:1.0:1790945944.513766:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 70 00000100:00100000:1.0:1790945944.513778:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408aa8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+53:11237:x1877942616499840:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:1.0:1790945944.513805:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945944.513827:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d662 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330b91 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790945944.513981:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1790945944.514087:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d662 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b91 expref: 55 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945944.514102:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3f824ef800) 00010000:00010000:1.0:1790945944.514105:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790945944.514111:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d662 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b91 expref: 55 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945944.514125:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4092afc000, rc 0) 00000100:00100000:1.0:1790945944.514244:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408aa8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+54:11237:x1877942616499840:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 468us (2415us total) trans 4294967347 rc 301/301 00000100:00100000:1.0:1790945944.514252:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 70 00000100:00100000:1.0:1790945944.521369:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945944.521486:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616499968 00000100:00100000:2.0:1790945944.521498:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616499968 00000100:00100000:2.0:1790945944.521604:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 71 00000100:00100000:2.0:1790945944.521615:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4083514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+54:11237:x1877942616499968:12345-192.168.204.20@tcp:34:lfs.0 00010000:00010000:2.0:1790945944.521685:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d670 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.521702:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d670 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.521712:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d670 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.521740:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27d677 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.521748:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27d677 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.521755:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27d677 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.521825:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d67e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.521834:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d67e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.521841:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d67e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790945944.521907:0:6521:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d67e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.521921:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d670 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.521928:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d670 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.521935:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d670 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.521942:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f8363d400 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945944.521946:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d670 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.521970:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d670 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.521982:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d40bc9ad200) 00010000:00010000:2.0:1790945944.521985:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945944.521990:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d670 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.521996:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d670 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.522010:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27d677 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.522017:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27d677 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.522022:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27d677 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.522027:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f8363c600 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945944.522030:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27d677 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.522036:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27d677 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.522043:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d40bc9ad600) 00010000:00010000:2.0:1790945944.522045:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945944.522048:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27d677 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.522064:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27d677 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.522074:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d67e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.522079:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d67e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.522085:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d67e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.522090:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f8363da00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945944.522093:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d67e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.522098:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d67e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.522106:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:2.0:1790945944.522108:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945944.522111:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d67e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.522116:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d67e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945944.522261:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4083514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+54:11237:x1877942616499968:12345-192.168.204.20@tcp:34:lfs.0 Request processed in 648us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945944.522270:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 71 00000100:00100000:2.0:1790945944.525643:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945944.525733:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616500224 00000100:00100000:0.0:1790945944.525742:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616500224 00000100:00100000:0.0:1790945944.525839:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:0.0:1790945944.525850:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+54:11237:x1877942616500224:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:0.0:1790945944.526096:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+55:11237:x1877942616500224:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 247us (461us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1790945944.526104:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:1.0:1790945944.588394:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945944.588910:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616500480 00000100:00100000:3.0:1790945944.588921:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616500480 00000100:00100000:3.0:1790945944.589105:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 72 00000100:00100000:3.0:1790945944.589116:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4083517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+55:11240:x1877942616500480:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1790945944.589141:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945944.589211:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27d685 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330b98 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.589291:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27d68c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.589306:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27d68c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.589317:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27d68c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.589328:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6a00/0xd9f4181e0d27d693 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.589334:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6a00/0xd9f4181e0d27d693 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.589340:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6a00/0xd9f4181e0d27d693 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.589452:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27d69a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.589462:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27d69a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.589469:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27d69a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945944.589479:0:6522:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1790945944.594719:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27d68c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.594757:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27d68c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.594765:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27d68c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.594771:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d6800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945944.594776:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27d68c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.594784:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27d68c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.594800:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d40bc9ad200) 00010000:00010000:3.0:1790945944.594804:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945944.594808:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27d68c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.594814:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27d68c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.594832:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6a00/0xd9f4181e0d27d693 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.594838:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6a00/0xd9f4181e0d27d693 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.594844:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6a00/0xd9f4181e0d27d693 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.594848:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d6a00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945944.594856:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6a00/0xd9f4181e0d27d693 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.594862:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6a00/0xd9f4181e0d27d693 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.594870:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d40bc9ad600) 00010000:00010000:3.0:1790945944.594872:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945944.594875:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6a00/0xd9f4181e0d27d693 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.594880:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6a00/0xd9f4181e0d27d693 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.595475:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27d685 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b98 expref: 58 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.595491:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27d69a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b98 expref: 57 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.595498:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:3.0:1790945944.595501:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790945944.595504:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40813ff800, rc 0) 00000100:00100000:3.0:1790945944.596245:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4083517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+57:11240:x1877942616500480:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 7127us (7858us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1790945944.596255:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 72 00000100:00100000:1.0:1790945944.607369:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945944.607454:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945944.607765:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616500736 00000100:00100000:2.0:1790945944.607774:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616500736 00000100:00100000:2.0:1790945944.607843:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00100000:2.0:1790945944.607853:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4083515c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+57:2404:x1877942616500736:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790945944.607870:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945944.607908:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27d69a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b98 expref: 57 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.607939:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:2.0:1790945944.607944:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945944.608014:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4083515c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+56:2404:x1877942616500736:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 161us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945944.608022:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00100000:3.0:1790945944.608517:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616500608 00000100:00100000:3.0:1790945944.608523:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616500608 00000100:00100000:3.0:1790945944.608578:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 73 00000100:00100000:3.0:1790945944.608587:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4083515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+56:11240:x1877942616500608:12345-192.168.204.20@tcp:54:lfs.0 00010000:00010000:3.0:1790945944.608663:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d6a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.608678:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d6a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.608689:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d6a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.608721:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d6a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.608730:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d6a8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.608737:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d6a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.608742:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40813fe800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945944.608747:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d6a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.608755:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d6a8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.608763:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:3.0:1790945944.608765:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790945944.608769:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d6a8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.608776:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d6a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945944.608850:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4083515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+56:11240:x1877942616500608:12345-192.168.204.20@tcp:54:lfs.0 Request processed in 264us (1488us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945944.608857:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 73 00000100:00100000:1.0:1790945944.617316:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945944.617440:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616500992 00000100:00100000:2.0:1790945944.617450:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616500992 00000100:00100000:2.0:1790945944.617499:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:2.0:1790945944.617508:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4083517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+56:11240:x1877942616500992:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:2.0:1790945944.617844:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4083517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+57:11240:x1877942616500992:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 336us (537us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1790945944.617853:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:0.0:1790945944.841524:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945944.848125:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616501248 00000100:00100000:3.0:1790945944.848143:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616501248 00000100:00100000:3.0:1790945944.848237:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 74 00000100:00100000:3.0:1790945944.848248:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408aa8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+57:11258:x1877942616501248:12345-192.168.204.20@tcp:101:cat.0 00010000:00010000:3.0:1790945944.848273:0:8457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945944.848299:0:8457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d6af lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330b9f expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.848405:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27d6b6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.848421:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27d6b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.848432:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27d6b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945944.848443:0:8457:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1790945944.848541:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d6af lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b9f expref: 60 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.848559:0:8457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27d6b6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b9f expref: 59 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.848568:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:3.0:1790945944.848583:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1790945944.848588:0:8457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40813fea00, rc 0) 00000100:00100000:3.0:1790945944.848666:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408aa8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+59:11258:x1877942616501248:12345-192.168.204.20@tcp:101:cat.0 Request processed in 419us (7149us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1790945944.848672:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 74 00000100:00100000:1.0:1790945944.878541:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945944.878666:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616501376 00000100:00100000:3.0:1790945944.878675:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616501376 00000100:00100000:3.0:1790945944.878799:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 75 00000100:00100000:3.0:1790945944.878810:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4083514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+59:11259:x1877942616501376:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1790945944.878842:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945944.878871:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d6c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330ba6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.878940:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27d6cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.878976:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27d6cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.878987:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27d6cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945944.879029:0:6522:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1790945944.879033:0:6522:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790945944.879054:0:6522:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27d6cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.879079:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d6c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ba6 expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.879118:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27d6cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ba6 expref: 60 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945944.879127:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d40bc9ad200) 00010000:00010000:3.0:1790945944.879130:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790945944.879133:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40813ff800, rc 0) 00000100:00100000:3.0:1790945944.879334:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4083514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+60:11259:x1877942616501376:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 525us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945944.879342:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 75 00000100:00100000:1.0:1790945944.886504:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945944.886612:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616501760 00000100:00100000:0.0:1790945944.886622:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616501760 00000100:00100000:0.0:1790945944.886696:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 18 00000100:00100000:0.0:1790945944.886706:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4083515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+60:11259:x1877942616501760:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:0.0:1790945944.887042:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4083515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+61:11259:x1877942616501760:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 337us (547us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1790945944.887050:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 18 00000100:00100000:2.0:1790945944.889159:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945944.889334:0:7471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616501888 00000100:00100000:1.0:1790945944.889344:0:7471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616501888 00000100:00100000:1.0:1790945944.889409:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00100000:1.0:1790945944.889418:0:7471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+61:11259:x1877942616501888:12345-192.168.204.20@tcp:103:lfs.0 00010000:00010000:1.0:1790945944.889432:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1790945944.889479:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d65b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b8a expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945944.889511:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27d6b6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b9f expref: 60 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945944.889534:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363cc00/0xd9f4181e0d27d558 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b44 expref: 59 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945944.889545:0:7471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:1.0:1790945944.889550:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945944.889617:0:7471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+58:11259:x1877942616501888:12345-192.168.204.20@tcp:103:lfs.0 Request processed in 200us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945944.889625:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00100000:1.0:1790945944.892134:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945944.892223:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616502016 00000100:00100000:2.0:1790945944.892233:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616502016 00000100:00100000:2.0:1790945944.892316:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 76 00000100:00100000:2.0:1790945944.892325:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4083516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+58:11259:x1877942616502016:12345-192.168.204.20@tcp:58:lfs.0 00010000:00010000:2.0:1790945944.892446:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27d6d2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.892464:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27d6d2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.892475:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27d6d2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790945944.892735:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790945944.892874:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1790945944.893136:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1790945944.893470:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4083516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+58:11259:x1877942616502016:12345-192.168.204.20@tcp:58:lfs.0 Request processed in 1144us (1342us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945944.893480:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 76 00000100:00100000:1.0:1790945944.934893:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945944.939460:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616502144 00000100:00100000:3.0:1790945944.939477:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616502144 00000100:00100000:2.0:1790945944.943958:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 77 00000100:00100000:2.0:1790945944.943975:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4083515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+58:11261:x1877942616502144:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1790945944.943999:0:8457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945944.944020:0:8457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d6d9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330bad expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.944107:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27d6e0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.944132:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27d6e0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.944143:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27d6e0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.944221:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d6e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.944246:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d6e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.944254:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d6e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.944341:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d6ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.944351:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d6ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.944358:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d6ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945944.944399:0:8457:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1790945944.944404:0:8457:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790945944.944421:0:8457:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d6ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.944432:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d6ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.944440:0:8457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27d6e0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.944446:0:8457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27d6e0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.944462:0:8457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27d6e0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.944468:0:8457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f8363c200 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945944.944473:0:8457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27d6e0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.944481:0:8457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27d6e0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.944505:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d40bc9ad200) 00010000:00010000:2.0:1790945944.944509:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945944.944513:0:8457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27d6e0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.944520:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27d6e0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.944534:0:8457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d6e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.944540:0:8457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d6e7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.944546:0:8457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d6e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.944551:0:8457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f8363ce00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945944.944554:0:8457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d6e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.944571:0:8457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d6e7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.944579:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d40bc9ad600) 00010000:00010000:2.0:1790945944.944581:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945944.945032:0:8457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d6e7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.945041:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d6e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.945074:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d6d9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bad expref: 60 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.945087:0:8457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d6ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bad expref: 59 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945944.945095:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:2.0:1790945944.945097:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790945944.945099:0:8457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f8363d600, rc 0) 00000100:00100000:2.0:1790945944.945206:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4083515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+59:11261:x1877942616502144:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 1235us (10322us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945944.945214:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 77 00010000:00010000:2.0:1790945945.055496:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945945.440600:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638606080:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790945945.440685:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945945.440847:0:11925:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638606080 00000100:00100000:3.0:1790945945.440855:0:11925:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638606080 00000100:00100000:0.0:1790945945.440906:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4081325180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638606208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790945945.440918:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1790945945.440928:0:11925:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4083517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638606080:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790945945.440933:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1790945945.440971:0:11925:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790945945.440989:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638606208 00000100:00100000:0.0:1790945945.440993:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638606208 00000100:00100000:3.0:1790945945.441017:0:11925:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4083517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638606080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945945.441017:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1790945945.441022:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4081324700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638606208:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790945945.441024:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00002000:00000024:0.0:1790945945.441032:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790945945.441076:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638606080:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1790945945.441130:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790945945.448866:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4081324700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638606208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7832us (7919us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945945.448883:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1790945945.451912:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4081325180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638606208:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1790945945.762041:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790945945.762892:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790945945.762956:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1790945945.762964:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790945945.763124:0:13803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff96d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13803:1877942638606336:192.168.204.20@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790945945.764508:0:13803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408fc76540 going to sleep for 11 seconds 00000100:00100000:2.0:1790945945.773670:0:13803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff96d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13803:1877942638606336:192.168.204.20@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790945945.778542:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945945.778586:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616502272 00000100:00100000:0.0:1790945945.778597:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616502272 00000100:00100000:0.0:1790945945.778650:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 78 00000100:00100000:0.0:1790945945.778660:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4081325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+59:11272:x1877942616502272:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790945945.778691:0:6522:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790945945.778801:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4081325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+59:11272:x1877942616502272:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 Request processed in 142us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945945.778809:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 78 00000100:00100000:3.0:1790945945.787700:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945945.787736:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616502400 00000100:00100000:3.0:1790945945.787746:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616502400 00000100:00100000:3.0:1790945945.787798:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 79 00000100:00100000:3.0:1790945945.787807:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+59:11272:x1877942616502400:12345-192.168.204.20@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1790945945.787882:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d6f5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.787900:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d6f5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.787913:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d6f5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.787975:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27d6fc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.787983:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27d6fc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.787990:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27d6fc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.788017:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d703 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.788026:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d703 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.788033:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d703 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945945.788087:0:13005:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1790945945.788092:0:13005:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790945945.788108:0:13005:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d703 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.788119:0:13005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d6f5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.788126:0:13005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d6f5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.788133:0:13005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d6f5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.788139:0:13005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40813fe800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945945.788143:0:13005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d6f5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.788150:0:13005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d6f5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.788160:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3f824ec400) 00010000:00010000:3.0:1790945945.788163:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945945.788359:0:13005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d6f5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.788366:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d6f5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.788381:0:13005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27d6fc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.788397:0:13005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27d6fc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.788402:0:13005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27d6fc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.788407:0:13005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40813fea00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945945.788411:0:13005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27d6fc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.788417:0:13005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27d6fc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.788425:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9d3f8259f900) 00010000:00010000:3.0:1790945945.788428:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945945.788430:0:13005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27d6fc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.788436:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27d6fc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.788451:0:13005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d703 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.788457:0:13005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d703 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.788463:0:13005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d703 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.788467:0:13005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080031800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945945.788475:0:13005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d703 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.788481:0:13005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d703 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.788487:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:3.0:1790945945.788489:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945945.788492:0:13005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d703 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.788497:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d703 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945945.790126:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+59:11272:x1877942616502400:12345-192.168.204.20@tcp:34:lhsmtool_posix.0 Request processed in 2309us (2426us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945945.790139:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 79 00000100:00100000:3.0:1790945945.793848:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945945.801123:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616502656 00000100:00100000:1.0:1790945945.801140:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616502656 00000100:00100000:1.0:1790945945.801236:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 80 00000100:00100000:1.0:1790945945.801248:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+59:11272:x1877942616502656:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790945945.801270:0:8457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945945.801292:0:8457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd000/0xd9f4181e0d27d70a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330bb4 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945945.801417:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc800/0xd9f4181e0d27d711 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945945.801434:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc800/0xd9f4181e0d27d711 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945945.801444:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc800/0xd9f4181e0d27d711 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790945945.801455:0:8457:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1790945945.801531:0:8457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc800/0xd9f4181e0d27d711 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945945.801540:0:8457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc800/0xd9f4181e0d27d711 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945945.801547:0:8457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc800/0xd9f4181e0d27d711 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945945.801553:0:8457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afc800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:1.0:1790945945.801558:0:8457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc800/0xd9f4181e0d27d711 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945945.801565:0:8457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc800/0xd9f4181e0d27d711 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945945.801587:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:1.0:1790945945.801591:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790945945.801596:0:8457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc800/0xd9f4181e0d27d711 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945945.801614:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc800/0xd9f4181e0d27d711 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945945.801659:0:8457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd000/0xd9f4181e0d27d70a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bb4 expref: 61 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945945.801670:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3f824ec400) 00010000:00010000:1.0:1790945945.801672:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790945945.801676:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd000/0xd9f4181e0d27d70a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bb4 expref: 61 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945945.801684:0:8457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4092afd000, rc 0) 00000100:00100000:1.0:1790945945.801755:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+60:11272:x1877942616502656:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 510us (7918us total) trans 4294967353 rc 301/301 00000100:00100000:1.0:1790945945.801764:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 80 00000100:00100000:0.0:1790945945.810637:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945945.814471:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616502784 00000100:00100000:1.0:1790945945.814486:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616502784 00000100:00100000:1.0:1790945945.814551:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 81 00000100:00100000:1.0:1790945945.814562:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4081324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+60:11272:x1877942616502784:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790945945.814610:0:6521:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790945945.814740:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4081324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+60:11272:x1877942616502784:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 Request processed in 179us (4179us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945945.814749:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 81 00000100:00100000:1.0:1790945945.818411:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945945.818688:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616503040 00000100:00100000:0.0:1790945945.818718:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616503040 00000100:00100000:0.0:1790945945.818777:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 82 00000100:00100000:0.0:1790945945.818787:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4083515f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+60:11272:x1877942616503040:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790945945.818806:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945945.818809:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790945945.818834:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27d6cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ba6 expref: 60 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945945.818850:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d40bc9ad200) 00010000:00010000:0.0:1790945945.818855:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790945945.818868:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27d71f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330bbb expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790945945.819387:0:6523:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:0.0:1790945945.819539:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27d726 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945945.819551:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27d726 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945945.819561:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27d726 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945945.819609:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27d71f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bbb expref: 62 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945945.819626:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27d726 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bbb expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945945.819647:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d40bc9ad000) 00010000:00010000:0.0:1790945945.819650:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790945945.819652:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe1a00, rc 0) 00000100:00100000:0.0:1790945945.819712:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4083515f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+61:11272:x1877942616503040:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 926us (1308us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1790945945.819720:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 82 00000100:00100000:3.0:1790945945.828533:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945945.828569:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616503296 00000100:00100000:3.0:1790945945.828580:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616503296 00000100:00100000:3.0:1790945945.828634:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 83 00000100:00100000:3.0:1790945945.828645:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+61:11272:x1877942616503296:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790945945.828706:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945945.828732:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27d726 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bbb expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.828753:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d40bc9ad000) 00010000:00010000:3.0:1790945945.828763:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790945945.828793:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d734 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.828807:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d734 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.828817:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d734 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.828830:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27d73b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xf19a1902 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.828837:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27d73b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xf19a1902 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.828843:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27d73b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xf19a1902 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.828885:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d734 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.828892:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d734 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.828898:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d734 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.828904:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080031800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945945.828908:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d734 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.828916:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d734 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.828947:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d40bc9ad200) 00010000:00010000:3.0:1790945945.828950:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945945.828954:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d734 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.828960:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27d734 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.828972:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27d73b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xf19a1902 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.828977:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27d73b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xf19a1902 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.828983:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27d73b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xf19a1902 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.828988:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080030a00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945945.828991:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27d73b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xf19a1902 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.828997:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27d73b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xf19a1902 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.829004:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xf19a1902 (ffff9d3f8259f900) 00010000:00010000:3.0:1790945945.829006:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945945.829009:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27d73b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xf19a1902 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.829015:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27d73b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xf19a1902 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945945.829100:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+60:11272:x1877942616503296:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 457us (577us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790945945.829108:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 83 00000100:00100000:3.0:1790945945.831875:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000001:00080000:3.0:1790945945.833527:0:6500:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:3.0:1790945945.833588:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1790945945.833606:0:6500:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d40af660300 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1790945945.833611:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d40b4c0b000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d40bb00a900 00000020:00080000:3.0:1790945945.833614:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d40b4c0b300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d40836c2e00 00000100:00100000:3.0:1790945945.833742:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638606464:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1790945945.833799:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945945.833871:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638606464 00000100:00100000:3.0:1790945945.833878:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638606464 00000100:00100000:3.0:1790945945.833939:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790945945.833950:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1877942638606464:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1790945945.833973:0:8437:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:3.0:1790945945.834006:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6abfaa97, atime: 0x6abfaa97, ctime: 0x6abfaa97, blocks: 0x8 00010000:00010000:3.0:1790945945.834014:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a7d99fb/0xd9f4181e0d27d742 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.834030:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=396s v=(0 0) 00010000:00010000:3.0:1790945945.834034:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945945.834040:0:8437:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a7d99fb/0xd9f4181e0d27d742 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.834085:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a7d99fb/0xd9f4181e0d27d742 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.834096:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a7d99fb/0xd9f4181e0d27d742 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.834104:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a7d99fb/0xd9f4181e0d27d742 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.834125:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790945945.834332:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27d494 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945945.834351:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27d494 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945945.834357:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27d494 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945945.834363:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe1200 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945945.834368:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27d494 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945945.834376:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27d494 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945945.834389:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9d40bc9ad100) 00010000:00010000:2.0:1790945945.834393:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945945.834397:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27d494 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945945.834403:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27d494 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945945.834423:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27d49b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945945.834428:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27d49b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945945.834433:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27d49b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945945.834438:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe1400 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945945.834445:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27d49b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945945.834451:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27d49b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945945.834458:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d40bc9ad200) 00010000:00010000:2.0:1790945945.834460:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945945.834462:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27d49b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945945.834467:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27d49b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945945.834479:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27d4da lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945945.834485:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27d4da lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945945.834490:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27d4da lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945945.834495:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe1e00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945945.834497:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27d4da lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945945.834502:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27d4da lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945945.834507:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d40bc9ad600) 00010000:00010000:2.0:1790945945.834510:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945945.834516:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27d4da lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945945.834522:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27d4da lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945945.834537:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d5e4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945945.834543:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d5e4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945945.834547:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d5e4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945945.834552:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f8363c000 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945945.834555:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d5e4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945945.834560:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d5e4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945945.834569:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:2.0:1790945945.834571:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945945.834574:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d5e4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945945.834580:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d5e4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945945.834590:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d607 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945945.834596:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d607 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945945.834608:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d607 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945945.834612:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0400 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945945.834615:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d607 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945945.834621:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d607 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945945.834628:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:2.0:1790945945.834631:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945945.834634:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d607 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945945.834639:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d607 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945945.834651:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27d64d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945945.834657:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27d64d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945945.834662:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27d64d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945945.834667:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f8363ca00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945945.834670:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27d64d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945945.834685:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27d64d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945945.834693:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:2.0:1790945945.834696:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945945.834698:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27d64d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945945.834703:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27d64d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945945.834887:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3648:x1877942638606464:12345-0@lo:6:osp-syn-1-0.0 Request processed in 938us (1086us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1790945945.834894:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1790945945.834919:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1790945945.834940:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790945945.834947:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a7d99fb/0xd9f4181e0d27d742 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.834955:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40813fea00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:3.0:1790945945.834959:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a7d99fb/0xd9f4181e0d27d742 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.834966:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a7d99fb/0xd9f4181e0d27d742 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.834991:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a7d99fb/0xd9f4181e0d27d742 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.834998:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a7d99fb/0xd9f4181e0d27d742 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.835014:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945945.835017:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945945.835018:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1790945945.835188:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d40bff94380/2, rc 0, transno 4294967302 00000100:00100000:2.0:1790945945.835196:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638606464:0@lo:6:osp-syn-1-0.0 00000020:00080000:0.0:1790945945.835528:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1790945945.835682:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1790945945.837052:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616503424 00000100:00100000:1.0:1790945945.837064:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616503424 00000100:00100000:1.0:1790945945.837134:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 84 00000100:00100000:1.0:1790945945.837144:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+11:11272:x1877942616503424:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790945945.837164:0:13005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945945.837343:0:13005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd000/0xd9f4181e0d27d749 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330bc2 expref: -99 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945945.837386:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc800/0xd9f4181e0d27d750 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945945.837402:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc800/0xd9f4181e0d27d750 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945945.837414:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc800/0xd9f4181e0d27d750 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945945.837522:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd000/0xd9f4181e0d27d749 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bc2 expref: 13 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945945.837540:0:13005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc800/0xd9f4181e0d27d750 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bc2 expref: 12 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945945.837549:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d3f83dbad00) 00010000:00010000:1.0:1790945945.837551:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790945945.837555:0:13005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4092afc800, rc 0) 00000100:00100000:1.0:1790945945.837622:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+12:11272:x1877942616503424:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 479us (5756us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945945.837630:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 84 00000100:00100000:0.0:1790945945.843383:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945945.843797:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616503680 00000100:00100000:3.0:1790945945.843809:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616503680 00000100:00100000:3.0:1790945945.843906:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 85 00000100:00100000:3.0:1790945945.843918:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4081327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+12:11272:x1877942616503680:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790945945.844015:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d757 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.844031:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d757 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.844041:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d757 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790945945.844308:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1790945945.844319:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 396660150963ns, next at 397660148535ns, rc = 0 00000004:00010000:3.0:1790945945.844367:0:6522:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b6767cd4 reply state 00000000fc70f281 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d757 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.844381:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d757 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.844400:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d3f83dbad00) 00010000:00010000:3.0:1790945945.844402:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1790945945.844406:0:6522:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790945945.844508:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4081327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+14:11272:x1877942616503680:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 592us (1135us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1790945945.844516:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 85 00000100:00100000:2.0:1790945945.850394:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945945.850441:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616503808 00000100:00100000:2.0:1790945945.850452:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616503808 00000100:00100000:2.0:1790945945.850508:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 86 00000100:00100000:2.0:1790945945.850518:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+14:11272:x1877942616503808:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790945945.850541:0:8457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945945.850561:0:8457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d75e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330bc9 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945945.850624:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d75e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bc9 expref: 15 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945945.850638:0:8457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d75e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bc9 expref: 15 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945945.850678:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d3f83dbad00) 00010000:00010000:2.0:1790945945.850681:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790945945.850684:0:8457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f8363ce00, rc 0) 00000100:00100000:2.0:1790945945.850743:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+15:11272:x1877942616503808:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 226us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945945.850750:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 86 00000100:00100000:3.0:1790945945.856427:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945945.856661:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616503936 00000100:00100000:2.0:1790945945.856672:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616503936 00000100:00100000:2.0:1790945945.856722:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 33 00000100:00100000:2.0:1790945945.856731:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2400:x1877942616503936:12345-192.168.204.20@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1790945945.856766:0:8916:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 0cadc7a5-c0ba-4320-984f-d871ffb3a3ef@192.168.204.20@tcp t0 exp 0000000000000000 cur 396 last 0 00000020:00000080:2.0:1790945945.856801:0:8916:0:(genops.c:1384:class_connect()) connect: client 0cadc7a5-c0ba-4320-984f-d871ffb3a3ef, cookie 0xd9f4181e0d27d765 00002000:00100000:2.0:1790945945.856814:0:8916:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0cadc7a5-c0ba-4320-984f-d871ffb3a3ef/ffff9d40914e0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790945945.856825:0:8916:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790945945.856909:0:8916:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790945945.856949:0:8916:0:(import.c:65:import_set_state_nolock()) ffff9d40914e0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790945945.857020:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2400:x1877942616503936:12345-192.168.204.20@tcp:8:lhsmtool_posix.0 Request processed in 287us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945945.857028:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 33 00000100:00100000:3.0:1790945945.869814:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945945.869898:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616504064 00000100:00100000:1.0:1790945945.869918:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616504064 00000100:00100000:1.0:1790945945.870037:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 34 00000100:00100000:1.0:1790945945.870046:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:0:x1877942616504064:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 00000001:00080000:0.0:1790945945.879433:0:8429:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:0.0:1790945945.879451:0:8429:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0cadc7a5-c0ba-4320-984f-d871ffb3a3ef 00000100:00100000:2.0:1790945945.879651:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:0:x1877942616504064:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 Request processed in 9600us (9841us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1790945945.879663:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 34 00000100:00080000:3.0:1790945945.880461:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790945945.884517:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945945.885334:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616504320 00000100:00100000:0.0:1790945945.885347:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616504320 00000100:00100000:0.0:1790945945.891382:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:0.0:1790945945.891405:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+15:11272:x1877942616504320:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790945945.892320:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+16:11272:x1877942616504320:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 Request processed in 771us (7658us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1790945945.892331:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:2.0:1790945945.897740:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945945.897792:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616504576 00000100:00100000:2.0:1790945945.897818:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616504576 00000100:00100000:2.0:1790945945.897871:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 87 00000100:00100000:2.0:1790945945.897882:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+16:11272:x1877942616504576:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790945945.898006:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+16:11272:x1877942616504576:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 126us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945945.898014:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 87 00000100:00100000:3.0:1790945945.900558:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945945.905405:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616504704 00000100:00100000:0.0:1790945945.905422:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616504704 00000100:00100000:0.0:1790945945.905545:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 88 00000100:00100000:0.0:1790945945.905556:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+16:11272:x1877942616504704:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790945945.905577:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945945.905599:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27d76c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330bd0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945945.905683:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d773 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945945.905699:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d773 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945945.905710:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d773 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945945.905766:0:6521:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790945945.905786:0:6521:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d773 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945945.905823:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27d76c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bd0 expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945945.905843:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d773 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bd0 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945945.905852:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d3f83dbad00) 00010000:00010000:0.0:1790945945.905855:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790945945.905858:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe0400, rc 0) 00000100:00100000:0.0:1790945945.905924:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+17:11272:x1877942616504704:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 370us (5374us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945945.905943:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 88 00000100:00100000:2.0:1790945945.918953:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945945.918989:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616504832 00000100:00100000:3.0:1790945945.918998:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616504832 00000100:00100000:3.0:1790945945.919062:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 35 00000100:00100000:3.0:1790945945.919071:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2404:x1877942616504832:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790945945.919088:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945945.919110:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a7d99fb/0xd9f4181e0d27d77a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330bd7 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790945945.919136:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abfaa9a, blocks: 0x0 00010000:00010000:3.0:1790945945.919154:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=396s v=(0 0) 00010000:00010000:3.0:1790945945.919159:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945945.919224:0:8437:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a7d99fb/0xd9f4181e0d27d77a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bd7 expref: 6 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.919247:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004a7d99fb/0xd9f4181e0d27d77a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bd7 expref: 6 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.919267:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40813fea00, rc 0) 00000100:00100000:3.0:1790945945.919325:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2404:x1877942616504832:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 254us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945945.919333:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 35 00000100:00100000:2.0:1790945945.925728:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945945.927252:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616505088 00000100:00100000:3.0:1790945945.927269:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616505088 00000100:00100000:2.0:1790945945.927386:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 89 00000100:00100000:2.0:1790945945.927397:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+17:11272:x1877942616505088:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790945945.927506:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+17:11272:x1877942616505088:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 110us (1788us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945945.927514:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 89 00000040:00080000:1.0:1790945945.928668:0:14212:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790945945.928675:0:14212:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790945945.928702:0:14212:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1790945945.928708:0:14212:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790945945.932704:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945945.932791:0:8436:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616505216 00000100:00100000:1.0:1790945945.932801:0:8436:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616505216 00000100:00100000:1.0:1790945945.932858:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 36 00000100:00100000:1.0:1790945945.932868:0:8436:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:11272:x1877942616505216:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790945945.932887:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945945.932905:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017f3cf83/0xd9f4181e0d27d781 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330bde expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945945.932949:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004a7d99fb/0xd9f4181e0d27d77a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bd7 expref: 7 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945945.932959:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945945.932963:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945945.932968:0:8436:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017f3cf83/0xd9f4181e0d27d781 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bde expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945945.933002:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004a7d99fb/0xd9f4181e0d27d77a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bd7 expref: 7 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945945.933016:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004a7d99fb/0xd9f4181e0d27d77a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bd7 expref: 7 pid: 8437 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945945.933047:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4083514700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1877942638606592:192.168.204.20@tcp:104: 00000100:00100000:1.0:1790945945.933136:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408554e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790945945.937850:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945945.938470:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4083514700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1877942638606592:192.168.204.20@tcp:104: 00010000:00010000:1.0:1790945945.938503:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000017f3cf83/0xd9f4181e0d27d781 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bde expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945945.938523:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4092afd400, rc 0) 00000100:00100000:1.0:1790945945.938590:0:8436:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:11272:x1877942616505216:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 5722us (5893us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945945.938599:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 36 00000100:00100000:3.0:1790945945.941695:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616505344 00000100:00100000:3.0:1790945945.941713:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616505344 00010000:00010000:3.0:1790945945.941768:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004a7d99fb/0xd9f4181e0d27d77a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bd7 expref: 7 pid: 8437 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945945.941913:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 59 00000100:00100000:3.0:1790945945.941923:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:2404:x1877942616505344:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790945945.941954:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945945.941977:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004a7d99fb/0xd9f4181e0d27d77a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bd7 expref: 7 pid: 8437 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.941992:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004a7d99fb/0xd9f4181e0d27d77a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bd7 expref: 7 pid: 8437 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.942015:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a7d99fb/0xd9f4181e0d27d77a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bd7 expref: 7 pid: 8437 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.942042:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945945.942047:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945945.942057:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000017f3cf83/0xd9f4181e0d27d781 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bde expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.942067:0:6506:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017f3cf83/0xd9f4181e0d27d781 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bde expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945945.942107:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000017f3cf83/0xd9f4181e0d27d781 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bde expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945945.942123:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff95f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6506:1877942638606720:192.168.204.20@tcp:105: 00000100:00100000:3.0:1790945945.942245:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4084352c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790945945.944047:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff95f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6506:1877942638606720:192.168.204.20@tcp:105: 00010000:00010000:3.0:1790945945.944075:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945945.944131:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2404:x1877942616505344:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 2209us (6290us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945945.944142:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 59 00000100:00100000:2.0:1790945945.945418:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945945.945492:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616505472 00000100:00100000:3.0:1790945945.945502:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616505472 00002000:00100000:3.0:1790945945.945549:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9d40bff83100 x1877942616505472/t0(0) o4->0cadc7a5-c0ba-4320-984f-d871ffb3a3ef@192.168.204.20@tcp:641/0 lens 504/0 e 0 to 0 dl 1790945956 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790945945.945559:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d40bff83100 with x1877942616505472 ext(0->8) 00002000:00010000:3.0:1790945945.945564:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d40bff83100 00000100:00100000:3.0:1790945945.945620:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:3.0:1790945945.945630:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2404:x1877942616505472:12345-192.168.204.20@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1790945945.950386:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+8:2404:x1877942616505472:12345-192.168.204.20@tcp:4:lhsmtool_posix.0 Request processed in 4750us (4966us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1790945945.950401:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 0 00002000:00100000:3.0:1790945945.950414:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9d40bff83100 x1877942616505472/t4294967303(0) o4->0cadc7a5-c0ba-4320-984f-d871ffb3a3ef@192.168.204.20@tcp:641/0 lens 504/448 e 0 to 0 dl 1790945956 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790945945.950425:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d40bff83100 with x1877942616505472 ext(0->8) 00002000:00010000:3.0:1790945945.950432:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d40bff83100 00000100:00100000:2.0:1790945945.956901:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945945.957000:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616505600 00000100:00100000:3.0:1790945945.957012:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616505600 00000100:00100000:3.0:1790945945.957078:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 90 00000100:00100000:3.0:1790945945.957088:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+17:11272:x1877942616505600:12345-192.168.204.20@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1790945945.963477:0:6500:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:0.0:1790945945.963493:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1790945945.963506:0:6500:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:0.0:1790945945.964392:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1790945945.964406:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:1.0:1790945945.965344:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d757 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945945.965360:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d757 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945945.965368:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d757 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945945.965374:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40813fe800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:1.0:1790945945.965379:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d757 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945945.965386:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d757 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945945.965402:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d3f83dbad00) 00010000:00010000:1.0:1790945945.965414:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790945945.965420:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d757 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945945.965427:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d757 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945945.967134:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+14:11272:x1877942616505600:12345-192.168.204.20@tcp:44:lhsmtool_posix.0 Request processed in 10037us (10232us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945945.967148:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 90 00000100:00100000:3.0:1790945945.967447:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638606848:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1790945945.967501:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945945.967573:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638606848 00000100:00100000:1.0:1790945945.967581:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638606848 00000100:00100000:1.0:1790945945.967624:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790945945.967633:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638606848:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1790945945.967752:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1790945945.967756:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1790945946 00002000:00010000:1.0:1790945945.967770:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1790945945.967773:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1790945946 -> 1790945946 00002000:00010000:1.0:1790945945.967775:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1790945945.968684:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1877942638606848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1047us (1178us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1790945945.968694:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:2.0:1790945945.968843:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d40bff82680/2, rc 0, transno 4294967304 00000100:00100000:2.0:1790945945.968851:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638606848:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1790945945.971650:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945945.971791:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616505728 00000100:00100000:3.0:1790945945.971801:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616505728 00000100:00100000:3.0:1790945945.971863:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 38 00000100:00100000:3.0:1790945945.971874:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+8:2403:x1877942616505728:12345-192.168.204.20@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1790945945.974091:0:8429:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:0.0:1790945945.974106:0:8429:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:3.0:1790945945.974596:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2403:x1877942616505728:12345-192.168.204.20@tcp:16:lhsmtool_posix.0 Request processed in 2710us (2941us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945945.974619:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 38 00000100:00100000:2.0:1790945945.986292:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945945.987496:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616505984 00000100:00100000:0.0:1790945945.987509:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616505984 00000100:00100000:0.0:1790945945.987580:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 91 00000100:00100000:0.0:1790945945.987590:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+14:11272:x1877942616505984:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790945945.987646:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945945.987673:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d773 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bd0 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945945.987692:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d3f83dbad00) 00010000:00010000:0.0:1790945945.987696:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790945945.987723:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27d788 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945945.987737:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27d788 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945945.987746:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27d788 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790945945.988118:0:6521:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ba5fd962 reply state 0000000020b43274 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27d788 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945945.988132:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27d788 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945945.988138:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d3f83dbad00) 00010000:00010000:0.0:1790945945.988155:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790945945.988158:0:6521:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790945945.988389:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+15:11272:x1877942616505984:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 799us (2105us total) trans 4294967357 rc 0/0 00000100:00100000:0.0:1790945945.988397:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 91 00000100:00100000:2.0:1790945945.999016:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945945.999248:0:8436:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616506112 00000100:00100000:1.0:1790945945.999258:0:8436:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616506112 00000100:00100000:1.0:1790945945.999315:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 39 00000100:00100000:1.0:1790945945.999324:0:8436:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2404:x1877942616506112:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1790945945.999492:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1790945945.999496:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1790945946 -> 1790945944 00002000:00010000:1.0:1790945945.999498:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1790945943 00002000:00010000:1.0:1790945945.999500:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1790945946 -> 1790945944 00002000:00010000:1.0:1790945945.999502:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1790945945.999576:0:8436:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:2404:x1877942616506112:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 Request processed in 252us (570us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1790945945.999583:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 39 00000100:00100000:2.0:1790945946.006449:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945946.006686:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616506368 00000100:00100000:0.0:1790945946.006697:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616506368 00000100:00080000:2.0:1790945946.006990:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790945946.007035:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 92 00000100:00100000:0.0:1790945946.007047:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40accd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+15:11272:x1877942616506368:12345-192.168.204.20@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1790945946.007117:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d78f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945946.007135:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc800/0xd9f4181e0d27d750 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bc2 expref: 15 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945946.007145:0:6523:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d78f lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945946.007197:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc800/0xd9f4181e0d27d750 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bc2 expref: 15 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945946.007213:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc800/0xd9f4181e0d27d750 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bc2 expref: 15 pid: 13005 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945946.007227:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4081327b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1877942638606976:192.168.204.20@tcp:104: 00000100:00100000:0.0:1790945946.007320:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4d05780 going to sleep for 11 seconds 00000100:00100000:1.0:1790945946.012437:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945946.012570:0:7471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616506496 00000100:00100000:2.0:1790945946.012579:0:7471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616506496 00010000:00010000:2.0:1790945946.012683:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc800/0xd9f4181e0d27d750 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bc2 expref: 16 pid: 13005 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945946.012775:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 60 00000100:00100000:2.0:1790945946.012785:0:7471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4083514700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+16:2403:x1877942616506496:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790945946.012811:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945946.012819:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc800/0xd9f4181e0d27d750 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bc2 expref: 16 pid: 13005 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945946.012832:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc800/0xd9f4181e0d27d750 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bc2 expref: 16 pid: 13005 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945946.012854:0:7471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d3f83dbad00) 00010000:00010000:2.0:1790945946.012859:0:7471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d78f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945946.012870:0:7471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d78f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945946.012877:0:7471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d78f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945946.012896:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945946.012962:0:7471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4083514700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+16:2403:x1877942616506496:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 179us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945946.012970:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 60 00010000:00010000:0.0:1790945946.013986:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc800/0xd9f4181e0d27d750 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bc2 expref: 15 pid: 13005 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945946.014021:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4081327b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1877942638606976:192.168.204.20@tcp:104: 00010000:00010000:0.0:1790945946.014045:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d78f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945946.014055:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d78f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945946.014062:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d78f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945946.014106:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d78f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945946.014114:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d78f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945946.014121:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d78f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945946.014127:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0400 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945946.014132:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d78f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945946.014140:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d78f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945946.014153:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d3f83dbad00) 00010000:00010000:0.0:1790945946.014156:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1790945946.014159:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d78f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945946.014977:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d78f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945946.015042:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40accd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+14:11272:x1877942616506368:12345-192.168.204.20@tcp:55:lhsmtool_posix.0 Request processed in 7996us (8600us total) trans 0 rc -22/-22 00000100:00100000:0.0:1790945946.015051:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 92 00000100:00100000:3.0:1790945946.033810:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945946.033891:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616506624 00000100:00100000:1.0:1790945946.033902:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616506624 00000100:00100000:1.0:1790945946.034004:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 40 00000100:00100000:1.0:1790945946.034013:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:2403:x1877942616506624:12345-192.168.204.20@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1790945946.034060:0:8916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b9b655dc/0xd9f4181e0d27d796 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945946.034080:0:8916:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000017f3cf83/0xd9f4181e0d27d781 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bde expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945946.034088:0:8916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945946.034092:0:8916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790945946.034097:0:8916:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9b655dc/0xd9f4181e0d27d796 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945946.034138:0:8916:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000017f3cf83/0xd9f4181e0d27d781 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bde expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945946.034154:0:8916:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000017f3cf83/0xd9f4181e0d27d781 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bde expref: 7 pid: 8436 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945946.034183:0:8916:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4083514e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8916:1877942638607104:192.168.204.20@tcp:104: 00000100:00100000:1.0:1790945946.034290:0:8916:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408554e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945946.037725:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945946.037784:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616506752 00000100:00100000:2.0:1790945946.037794:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616506752 00010000:00010000:2.0:1790945946.037845:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000017f3cf83/0xd9f4181e0d27d781 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bde expref: 8 pid: 8436 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945946.037904:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 61 00000100:00100000:2.0:1790945946.037914:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+8:2403:x1877942616506752:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790945946.037940:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945946.037962:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000017f3cf83/0xd9f4181e0d27d781 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bde expref: 8 pid: 8436 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945946.037976:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000017f3cf83/0xd9f4181e0d27d781 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bde expref: 8 pid: 8436 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945946.038005:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790945946.038010:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790945946.038015:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b9b655dc/0xd9f4181e0d27d796 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945946.038025:0:6508:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9b655dc/0xd9f4181e0d27d796 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945946.038046:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945946.038096:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+8:2403:x1877942616506752:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 184us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945946.038103:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 61 00010000:00010000:1.0:1790945946.041115:0:8916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017f3cf83/0xd9f4181e0d27d781 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bde expref: 7 pid: 8436 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945946.041136:0:8916:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4083514e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8916:1877942638607104:192.168.204.20@tcp:104: 00010000:00010000:1.0:1790945946.041159:0:8916:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b9b655dc/0xd9f4181e0d27d796 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945946.041192:0:8916:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b9b655dc/0xd9f4181e0d27d796 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945946.041200:0:8916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9b655dc/0xd9f4181e0d27d796 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945946.041229:0:8916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b9b655dc/0xd9f4181e0d27d796 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945946.041237:0:8916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9b655dc/0xd9f4181e0d27d796 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945946.041246:0:8916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9b655dc/0xd9f4181e0d27d796 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945946.041253:0:8916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afd800 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:1.0:1790945946.041257:0:8916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9b655dc/0xd9f4181e0d27d796 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945946.041278:0:8916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9b655dc/0xd9f4181e0d27d796 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945946.041297:0:8916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9b655dc/0xd9f4181e0d27d796 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945946.041304:0:8916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9b655dc/0xd9f4181e0d27d796 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945946.041449:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2403:x1877942616506624:12345-192.168.204.20@tcp:1:lhsmtool_posix.0 Request processed in 7435us (7647us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945946.041460:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 40 00000100:00100000:3.0:1790945946.048294:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945946.048366:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616507008 00000100:00100000:2.0:1790945946.048380:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616507008 00000100:00100000:2.0:1790945946.048441:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 93 00000100:00100000:2.0:1790945946.048452:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+14:11272:x1877942616507008:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1790945946.048704:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d79d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945946.048722:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d5dd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b67 expref: 14 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945946.048732:0:6522:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d79d lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945946.048767:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d5dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b67 expref: 14 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945946.048780:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d5dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b67 expref: 14 pid: 8457 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945946.048792:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4087238380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1877942638607232:192.168.204.20@tcp:104: 00000100:00100000:2.0:1790945946.048951:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40af660e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790945946.052202:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4087238380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1877942638607232:192.168.204.20@tcp:104: 00010000:00010000:2.0:1790945946.052301:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d79d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945946.053205:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945946.053448:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616507136 00000100:00100000:1.0:1790945946.053456:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616507136 00010000:00010000:1.0:1790945946.053494:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d5dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b67 expref: 15 pid: 8457 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945946.053544:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 62 00000100:00100000:1.0:1790945946.053554:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4096cbc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+15:2404:x1877942616507136:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790945946.053578:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945946.053586:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d5dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b67 expref: 15 pid: 8457 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945946.053600:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d5dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b67 expref: 15 pid: 8457 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945946.053639:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27d5dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b67 expref: 15 pid: 8457 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945946.053655:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:1.0:1790945946.053660:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d79d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945946.053668:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d79d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945946.053676:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d79d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945946.053703:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945946.053816:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4096cbc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+14:2404:x1877942616507136:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 204us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945946.053827:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 62 00010000:00010000:3.0:1790945946.054627:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d79d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945946.054638:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d79d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945946.054823:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27d7a4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945946.054837:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d75e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bc9 expref: 14 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945946.054846:0:6522:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27d7a4 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945946.054878:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d75e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bc9 expref: 14 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945946.054892:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d75e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bc9 expref: 14 pid: 8457 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945946.054920:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff95880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1877942638607360:192.168.204.20@tcp:104: 00000100:00100000:3.0:1790945946.055000:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f824d8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790945946.057944:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff95880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1877942638607360:192.168.204.20@tcp:104: 00010000:00010000:2.0:1790945946.057985:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27d7a4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945946.062646:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945946.062739:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616507264 00000100:00100000:3.0:1790945946.062760:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616507264 00010000:00010000:3.0:1790945946.062805:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d75e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bc9 expref: 15 pid: 8457 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945946.062852:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 63 00000100:00100000:3.0:1790945946.062863:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4083515c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+15:2404:x1877942616507264:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790945946.062880:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945946.062887:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d75e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bc9 expref: 15 pid: 8457 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945946.062911:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d75e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bc9 expref: 15 pid: 8457 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945946.062943:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d75e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bc9 expref: 15 pid: 8457 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945946.062958:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d3f83dbad00) 00010000:00010000:3.0:1790945946.062963:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27d7a4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945946.062973:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27d7a4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945946.062981:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27d7a4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945946.063013:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945946.063062:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4083515c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+14:2404:x1877942616507264:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 200us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945946.063085:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 63 00010000:00010000:1.0:1790945946.063209:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27d7a4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945946.063218:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27d7a4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790945946.063351:0:6522:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:1.0:1790945946.063476:0:6522:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:1.0:1790945946.063511:0:6522:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:1.0:1790945946.063608:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4083514700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6522:1877942638607488:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1790945946.063657:0:6522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945946.063693:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bc8acc00 going to sleep for 11 seconds 00000100:00100000:3.0:1790945946.064352:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638607488 00000100:00100000:3.0:1790945946.064360:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638607488 00000100:00100000:3.0:1790945946.065526:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1790945946.065541:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4083514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6522:x1877942638607488:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1790945946.065660:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4083514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6522:x1877942638607488:12345-0@lo:1000:mdt00_001.0 Request processed in 123us (2001us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945946.065668:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1790945946.066240:0:6522:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1790945946.066248:0:6522:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d40bff82680, transno 4294967304 00000100:00100000:1.0:1790945946.066265:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4083514700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6522:1877942638607488:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1790945946.066415:0:6522:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:1.0:1790945946.066486:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4083514700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6522:1877942638607616:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1790945946.066529:0:6522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945946.070119:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4081377300 going to sleep for 11 seconds 00000100:00100000:0.0:1790945946.072314:0:12418:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638607616 00000100:00100000:0.0:1790945946.072328:0:12418:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638607616 00000100:00100000:1.0:1790945946.072915:0:12418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1790945946.072958:0:12418:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4083516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6522:x1877942638607616:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1790945946.073159:0:12418:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4083516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6522:x1877942638607616:12345-0@lo:1000:mdt00_001.0 Request processed in 234us (6628us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1790945946.073200:0:12418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1790945946.073393:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4083514700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6522:1877942638607616:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1790945946.073442:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27d7a4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945946.073464:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27d7a4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945946.073472:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27d7a4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945946.073479:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40813ff800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945946.073483:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27d7a4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945946.073491:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27d7a4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945946.073506:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d3f83dbad00) 00010000:00010000:2.0:1790945946.073509:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790945946.073513:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27d7a4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945946.073519:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27d7a4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945946.073559:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27d6d2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945946.073575:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27d6d2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945946.073581:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27d6d2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945946.073585:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f8363c600 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945946.073594:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27d6d2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945946.073601:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27d6d2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945946.073610:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:2.0:1790945946.073612:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790945946.073615:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27d6d2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945946.073621:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27d6d2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945946.073641:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d7ab lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945946.073654:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d6ee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bad expref: 17 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945946.073663:0:6522:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d7ab lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945946.073695:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d6ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bad expref: 17 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945946.073708:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d6ee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bad expref: 17 pid: 8457 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945946.073721:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4087238380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1877942638607744:192.168.204.20@tcp:104: 00000100:00100000:2.0:1790945946.073815:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40af660e40 going to sleep for 11 seconds 00010000:00010000:0.0:1790945946.079262:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945946.082454:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945946.083739:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616507392 00000100:00100000:0.0:1790945946.083764:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616507392 00010000:00010000:0.0:1790945946.083804:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d6ee lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bad expref: 18 pid: 8457 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945946.083845:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 64 00000100:00100000:0.0:1790945946.083856:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408723a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+18:2403:x1877942616507392:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790945946.083871:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945946.083878:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d6ee lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bad expref: 18 pid: 8457 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945946.083902:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d6ee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bad expref: 18 pid: 8457 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945946.083936:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:0.0:1790945946.083941:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d7ab lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945946.083950:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d7ab lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945946.083967:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d7ab lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945946.083987:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945946.084049:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408723a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+18:2403:x1877942616507392:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 194us (1603us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945946.084057:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 64 00010000:00010000:1.0:1790945946.087040:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d6ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bad expref: 17 pid: 8457 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945946.087207:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4087238380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1877942638607744:192.168.204.20@tcp:104: 00010000:00010000:1.0:1790945946.087231:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d7ab lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945946.087241:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d7ab lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945946.087247:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d7ab lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945946.087261:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d7ab lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945946.087284:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d7ab lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945946.087291:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d7ab lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945946.087298:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f8363c000 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:1.0:1790945946.087302:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d7ab lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945946.087310:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d7ab lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945946.087324:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:1.0:1790945946.087327:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945946.087332:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d7ab lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945946.087337:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d7ab lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945946.087349:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d79d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945946.087355:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d79d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945946.087360:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d79d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945946.087364:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f8363d400 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:1.0:1790945946.087373:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d79d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945946.087378:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d79d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945946.087386:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:1.0:1790945946.087389:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790945946.087392:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d79d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945946.087397:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d79d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790945946.087991:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790945946.087997:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790945946.088026:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1790945946.088033:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790945946.088199:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+16:11272:x1877942616507008:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 39745us (39911us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1790945946.088209:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 93 00000020:00080000:1.0:1790945946.088215:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1790945946.090452:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945946.090531:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616507648 00000100:00100000:0.0:1790945946.090542:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616507648 00000100:00100000:0.0:1790945946.090596:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 20 00000100:00100000:0.0:1790945946.090606:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408723b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+16:11272:x1877942616507648:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1790945946.090894:0:6525:0:(mdd_object.c:4180:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1790945946.090943:0:6525:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:0.0:1790945946.090979:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27d7b2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945946.090996:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27d7b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945946.091008:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27d7b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945946.091016:0:6525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27d7b2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945946.091022:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27d7b2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945946.091027:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27d7b2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945946.091205:0:6525:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790945946.091298:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408723b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+18:11272:x1877942616507648:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 Request processed in 692us (851us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1790945946.091307:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 20 00000020:00080000:0.0:1790945946.091312:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790945946.091980:0:10339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790945946.091993:0:10339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27d7b2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945946.092003:0:10339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0600 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:3.0:1790945946.092008:0:10339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27d7b2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945946.092017:0:10339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27d7b2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945946.092030:0:10339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d3f83dbad00) 00010000:00010000:3.0:1790945946.092034:0:10339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790945946.092039:0:10339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27d7b2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945946.092045:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27d7b2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945946.092237:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945946.092240:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945946.092242:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790945946.849156:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790945946.976848:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790945946.976878:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638607872:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790945946.976967:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945946.979865:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638607872 00000100:00100000:3.0:1790945946.979881:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638607872 00000100:00100000:3.0:1790945946.980028:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1790945946.980040:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4081327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638607872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790945946.980080:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1790945946.980203:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4081327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638607872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 165us (3235us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945946.980210:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1790945946.980313:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638607872:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1790945947.110096:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945947.205948:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945947.205999:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945947.206023:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945947.206048:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945947.206090:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945947.206119:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945947.206138:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945947.206165:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616508160 00000100:00100000:3.0:1790945947.206193:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616508160 00000100:00100000:3.0:1790945947.206245:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616508288 00000100:00100000:3.0:1790945947.206249:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616508288 00000100:00100000:3.0:1790945947.206270:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 108 00000100:00100000:3.0:1790945947.206279:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2404:x1877942616508160:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790945947.206341:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2404:x1877942616508160:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 63us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945947.206358:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 108 00000100:00100000:3.0:1790945947.206375:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 109 00000100:00100000:3.0:1790945947.206382:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83eb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:2404:x1877942616508288:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790945947.206423:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83eb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:2404:x1877942616508288:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 42us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945947.206429:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 109 00000100:00100000:3.0:1790945947.206448:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616507776 00000100:00100000:3.0:1790945947.206452:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616507776 00000100:00100000:3.0:1790945947.206476:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 379 00000100:00100000:3.0:1790945947.206482:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a72fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:2404:x1877942616507776:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945947.206664:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616507904 00000100:00100000:1.0:1790945947.206669:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616507904 00000100:00100000:1.0:1790945947.206698:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616508416 00000100:00100000:1.0:1790945947.206701:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616508416 00000100:00100000:1.0:1790945947.206716:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616508032 00000100:00100000:1.0:1790945947.206718:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616508032 00000100:00100000:1.0:1790945947.206731:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616508544 00000100:00100000:1.0:1790945947.206733:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616508544 00000100:00100000:1.0:1790945947.206747:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 273 00000100:00100000:1.0:1790945947.206754:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+18:2404:x1877942616507904:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945947.206792:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+18:2404:x1877942616507904:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 39us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945947.206797:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 273 00000100:00100000:1.0:1790945947.206819:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 274 00000100:00100000:1.0:1790945947.206825:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2404:x1877942616508416:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945947.206851:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2404:x1877942616508416:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 26us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945947.206857:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 274 00000100:00100000:1.0:1790945947.206868:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 275 00000100:00100000:1.0:1790945947.206874:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83eb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2404:x1877942616508032:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945947.206897:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83eb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2404:x1877942616508032:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 24us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945947.206916:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 275 00000100:00100000:1.0:1790945947.206927:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 276 00000100:00100000:1.0:1790945947.206934:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2404:x1877942616508544:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945947.206957:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2404:x1877942616508544:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 25us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945947.206963:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 276 00000100:00100000:3.0:1790945947.207081:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a72fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:2404:x1877942616507776:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 597us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945947.207087:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 379 00000100:00080000:3.0:1790945947.207297:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790945947.207301:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790945947.207304:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790945947.207307:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790945947.489906:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4087238000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638608000:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790945947.489982:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945947.490032:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638608000 00000100:00100000:2.0:1790945947.490041:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638608000 00000100:00100000:2.0:1790945947.490096:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1790945947.490106:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638608000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790945947.490140:0:6526:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790945947.490227:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638608000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945947.490235:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1790945947.490285:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4087238000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638608000:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1790945947.902038:0:14263:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790945947.902049:0:14263:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790945947.902074:0:14263:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1790945947.902081:0:14263:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1790945948.130299:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945948.231905:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945948.231952:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616508800 00000100:00100000:2.0:1790945948.231962:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616508800 00000100:00100000:2.0:1790945948.232036:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 94 00000100:00100000:2.0:1790945948.232046:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+18:11290:x1877942616508800:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1790945948.232066:0:13005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945948.232086:0:13005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d7b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330be5 expref: -99 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945948.232231:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363cc00/0xd9f4181e0d27d7c0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945948.232248:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363cc00/0xd9f4181e0d27d7c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945948.232275:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363cc00/0xd9f4181e0d27d7c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945948.232290:0:13005:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1790945948.233275:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27d7b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330be5 expref: 21 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945948.233294:0:13005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363cc00/0xd9f4181e0d27d7c0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330be5 expref: 20 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945948.233303:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d40bc9ad200) 00010000:00010000:2.0:1790945948.233832:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790945948.233837:0:13005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f8363cc00, rc 0) 00000100:00100000:2.0:1790945948.233939:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+20:11290:x1877942616508800:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 1892us (2040us total) trans 4294967365 rc 0/0 00000100:00080000:3.0:1790945948.234770:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790945948.234928:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 94 00000100:00100000:0.0:1790945948.242560:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945948.242611:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616508928 00000100:00100000:0.0:1790945948.242620:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616508928 00000100:00100000:0.0:1790945948.242673:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 95 00000100:00100000:0.0:1790945948.242683:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4081325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+20:11290:x1877942616508928:12345-192.168.204.20@tcp:34:lfs.0 00010000:00010000:0.0:1790945948.242755:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d7ce lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.242774:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d7ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.242786:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d7ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.242801:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d7d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.242809:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d7d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.242831:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d7d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.242924:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27d7dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.242933:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27d7dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.242940:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27d7dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790945948.242988:0:6522:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27d7dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.243001:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d7ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.243009:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d7ce lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.243015:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d7ce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.243022:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0c00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945948.243027:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d7ce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.243035:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d7ce lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.243046:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d40bc9ad200) 00010000:00010000:0.0:1790945948.243055:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945948.243062:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d7ce lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.243068:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d7ce lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.243082:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d7d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.243089:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d7d5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.243095:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d7d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.243099:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0200 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945948.243102:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d7d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.243108:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d7d5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.243116:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d40bc937e00) 00010000:00010000:0.0:1790945948.243118:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945948.243121:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d7d5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.243127:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d7d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.243141:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27d7dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.243153:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27d7dc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.243158:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27d7dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.243163:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe1c00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945948.243188:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27d7dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.243196:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27d7dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.243205:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d40bc937a00) 00010000:00010000:0.0:1790945948.243207:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945948.243210:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27d7dc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.243216:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27d7dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945948.243300:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4081325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+20:11290:x1877942616508928:12345-192.168.204.20@tcp:34:lfs.0 Request processed in 617us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945948.243309:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 95 00000100:00100000:3.0:1790945948.308260:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945948.308362:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616509184 00000100:00100000:0.0:1790945948.308372:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616509184 00000100:00100000:0.0:1790945948.308434:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 96 00000100:00100000:0.0:1790945948.308444:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83eb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+20:11293:x1877942616509184:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1790945948.308466:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945948.308499:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27d7e3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330bec expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.308584:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d7ea lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.308599:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d7ea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.308610:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d7ea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.308625:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d7f1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.308633:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d7f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.308639:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d7f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.308759:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d7f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.308768:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d7f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.308776:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d7f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945948.308785:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1790945948.308872:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d7ea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.308899:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d7ea lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.308907:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d7ea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.308913:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0200 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945948.308918:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d7ea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.308926:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d7ea lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.308939:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d40bc9ad200) 00010000:00010000:0.0:1790945948.308942:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945948.308947:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d7ea lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.308954:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d7ea lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.308969:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d7f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.308976:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d7f1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.308982:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d7f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.308987:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0c00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945948.309000:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d7f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.309006:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d7f1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.309015:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d40bc937a00) 00010000:00010000:0.0:1790945948.309018:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945948.309022:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d7f1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.309028:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d7f1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.309071:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27d7e3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bec expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.309085:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d7f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bec expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.309093:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d40bc937e00) 00010000:00010000:0.0:1790945948.309096:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790945948.309098:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe0000, rc 0) 00000100:00100000:0.0:1790945948.309226:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83eb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+22:11293:x1877942616509184:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 726us (918us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1790945948.309235:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 96 00000100:00100000:2.0:1790945948.314324:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945948.314436:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616509312 00000100:00100000:1.0:1790945948.314446:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616509312 00000100:00100000:1.0:1790945948.314564:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 97 00000100:00100000:1.0:1790945948.314576:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+22:11293:x1877942616509312:12345-192.168.204.20@tcp:54:lfs.0 00010000:00010000:1.0:1790945948.314647:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afda00/0xd9f4181e0d27d806 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.314677:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afda00/0xd9f4181e0d27d806 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.314689:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afda00/0xd9f4181e0d27d806 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.314723:0:8457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afda00/0xd9f4181e0d27d806 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.314731:0:8457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afda00/0xd9f4181e0d27d806 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.314739:0:8457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afda00/0xd9f4181e0d27d806 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.314745:0:8457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afda00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:1.0:1790945948.314749:0:8457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afda00/0xd9f4181e0d27d806 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.314756:0:8457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afda00/0xd9f4181e0d27d806 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.314767:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d40bc937e00) 00010000:00010000:1.0:1790945948.314770:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790945948.314775:0:8457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afda00/0xd9f4181e0d27d806 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.314932:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afda00/0xd9f4181e0d27d806 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945948.315012:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+22:11293:x1877942616509312:12345-192.168.204.20@tcp:54:lfs.0 Request processed in 437us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945948.315026:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 97 00000100:00100000:3.0:1790945948.317382:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945948.317696:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616509568 00000100:00100000:0.0:1790945948.317707:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616509568 00000100:00100000:0.0:1790945948.317772:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 21 00000100:00100000:0.0:1790945948.317781:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4096ddb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+22:11293:x1877942616509568:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:0.0:1790945948.318053:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4096ddb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+23:11293:x1877942616509568:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 272us (680us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1790945948.318061:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 21 00000100:00100000:3.0:1790945948.354282:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945948.354708:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616509824 00000100:00100000:0.0:1790945948.354720:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616509824 00000100:00100000:0.0:1790945948.354800:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 98 00000100:00100000:0.0:1790945948.354811:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83eb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+23:10812:x1877942616509824:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:0.0:1790945948.354839:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945948.354863:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27d80d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330bf3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.355003:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d814 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.355018:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d7f8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bec expref: 24 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.355027:0:6521:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d814 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.355060:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d7f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bec expref: 24 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.355074:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d7f8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bec expref: 24 pid: 6523 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945948.355087:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4083517100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1877942638608128:192.168.204.20@tcp:104: 00000100:00100000:0.0:1790945948.356188:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4d05780 going to sleep for 11 seconds 00000100:00100000:3.0:1790945948.361334:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945948.361498:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616509952 00000100:00100000:2.0:1790945948.361509:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616509952 00010000:00010000:2.0:1790945948.361562:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d7f8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bec expref: 25 pid: 6523 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945948.361600:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 65 00000100:00100000:2.0:1790945948.361609:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+25:2403:x1877942616509952:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790945948.361626:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945948.361633:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d7f8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bec expref: 25 pid: 6523 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945948.361666:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d7f8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bec expref: 25 pid: 6523 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945948.361688:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d40bc937e00) 00010000:00010000:2.0:1790945948.361694:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d814 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945948.361704:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d814 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945948.361712:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d814 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945948.361732:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945948.361933:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+25:2403:x1877942616509952:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 324us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945948.361942:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 65 00010000:00010000:0.0:1790945948.362936:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d7f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bec expref: 24 pid: 6523 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945948.362958:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4083517100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1877942638608128:192.168.204.20@tcp:104: 00010000:00010000:0.0:1790945948.362979:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d814 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.362988:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d814 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.363006:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d814 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945948.363025:0:6521:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1790945948.363225:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27d80d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bf3 expref: 25 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.363244:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d814 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bf3 expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.363253:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d40bc937e00) 00010000:00010000:0.0:1790945948.363256:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790945948.363259:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe0c00, rc 0) 00000100:00100000:0.0:1790945948.363318:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83eb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+24:10812:x1877942616509824:12345-192.168.204.20@tcp:101:bash.0 Request processed in 8510us (9167us total) trans 4294967368 rc 0/0 00000100:00100000:0.0:1790945948.363326:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 98 00000100:00100000:3.0:1790945948.375597:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945948.375708:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616510080 00000100:00100000:1.0:1790945948.375718:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616510080 00000100:00100000:1.0:1790945948.375778:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 99 00000100:00100000:1.0:1790945948.375788:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83eb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+24:10812:x1877942616510080:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:1.0:1790945948.375813:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945948.375835:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afda00/0xd9f4181e0d27d822 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330bfa expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.375892:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc600/0xd9f4181e0d27d829 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.375906:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc600/0xd9f4181e0d27d829 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.375918:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc600/0xd9f4181e0d27d829 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.376035:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afda00/0xd9f4181e0d27d822 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bfa expref: 26 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.376054:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc600/0xd9f4181e0d27d829 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bfa expref: 25 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.376063:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d40bc937e00) 00010000:00010000:1.0:1790945948.376067:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790945948.376071:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4092afc600, rc 0) 00000100:00100000:1.0:1790945948.376140:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83eb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+25:10812:x1877942616510080:12345-192.168.204.20@tcp:101:bash.0 Request processed in 353us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945948.376155:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 99 00000100:00100000:3.0:1790945948.379663:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945948.379756:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616510336 00000100:00100000:1.0:1790945948.379766:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616510336 00000100:00100000:1.0:1790945948.379829:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 100 00000100:00100000:1.0:1790945948.379839:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+25:10812:x1877942616510336:12345-192.168.204.20@tcp:36:bash.0 00010000:00010000:1.0:1790945948.380097:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afce00/0xd9f4181e0d27d830 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.380129:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afce00/0xd9f4181e0d27d830 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.380143:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afce00/0xd9f4181e0d27d830 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790945948.380223:0:8457:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:1.0:1790945948.380247:0:8457:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000042c2e887 reply state 0000000093947165 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afce00/0xd9f4181e0d27d830 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.380261:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afce00/0xd9f4181e0d27d830 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.380269:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d40bc937e00) 00010000:00010000:1.0:1790945948.380272:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790945948.380276:0:8457:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1790945948.380315:0:8457:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:1.0:1790945948.380421:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+29:10812:x1877942616510336:12345-192.168.204.20@tcp:36:bash.0 Request processed in 583us (767us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1790945948.380429:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 100 00000020:00080000:1.0:1790945948.380435:0:8457:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1790945948.383511:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945948.383629:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616510464 00000100:00100000:0.0:1790945948.383644:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616510464 00000100:00100000:0.0:1790945948.383719:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 101 00000100:00100000:0.0:1790945948.383730:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+29:10812:x1877942616510464:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:0.0:1790945948.383757:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945948.383777:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27d837 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330c01 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.383836:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27d837 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c01 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.383861:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27d837 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c01 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.383890:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d40bc937e00) 00010000:00010000:0.0:1790945948.383894:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790945948.383898:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe1c00, rc 0) 00000100:00100000:0.0:1790945948.383962:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+30:10812:x1877942616510464:12345-192.168.204.20@tcp:101:bash.0 Request processed in 233us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945948.383969:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 101 00000100:00100000:3.0:1790945948.387235:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945948.387336:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616510592 00000100:00100000:1.0:1790945948.387346:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616510592 00000100:00100000:1.0:1790945948.387402:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 41 00000100:00100000:1.0:1790945948.387412:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83eb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:10812:x1877942616510592:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:1.0:1790945948.387432:0:8916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945948.387455:0:8916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e978c91/0xd9f4181e0d27d83e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330c08 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790945948.387486:0:8916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6abfaa98, atime: 0x6abfaa97, ctime: 0x6abfaa98, blocks: 0x8 00010000:00010000:1.0:1790945948.387511:0:8916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=399s v=(0 0) 00010000:00010000:1.0:1790945948.387517:0:8916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945948.387536:0:8916:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e978c91/0xd9f4181e0d27d83e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c08 expref: 7 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.387556:0:8916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009e978c91/0xd9f4181e0d27d83e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c08 expref: 7 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.387571:0:8916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4092afda00, rc 0) 00000100:00100000:1.0:1790945948.387644:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83eb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:10812:x1877942616510592:12345-192.168.204.20@tcp:101:bash.0 Request processed in 233us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945948.387652:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 41 00000100:00100000:3.0:1790945948.390137:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945948.390319:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616510720 00000100:00100000:1.0:1790945948.390330:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616510720 00002000:00010000:1.0:1790945948.390372:0:8440:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:1.0:1790945948.390377:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3f83eb2a00 with x1877942616510720 ext(0->18446744073709551615) 00002000:00010000:1.0:1790945948.390388:0:8440:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d3f83eb2a00. 00000100:00100000:1.0:1790945948.390422:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1 00000100:00100000:1.0:1790945948.390446:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:2403:x1877942616510720:12345-192.168.204.20@tcp:10:bash.0 00002000:00010000:1.0:1790945948.390777:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1790945948.390781:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1790945944 -> 1790945948 00002000:00010000:1.0:1790945948.390784:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1790945943 -> 1790945943 00002000:00010000:1.0:1790945948.390786:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1790945944 -> 1790945948 00002000:00010000:1.0:1790945948.390788:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1790945948.390868:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+8:2403:x1877942616510720:12345-192.168.204.20@tcp:10:bash.0 Request processed in 424us (754us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1790945948.390876:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1 00002000:00010000:1.0:1790945948.390890:0:8440:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:1.0:1790945948.390892:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3f83eb2a00 with x1877942616510720 ext(0->18446744073709551615) 00002000:00010000:1.0:1790945948.390897:0:8440:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d3f83eb2a00. 00000100:00100000:2.0:1790945948.487520:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945948.487635:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616510848 00000100:00100000:0.0:1790945948.487647:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616510848 00000100:00100000:0.0:1790945948.487711:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 102 00000100:00100000:0.0:1790945948.487721:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408723b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+30:11307:x1877942616510848:12345-192.168.204.20@tcp:34:lfs.0 00010000:00010000:0.0:1790945948.487797:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d845 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.487815:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d845 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.487846:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d845 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.487863:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d84c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.487871:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d84c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.487892:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d84c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.487970:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d853 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.487980:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d853 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.487987:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d853 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790945948.488032:0:6522:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d853 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.488043:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d845 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.488050:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d845 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.488057:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d845 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.488073:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0000 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945948.488080:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d845 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.488088:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d845 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.488099:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d40bc9ad200) 00010000:00010000:0.0:1790945948.488101:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945948.488106:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d845 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.488111:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d845 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.488138:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d84c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.488143:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d84c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.488149:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d84c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.488153:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0200 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945948.488156:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d84c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.488162:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d84c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.488241:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d40bc937a00) 00010000:00010000:0.0:1790945948.488244:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945948.488247:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d84c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.488254:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d84c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.488269:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d853 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.488274:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d853 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.488279:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d853 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.488283:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe1600 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945948.488286:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d853 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.488291:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d853 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.488298:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d40bc937e00) 00010000:00010000:0.0:1790945948.488300:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945948.488303:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d853 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.488308:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d853 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945948.488402:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408723b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+30:11307:x1877942616510848:12345-192.168.204.20@tcp:34:lfs.0 Request processed in 682us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945948.488411:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 102 00000100:00100000:1.0:1790945948.511467:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790945948.511493:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83eb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638608256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790945948.511578:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945948.511953:0:11925:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638608256 00000100:00100000:3.0:1790945948.511962:0:11925:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638608256 00000100:00100000:3.0:1790945948.512049:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1790945948.512061:0:11925:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1877942638608256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790945948.512092:0:11925:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790945948.512157:0:11925:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1877942638608256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945948.512191:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1790945948.512254:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83eb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638608256:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1790945948.512313:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790945948.512928:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790945948.512942:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bfef1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638608384:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790945948.512989:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945948.514101:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638608384 00000100:00100000:3.0:1790945948.514110:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638608384 00000100:00100000:0.0:1790945948.515553:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1790945948.515576:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638608384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790945948.515604:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790945948.515690:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638608384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 124us (2700us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945948.515698:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1790945948.515736:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83eb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638608896:0@lo:400:kworker.0 00000100:00100000:0.0:1790945948.515777:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945948.515820:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638609408:0@lo:400:kworker.0 00000100:00100000:0.0:1790945948.515848:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945948.515871:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1790945948.515894:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83eb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638608512:0@lo:400:kworker.0 00000100:00100000:0.0:1790945948.515921:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945948.515943:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83eb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638609024:0@lo:400:kworker.0 00000100:00100000:0.0:1790945948.515966:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945948.515984:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83f6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638609536:0@lo:400:kworker.0 00000100:00100000:0.0:1790945948.516025:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945948.516059:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638608512 00000100:00100000:0.0:1790945948.516065:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638608512 00000100:00100000:0.0:1790945948.516099:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1790945948.516754:0:8436:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638609408 00000100:00100000:1.0:1790945948.516761:0:8436:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638609408 00000100:00100000:1.0:1790945948.516795:0:8436:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638609536 00000100:00100000:1.0:1790945948.516798:0:8436:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638609536 00000100:00100000:1.0:1790945948.516822:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1790945948.516828:0:8436:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4083515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638609408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945948.516893:0:8436:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4083515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638609408:12345-0@lo:400:kworker.0 Request processed in 64us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945948.516907:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1790945948.516923:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1790945948.516928:0:8436:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1877942638609536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945948.516954:0:8436:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1877942638609536:12345-0@lo:400:kworker.0 Request processed in 26us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945948.516959:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:1.0:1790945948.516976:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790945948.516979:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790945948.517010:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83f6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638609536:0@lo:400:kworker.0 00000100:00100000:1.0:1790945948.517021:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638609408:0@lo:400:kworker.0 00000100:00100000:2.0:1790945948.517625:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638608896 00000100:00100000:2.0:1790945948.517632:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638608896 00000100:00100000:2.0:1790945948.517679:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1790945948.517687:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4083517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638608896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945948.517731:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4083517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638608896:12345-0@lo:400:kworker.0 Request processed in 45us (1954us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945948.517737:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1790945948.517777:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bfef1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638608384:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790945948.517825:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83eb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638608640:0@lo:400:kworker.0 00000100:00100000:2.0:1790945948.517866:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945948.517899:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83eb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1877942638609152:0@lo:400:kworker.0 00000100:00100000:2.0:1790945948.517936:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945948.517962:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83f68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1877942638609664:0@lo:400:kworker.0 00000100:00100000:2.0:1790945948.517984:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945948.518002:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1790945948.518009:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83eb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638608768:0@lo:400:kworker.0 00000100:00100000:2.0:1790945948.518031:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945948.518047:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83eb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1877942638609280:0@lo:400:kworker.0 00000100:00100000:2.0:1790945948.518066:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945948.518082:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1877942638609792:0@lo:400:kworker.0 00000100:00100000:2.0:1790945948.518102:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945948.518120:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638608640 00000100:00100000:2.0:1790945948.518125:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638608640 00000100:00100000:2.0:1790945948.518143:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638609152 00000100:00100000:2.0:1790945948.518145:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638609152 00000100:00100000:2.0:1790945948.518162:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638609664 00000100:00100000:2.0:1790945948.518194:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638609664 00000100:00100000:2.0:1790945948.518210:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638609280 00000100:00100000:2.0:1790945948.518213:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638609280 00000100:00100000:2.0:1790945948.518225:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638609792 00000100:00100000:2.0:1790945948.518227:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638609792 00000100:00100000:2.0:1790945948.518238:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1790945948.518244:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bfef1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638608640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945948.518278:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bfef1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638608640:12345-0@lo:400:kworker.0 Request processed in 34us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945948.518283:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1790945948.518303:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1790945948.518309:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1877942638609152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945948.518337:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1877942638609152:12345-0@lo:400:kworker.0 Request processed in 29us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945948.518343:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1790945948.518354:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1790945948.518360:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1877942638609664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945948.518400:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1877942638609664:12345-0@lo:400:kworker.0 Request processed in 40us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945948.518406:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1790945948.519619:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a72fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3649:x1877942638608512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945948.519705:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a72fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3649:x1877942638608512:12345-0@lo:400:kworker.0 Request processed in 3597us (3780us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945948.519716:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1790945948.519765:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638609024 00000100:00100000:0.0:1790945948.519771:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638609024 00000100:00100000:0.0:1790945948.519811:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638608768 00000100:00100000:0.0:1790945948.519813:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638608768 00000100:00100000:0.0:1790945948.519827:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1790945948.519832:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638609024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945948.519864:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638609024:12345-0@lo:400:kworker.0 Request processed in 32us (3897us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945948.519870:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1790945948.519894:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1790945948.519900:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638608768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945948.519928:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638608768:12345-0@lo:400:kworker.0 Request processed in 28us (1895us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945948.519933:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1790945948.519962:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1790945948.519969:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1877942638609280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945948.519997:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1877942638609280:12345-0@lo:400:kworker.0 Request processed in 29us (1930us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945948.520002:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1790945948.520015:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1790945948.520020:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1877942638609792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945948.520046:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1877942638609792:12345-0@lo:400:kworker.0 Request processed in 26us (1943us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945948.520058:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1790945948.520121:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83eb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638608768:0@lo:400:kworker.0 00010000:00080000:0.0:1790945948.520135:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f83eb2680 x1877942638609280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945948.520146:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83eb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1877942638609280:0@lo:400:kworker.0 00010000:00080000:0.0:1790945948.520156:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f83f69180 x1877942638609792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945948.520164:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1877942638609792:0@lo:400:kworker.0 00000100:00100000:0.0:1790945948.520196:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83eb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638608640:0@lo:400:kworker.0 00000100:00100000:0.0:1790945948.520207:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83eb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1877942638609152:0@lo:400:kworker.0 00000100:00100000:0.0:1790945948.520218:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83f68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1877942638609664:0@lo:400:kworker.0 00000100:00080000:1.0:1790945948.520735:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790945948.520741:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790945948.520764:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83eb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638608512:0@lo:400:kworker.0 00000100:00100000:1.0:1790945948.520777:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83eb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638609024:0@lo:400:kworker.0 00000100:00100000:1.0:1790945948.520787:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83eb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638608896:0@lo:400:kworker.0 00000100:00100000:2.0:1790945948.544401:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945948.544928:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616511104 00000100:00100000:0.0:1790945948.544941:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616511104 00000100:00100000:0.0:1790945948.545076:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 103 00000100:00100000:0.0:1790945948.545086:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+30:11310:x1877942616511104:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1790945948.545107:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945948.545138:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d85a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330c0f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.545385:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d861 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.545403:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d861 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.545429:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d861 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.545446:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d868 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.545454:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d868 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.545461:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d868 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.545935:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27d86f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.545947:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27d86f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.545955:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27d86f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945948.545964:0:6522:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1790945948.546298:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d861 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.546307:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d861 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.546314:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d861 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.546320:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0200 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945948.546345:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d861 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.546354:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d861 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.546378:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d40bc9ad200) 00010000:00010000:0.0:1790945948.546382:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945948.546387:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d861 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.546394:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d861 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.546410:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d868 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.546416:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d868 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.546421:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d868 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.546427:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0000 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945948.546430:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d868 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.546436:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d868 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.546443:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d40bc937a00) 00010000:00010000:0.0:1790945948.546446:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945948.546455:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d868 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.546462:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d868 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.546507:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d85a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c0f expref: 33 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.547133:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27d86f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c0f expref: 32 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.547142:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d40bc937e00) 00010000:00010000:0.0:1790945948.547144:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790945948.547147:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe0e00, rc 0) 00000100:00100000:0.0:1790945948.547415:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+32:11310:x1877942616511104:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 2329us (3023us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1790945948.547425:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 103 00000100:00100000:3.0:1790945948.553803:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945948.553945:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616511232 00000100:00100000:1.0:1790945948.553956:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616511232 00000100:00100000:1.0:1790945948.554066:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 104 00000100:00100000:1.0:1790945948.554078:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+32:11310:x1877942616511232:12345-192.168.204.20@tcp:54:lfs.0 00010000:00010000:1.0:1790945948.554339:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d87d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.554360:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d814 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bf3 expref: 32 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.554426:0:6521:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d87d lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.554461:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d814 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bf3 expref: 32 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.554471:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d814 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bf3 expref: 32 pid: 6521 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945948.554482:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff80000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1877942638609920:192.168.204.20@tcp:104: 00000100:00100000:1.0:1790945948.554625:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4083509e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790945948.557599:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff80000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1877942638609920:192.168.204.20@tcp:104: 00010000:00010000:1.0:1790945948.557628:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d87d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945948.558091:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945948.558350:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616511488 00000100:00100000:0.0:1790945948.558360:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616511488 00000100:00100000:0.0:1790945948.558417:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 22 00000100:00100000:0.0:1790945948.558427:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+33:6170:x1877942616511488:12345-192.168.204.20@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1790945948.558788:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+34:6170:x1877942616511488:12345-192.168.204.20@tcp:35:ldlm_bl.0 Request processed in 362us (697us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1790945948.558797:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 22 00000100:00100000:2.0:1790945948.570655:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945948.570793:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616511616 00000100:00100000:0.0:1790945948.570803:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616511616 00010000:00010000:0.0:1790945948.570858:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d814 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bf3 expref: 34 pid: 6521 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945948.570975:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 66 00000100:00100000:0.0:1790945948.570985:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+34:2404:x1877942616511616:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790945948.571010:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945948.571017:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d814 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bf3 expref: 34 pid: 6521 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.571031:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d814 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bf3 expref: 34 pid: 6521 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.571055:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d814 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bf3 expref: 34 pid: 6521 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.571071:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d40bc937e00) 00010000:00010000:0.0:1790945948.571076:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d87d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.571085:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d87d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.571092:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d87d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.571126:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945948.572563:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+33:2404:x1877942616511616:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 1567us (1908us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945948.572578:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 66 00010000:00010000:3.0:1790945948.572801:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d87d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945948.572813:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d87d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945948.572872:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d87d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945948.572894:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d87d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945948.572902:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d87d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945948.572924:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afc000 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945948.572929:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d87d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945948.572936:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d87d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945948.572951:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d40bc937e00) 00010000:00010000:3.0:1790945948.572955:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790945948.572960:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d87d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945948.572967:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d87d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945948.573097:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+32:11310:x1877942616511232:12345-192.168.204.20@tcp:54:lfs.0 Request processed in 19021us (19305us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945948.573106:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 104 00000100:00100000:2.0:1790945948.577816:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945948.577904:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616511872 00000100:00100000:3.0:1790945948.577914:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616511872 00000100:00100000:3.0:1790945948.577972:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 23 00000100:00100000:3.0:1790945948.577983:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+32:11310:x1877942616511872:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:3.0:1790945948.578255:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+33:11310:x1877942616511872:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 273us (450us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1790945948.578264:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 23 00000100:00100000:2.0:1790945948.696200:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945948.696288:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616512128 00000100:00100000:0.0:1790945948.696325:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616512128 00000100:00100000:0.0:1790945948.696414:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 105 00000100:00100000:0.0:1790945948.696425:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+33:11321:x1877942616512128:12345-192.168.204.20@tcp:101:cat.0 00010000:00010000:0.0:1790945948.696454:0:13005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945948.696476:0:13005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d884 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330c16 expref: -99 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.696573:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d88b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.696599:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d88b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.696612:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d88b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.696628:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d892 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.696637:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d892 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.696643:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d892 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.696781:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d899 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.696792:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d899 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.696799:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d899 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945948.696818:0:13005:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:0.0:1790945948.696915:0:13005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d88b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.696923:0:13005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d88b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.696929:0:13005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d88b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.696935:0:13005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe1600 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945948.696939:0:13005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d88b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.696946:0:13005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d88b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.696960:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d40bc9ad200) 00010000:00010000:0.0:1790945948.696963:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945948.696968:0:13005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d88b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.696974:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d88b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.696986:0:13005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d892 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.696991:0:13005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d892 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.697009:0:13005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d892 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.697014:0:13005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0000 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945948.697017:0:13005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d892 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.697023:0:13005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d892 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.697030:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d40bc937a00) 00010000:00010000:0.0:1790945948.697032:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945948.697035:0:13005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d892 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.697040:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d892 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.697099:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d884 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c16 expref: 36 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.697114:0:13005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d899 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c16 expref: 35 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.697121:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d40bc937e00) 00010000:00010000:0.0:1790945948.697123:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790945948.697126:0:13005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe0200, rc 0) 00000100:00100000:0.0:1790945948.697503:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+35:11321:x1877942616512128:12345-192.168.204.20@tcp:101:cat.0 Request processed in 1078us (1312us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1790945948.697521:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 105 00000100:00100000:3.0:1790945948.701988:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945948.702081:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616512384 00000100:00100000:0.0:1790945948.702091:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616512384 00000100:00100000:0.0:1790945948.702155:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 24 00000100:00100000:0.0:1790945948.702199:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+35:11321:x1877942616512384:12345-192.168.204.20@tcp:35:cat.0 00000100:00100000:0.0:1790945948.702494:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+36:11321:x1877942616512384:12345-192.168.204.20@tcp:35:cat.0 Request processed in 329us (515us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1790945948.702503:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 24 00000100:00100000:3.0:1790945948.719967:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945948.720137:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616512640 00000100:00100000:0.0:1790945948.720150:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616512640 00000100:00100000:0.0:1790945948.720240:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 106 00000100:00100000:0.0:1790945948.720252:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+36:11322:x1877942616512640:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:0.0:1790945948.720317:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1790945948.720350:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27d837 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c01 expref: 36 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.720374:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d899 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c16 expref: 35 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.720385:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27d86f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c0f expref: 34 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.720398:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc600/0xd9f4181e0d27d829 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330bfa expref: 33 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.720408:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d40bc937e00) 00010000:00010000:0.0:1790945948.720428:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790945948.720450:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d8a7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.720465:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d8a7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.720475:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d8a7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.720490:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d8ae lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.720499:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d8ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.720505:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d8ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.720753:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d8b5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.720761:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d8b5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.720769:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d8b5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790945948.721004:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:0.0:1790945948.721014:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 399536845943ns, next at 400536843263ns, rc = 0 00010000:00010000:0.0:1790945948.721064:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27d8bc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.721083:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27d8bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.721091:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27d8bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.721099:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27d8bc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.721105:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27d8bc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.721111:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27d8bc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.721136:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790945948.721156:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d8b5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.721161:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d8b5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.721212:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d8b5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.721219:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe1600 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945948.721449:0:10339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790945948.721461:0:10339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27d8bc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945948.721466:0:10339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe1800 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:3.0:1790945948.721470:0:10339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27d8bc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945948.721478:0:10339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27d8bc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945948.721489:0:10339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d40bc937e00) 00010000:00010000:3.0:1790945948.721492:0:10339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790945948.721496:0:10339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27d8bc lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945948.721502:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27d8bc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945948.721638:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945948.721640:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945948.721642:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945948.721863:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d8b5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.721886:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d8b5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.721907:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d40bc937e00) 00010000:00010000:0.0:1790945948.721909:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1790945948.721913:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d8b5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.721918:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d8b5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.721934:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d8a7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.721941:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d8a7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.721947:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d8a7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.721957:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0c00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945948.721960:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d8a7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.721967:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d8a7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.721975:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d40bc9ad200) 00010000:00010000:0.0:1790945948.721977:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945948.721980:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d8a7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.721985:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27d8a7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790945948.722006:0:6522:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000741a9a2b reply state 000000003720dfe9 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d8ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.722017:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d8ae lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.722023:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d40bc937a00) 00010000:00010000:0.0:1790945948.722025:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790945948.722028:0:6522:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790945948.722129:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+34:11322:x1877942616512640:12345-192.168.204.20@tcp:36:rm.0 Request processed in 1868us (2161us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1790945948.722138:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 106 00000100:00100000:3.0:1790945948.791007:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945948.791375:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616512896 00000100:00100000:1.0:1790945948.791386:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616512896 00000100:00100000:1.0:1790945948.791459:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 107 00000100:00100000:1.0:1790945948.791471:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+34:11329:x1877942616512896:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:1.0:1790945948.791496:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945948.791529:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afdc00/0xd9f4181e0d27d8c3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330c1d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.791632:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc200/0xd9f4181e0d27d8ca lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.791648:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc200/0xd9f4181e0d27d8ca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.791674:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc200/0xd9f4181e0d27d8ca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.791687:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afcc00/0xd9f4181e0d27d8d1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.791696:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afcc00/0xd9f4181e0d27d8d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.791704:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afcc00/0xd9f4181e0d27d8d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790945948.792067:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:1.0:1790945948.792464:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27d8d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.792474:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27d8d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.792483:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27d8d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.792580:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc200/0xd9f4181e0d27d8ca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.792589:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc200/0xd9f4181e0d27d8ca lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.792596:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc200/0xd9f4181e0d27d8ca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.792602:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afc200 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:1.0:1790945948.792617:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc200/0xd9f4181e0d27d8ca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.792627:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc200/0xd9f4181e0d27d8ca lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.792639:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d40bc9ad200) 00010000:00010000:1.0:1790945948.792642:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945948.792647:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc200/0xd9f4181e0d27d8ca lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.792654:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc200/0xd9f4181e0d27d8ca lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790945948.792669:0:6521:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009ac96359 reply state 0000000096eca7d7 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afcc00/0xd9f4181e0d27d8d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.792679:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afcc00/0xd9f4181e0d27d8d1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.792685:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d40bc937a00) 00010000:00010000:1.0:1790945948.792687:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790945948.792689:0:6521:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790945948.792718:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afdc00/0xd9f4181e0d27d8c3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c1d expref: 37 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.792733:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27d8d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c1d expref: 36 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.792740:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d40928bde00) 00010000:00010000:1.0:1790945948.792742:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790945948.792751:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4092afd600, rc 0) 00000100:00100000:1.0:1790945948.793036:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+37:11329:x1877942616512896:12345-192.168.204.20@tcp:101:bash.0 Request processed in 1566us (2038us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1790945948.793045:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 107 00000100:00100000:3.0:1790945948.797898:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945948.798043:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616513024 00000100:00100000:0.0:1790945948.798054:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616513024 00000100:00100000:0.0:1790945948.798108:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 42 00000100:00100000:0.0:1790945948.798118:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:2403:x1877942616513024:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:0.0:1790945948.798135:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945948.798154:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db5c9e24/0xd9f4181e0d27d8e6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330c24 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790945948.798211:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790945948.798231:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=399s v=(0 0) 00010000:00010000:0.0:1790945948.798236:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790945948.798245:0:8437:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db5c9e24/0xd9f4181e0d27d8e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c24 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.798264:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000db5c9e24/0xd9f4181e0d27d8e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c24 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.798296:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe0c00, rc 0) 00000100:00100000:0.0:1790945948.798366:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+8:2403:x1877942616513024:12345-192.168.204.20@tcp:101:bash.0 Request processed in 249us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945948.798374:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 42 00000100:00100000:3.0:1790945948.803732:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945948.803901:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616513152 00000100:00100000:1.0:1790945948.803914:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616513152 00000100:00100000:1.0:1790945948.803983:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 43 00000100:00100000:1.0:1790945948.803994:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+8:11329:x1877942616513152:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:1.0:1790945948.804014:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945948.804033:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087408219/0xd9f4181e0d27d8ed lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330c2b expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.804067:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000db5c9e24/0xd9f4181e0d27d8e6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c24 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.804076:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945948.804081:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945948.804087:0:8435:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087408219/0xd9f4181e0d27d8ed lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c2b expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.804129:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000db5c9e24/0xd9f4181e0d27d8e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c24 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.804144:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000db5c9e24/0xd9f4181e0d27d8e6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c24 expref: 9 pid: 8437 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945948.804158:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff80000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1877942638610048:192.168.204.20@tcp:104: 00000100:00100000:1.0:1790945948.804321:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f83588000 going to sleep for 11 seconds 00000100:00100000:3.0:1790945948.807433:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945948.807650:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616513280 00000100:00100000:0.0:1790945948.807661:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616513280 00010000:00010000:0.0:1790945948.807705:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000db5c9e24/0xd9f4181e0d27d8e6 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c24 expref: 10 pid: 8437 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945948.807750:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 67 00000100:00100000:0.0:1790945948.807759:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+10:2404:x1877942616513280:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790945948.807775:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945948.807795:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000db5c9e24/0xd9f4181e0d27d8e6 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c24 expref: 10 pid: 8437 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.807810:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000db5c9e24/0xd9f4181e0d27d8e6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c24 expref: 10 pid: 8437 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.807834:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790945948.807851:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790945948.807860:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000087408219/0xd9f4181e0d27d8ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c2b expref: 10 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.807880:0:6506:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087408219/0xd9f4181e0d27d8ed lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c2b expref: 10 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945948.807932:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000087408219/0xd9f4181e0d27d8ed lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c2b expref: 10 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945948.807947:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83f3df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6506:1877942638610176:192.168.204.20@tcp:105: 00000100:00100000:0.0:1790945948.808023:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4d05900 going to sleep for 11 seconds 00010000:00010000:1.0:1790945948.808745:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db5c9e24/0xd9f4181e0d27d8e6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c24 expref: 10 pid: 8437 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945948.808762:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff80000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1877942638610048:192.168.204.20@tcp:104: 00010000:00010000:1.0:1790945948.808787:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000087408219/0xd9f4181e0d27d8ed lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c2b expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945948.808797:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4092afdc00, rc 0) 00000100:00100000:1.0:1790945948.808851:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+9:11329:x1877942616513152:12345-192.168.204.20@tcp:101:bash.0 Request processed in 4858us (5129us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945948.808859:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 43 00000100:00100000:0.0:1790945948.812768:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83f3df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6506:1877942638610176:192.168.204.20@tcp:105: 00010000:00010000:0.0:1790945948.812798:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945948.812864:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+8:2404:x1877942616513280:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 5105us (5441us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945948.812884:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 67 00000100:00100000:3.0:1790945948.816245:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945948.816393:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616513536 00000100:00100000:0.0:1790945948.816405:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616513536 00000100:00100000:0.0:1790945948.816467:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 25 00000100:00100000:0.0:1790945948.816477:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+37:11329:x1877942616513536:12345-192.168.204.20@tcp:35:bash.0 00000100:00100000:0.0:1790945948.816821:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+38:11329:x1877942616513536:12345-192.168.204.20@tcp:35:bash.0 Request processed in 344us (584us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1790945948.816828:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 25 00000100:00100000:3.0:1790945949.006842:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945949.007447:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616513664 00000100:00100000:0.0:1790945949.007458:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616513664 00000100:00100000:0.0:1790945949.007649:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 108 00000100:00100000:0.0:1790945949.007661:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+38:11345:x1877942616513664:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1790945949.007690:0:13005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945949.007712:0:13005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d8f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330c32 expref: -99 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.007805:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27d8fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.007820:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27d8fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.007831:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27d8fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945949.007887:0:13005:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1790945949.007899:0:13005:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790945949.007918:0:13005:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27d8fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.007941:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d8f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c32 expref: 40 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.007959:0:13005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27d8fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c32 expref: 39 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.009165:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d40bc9ad200) 00010000:00010000:0.0:1790945949.009192:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790945949.009197:0:13005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe0e00, rc 0) 00000100:00100000:0.0:1790945949.009294:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+39:11345:x1877942616513664:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 1632us (2461us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945949.009304:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 108 00000100:00100000:3.0:1790945949.017074:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945949.017359:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616513920 00000100:00100000:0.0:1790945949.017370:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616513920 00000100:00100000:0.0:1790945949.017451:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 109 00000100:00100000:0.0:1790945949.017462:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+39:11345:x1877942616513920:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1790945949.017486:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945949.017521:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d902 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330c39 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.017657:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d909 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.017672:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d909 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.017685:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d909 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945949.017697:0:6522:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1790945949.017818:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d902 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c39 expref: 42 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.017839:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d909 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c39 expref: 41 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.017848:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d40928bde00) 00010000:00010000:0.0:1790945949.017851:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790945949.017854:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe0200, rc 0) 00000100:00100000:0.0:1790945949.017946:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+41:11345:x1877942616513920:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 486us (880us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1790945949.017954:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 109 00000100:00100000:1.0:1790945949.022341:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945949.022510:0:7471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616514048 00000100:00100000:2.0:1790945949.022531:0:7471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616514048 00000100:00100000:2.0:1790945949.022594:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:2.0:1790945949.022604:0:7471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+41:2404:x1877942616514048:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790945949.022622:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945949.022659:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27d909 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c39 expref: 41 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.022679:0:7471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d40928bde00) 00010000:00010000:2.0:1790945949.022683:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945949.022744:0:7471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+40:2404:x1877942616514048:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 141us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945949.022769:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:3.0:1790945949.024790:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945949.025755:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616514304 00000100:00100000:2.0:1790945949.025768:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616514304 00000100:00100000:2.0:1790945949.025826:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 110 00000100:00100000:2.0:1790945949.025836:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+40:11345:x1877942616514304:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1790945949.025859:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945949.027478:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d917 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330c40 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.029110:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27d91e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.029134:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27d91e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.029147:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27d91e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945949.030287:0:6521:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1790945949.030449:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27d917 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c40 expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.030469:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27d91e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c40 expref: 42 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.030478:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d40928bde00) 00010000:00010000:2.0:1790945949.030480:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790945949.030483:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f8363c200, rc 0) 00000100:00100000:2.0:1790945949.030579:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+42:11345:x1877942616514304:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 4743us (5794us total) trans 4294967381 rc 0/0 00000100:00100000:2.0:1790945949.030589:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 110 00000001:00080000:0.0:1790945949.034129:0:9515:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:0.0:1790945949.034163:0:9515:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:3.0:1790945949.036519:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945949.037110:0:10099:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616514432 00000100:00100000:0.0:1790945949.037120:0:10099:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616514432 00000100:00100000:0.0:1790945949.037230:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 44 00000100:00100000:0.0:1790945949.037241:0:10099:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2402:x1877942616514432:12345-192.168.204.20@tcp:1:lfs.0 00010000:00010000:0.0:1790945949.037289:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057c5e76c/0xd9f4181e0d27d92c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.037310:0:10099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000087408219/0xd9f4181e0d27d8ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c2b expref: 6 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.037320:0:10099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790945949.037324:0:10099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790945949.037329:0:10099:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057c5e76c/0xd9f4181e0d27d92c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.037368:0:10099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000087408219/0xd9f4181e0d27d8ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c2b expref: 6 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.037384:0:10099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000087408219/0xd9f4181e0d27d8ed lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c2b expref: 6 pid: 8435 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945949.037398:0:10099:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83f3df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:10099:1877942638610304:192.168.204.20@tcp:104: 00000100:00100000:0.0:1790945949.037489:0:10099:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4d05c00 going to sleep for 11 seconds 00000100:00080000:1.0:1790945949.039012:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790945949.047740:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945949.047940:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616514560 00000100:00100000:3.0:1790945949.047974:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616514560 00002000:00100000:3.0:1790945949.048039:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9d40bff81c00 x1877942616514560/t0(0) o4->0cadc7a5-c0ba-4320-984f-d871ffb3a3ef@192.168.204.20@tcp:645/0 lens 504/0 e 0 to 0 dl 1790945960 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790945949.048051:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d40bff81c00 with x1877942616514560 ext(0->8) 00010000:00010000:3.0:1790945949.048061:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000087408219/0xd9f4181e0d27d8ed lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c2b expref: 7 pid: 8435 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945949.048078:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000087408219/0xd9f4181e0d27d8ed lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c2b expref: 7 pid: 8435 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790945949.048087:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9d40bff81c00 00000100:00100000:3.0:1790945949.048121:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1 00000100:00100000:3.0:1790945949.048132:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:2403:x1877942616514560:12345-192.168.204.20@tcp:4:lfs.0 00000100:00100000:3.0:1790945949.049619:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+9:2403:x1877942616514560:12345-192.168.204.20@tcp:4:lfs.0 Request processed in 1482us (1884us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1790945949.050820:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1 00002000:00100000:3.0:1790945949.050838:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9d40bff81c00 x1877942616514560/t4294967303(0) o4->0cadc7a5-c0ba-4320-984f-d871ffb3a3ef@192.168.204.20@tcp:645/0 lens 504/448 e 0 to 0 dl 1790945960 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790945949.051086:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d40bff81c00 with x1877942616514560 ext(0->8) 00010000:00010000:3.0:1790945949.051098:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000087408219/0xd9f4181e0d27d8ed lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c2b expref: 9 pid: 8435 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945949.051118:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000087408219/0xd9f4181e0d27d8ed lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c2b expref: 9 pid: 8435 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790945949.051147:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9d40bff81c00 00000100:00100000:2.0:1790945949.056729:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945949.057072:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616514688 00000100:00100000:3.0:1790945949.057083:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616514688 00010000:00010000:3.0:1790945949.057129:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000087408219/0xd9f4181e0d27d8ed lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c2b expref: 9 pid: 8435 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945949.057287:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 68 00000100:00100000:3.0:1790945949.057298:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4096cbe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+9:2404:x1877942616514688:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790945949.057318:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1790945949.057336:0:6508:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1790945949.057338:0:6508:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1790945949 00002000:00010000:3.0:1790945949.057340:0:6508:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1790945949 00002000:00010000:3.0:1790945949.057342:0:6508:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1790945949 00002000:00010000:3.0:1790945949.057344:0:6508:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1790945949.057351:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000087408219/0xd9f4181e0d27d8ed lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c2b expref: 9 pid: 8435 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945949.057364:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000087408219/0xd9f4181e0d27d8ed lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c2b expref: 9 pid: 8435 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945949.057390:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790945949.057394:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790945949.057399:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000057c5e76c/0xd9f4181e0d27d92c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945949.057429:0:6508:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057c5e76c/0xd9f4181e0d27d92c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945949.057451:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945949.057517:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4096cbe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+9:2404:x1877942616514688:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 209us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945949.057525:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 68 00010000:00010000:0.0:1790945949.058558:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087408219/0xd9f4181e0d27d8ed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c2b expref: 8 pid: 8435 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945949.058597:0:10099:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83f3df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:10099:1877942638610304:192.168.204.20@tcp:104: 00010000:00010000:0.0:1790945949.058623:0:10099:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000057c5e76c/0xd9f4181e0d27d92c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.062627:0:10099:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000057c5e76c/0xd9f4181e0d27d92c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.062637:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057c5e76c/0xd9f4181e0d27d92c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.062683:0:10099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057c5e76c/0xd9f4181e0d27d92c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.062692:0:10099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057c5e76c/0xd9f4181e0d27d92c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.063124:0:10099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057c5e76c/0xd9f4181e0d27d92c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.063135:0:10099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe1600 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:0.0:1790945949.063139:0:10099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057c5e76c/0xd9f4181e0d27d92c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.063148:0:10099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057c5e76c/0xd9f4181e0d27d92c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.063278:0:10099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057c5e76c/0xd9f4181e0d27d92c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.063286:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057c5e76c/0xd9f4181e0d27d92c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945949.063423:0:10099:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:2402:x1877942616514432:12345-192.168.204.20@tcp:1:lfs.0 Request processed in 26176us (26915us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945949.063434:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 44 00000100:00100000:2.0:1790945949.069068:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945949.069398:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616514944 00000100:00100000:0.0:1790945949.069410:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616514944 00000100:00100000:1.0:1790945949.070156:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 26 00000100:00100000:1.0:1790945949.070376:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4096dda450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+42:11345:x1877942616514944:12345-192.168.204.20@tcp:35:lfs.0 00000004:00010000:1.0:1790945949.070446:0:6525:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27d91e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c40 expref: 42 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790945949.070661:0:6525:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:1.0:1790945949.070699:0:6525:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1790945949.071484:0:6525:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:1.0:1790945949.071633:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d933 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945949.071651:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27d8d8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c1d expref: 46 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945949.071669:0:6525:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d933 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945949.071712:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27d8d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c1d expref: 46 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945949.071728:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27d8d8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c1d expref: 46 pid: 6521 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945949.071743:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff80000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6525:1877942638610432:192.168.204.20@tcp:104: 00000100:00100000:1.0:1790945949.071914:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f83588000 going to sleep for 11 seconds 00000100:00100000:3.0:1790945949.075888:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945949.076024:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff80000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6525:1877942638610432:192.168.204.20@tcp:104: 00010000:00010000:1.0:1790945949.076054:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d933 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945949.076366:0:7471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616515072 00000100:00100000:1.0:1790945949.076373:0:7471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616515072 00010000:00010000:1.0:1790945949.076409:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27d8d8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c1d expref: 47 pid: 6521 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945949.076450:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 69 00000100:00100000:1.0:1790945949.076460:0:7471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+47:2403:x1877942616515072:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790945949.076474:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945949.076481:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27d8d8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c1d expref: 47 pid: 6521 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945949.076528:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27d8d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c1d expref: 47 pid: 6521 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945949.076553:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27d8d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c1d expref: 47 pid: 6521 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945949.076569:0:7471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d40928bde00) 00010000:00010000:1.0:1790945949.076573:0:7471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d933 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945949.076583:0:7471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d933 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945949.076590:0:7471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d933 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945949.076615:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790945949.077187:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d933 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.077197:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d933 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790945949.077323:0:6525:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:0.0:1790945949.077444:0:6525:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:0.0:1790945949.077533:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83f3df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1877942638610560:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790945949.077585:0:6525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945949.077621:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638610560 00000100:00100000:0.0:1790945949.077626:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638610560 00000100:00100000:0.0:1790945949.077664:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1790945949.077672:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6525:x1877942638610560:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790945949.077739:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6525:x1877942638610560:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 68us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945949.077756:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1790945949.077780:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4d05540 going to sleep for 11 seconds 00000100:00100000:0.0:1790945949.077797:0:6525:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:0.0:1790945949.077802:0:6525:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:0.0:1790945949.077818:0:6525:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d40bff94380, transno 4294967302 00000100:00100000:0.0:1790945949.077838:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83f3df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1877942638610560:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1790945949.077971:0:6525:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:0.0:1790945949.078010:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83f3df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1877942638610688:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790945949.078037:0:6525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945949.078054:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4d05e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790945949.078077:0:12418:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638610688 00000100:00100000:0.0:1790945949.078081:0:12418:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638610688 00000100:00100000:0.0:1790945949.078105:0:12418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1790945949.078112:0:12418:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6525:x1877942638610688:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790945949.078232:0:12418:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6525:x1877942638610688:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 120us (193us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1790945949.078238:0:12418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1790945949.078276:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83f3df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1877942638610688:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1790945949.078305:0:6525:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:0.0:1790945949.078331:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d933 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.078339:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d933 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.078346:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d933 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.078362:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afc000 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945949.078367:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d933 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.078375:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d933 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.078388:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d40928bde00) 00010000:00010000:0.0:1790945949.078391:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1790945949.078395:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d933 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.078401:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc000/0xd9f4181e0d27d933 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790945949.078486:0:6525:0:(mdd_object.c:4180:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1790945949.078540:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:0.0:1790945949.078550:0:6525:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 399894382110ns, next at 400894379958ns, rc = 0 00000001:00080000:0.0:1790945949.078557:0:6525:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:0.0:1790945949.078577:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d40928bde00) 00010000:00010000:0.0:1790945949.078580:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790945949.078587:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27d91e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c40 expref: 51 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945949.079766:0:7471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+50:2403:x1877942616515072:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 3301us (3882us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945949.079778:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 69 00000100:00100000:0.0:1790945949.080053:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4096dda450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+49:11345:x1877942616514944:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 9886us (11097us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1790945949.080062:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 26 00000020:00080000:0.0:1790945949.080067:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1790945949.083340:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945949.083426:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616515200 00000100:00100000:0.0:1790945949.083438:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616515200 00000100:00100000:0.0:1790945949.083594:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 111 00000100:00100000:0.0:1790945949.083605:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+49:11345:x1877942616515200:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1790945949.083629:0:13005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945949.083650:0:13005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27d93a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330c47 expref: -99 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.083711:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27d93a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c47 expref: 50 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.083725:0:13005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27d93a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c47 expref: 50 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.083745:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d40bc937800) 00010000:00010000:0.0:1790945949.083748:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790945949.083751:0:13005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe0600, rc 0) 00000100:00100000:0.0:1790945949.083857:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+50:11345:x1877942616515200:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 254us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945949.083875:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 111 00000100:00100000:0.0:1790945949.088155:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945949.088388:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616515456 00000100:00100000:2.0:1790945949.088402:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616515456 00000100:00100000:2.0:1790945949.088462:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 27 00000100:00100000:2.0:1790945949.088472:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+50:11345:x1877942616515456:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:2.0:1790945949.088768:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+51:11345:x1877942616515456:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 297us (623us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1790945949.088777:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 27 00010000:00010000:3.0:1790945949.151395:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945949.189271:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945949.189680:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616515584 00000100:00100000:2.0:1790945949.189690:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616515584 00000100:00100000:2.0:1790945949.189750:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 112 00000100:00100000:2.0:1790945949.189760:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+51:11355:x1877942616515584:12345-192.168.204.20@tcp:34:lfs.0 00010000:00010000:2.0:1790945949.189840:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d941 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.189858:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d941 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.189889:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d941 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.189901:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d948 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.189929:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d948 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.189937:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d948 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.190026:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d94f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.190035:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d94f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.190041:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d94f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790945949.190090:0:8457:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d94f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.190103:0:8457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d941 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.190109:0:8457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d941 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.190117:0:8457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d941 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.190124:0:8457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f8363d600 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945949.190128:0:8457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d941 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.190136:0:8457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d941 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.190155:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d40bc9ad200) 00010000:00010000:2.0:1790945949.190158:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945949.190162:0:8457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d941 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.190199:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d941 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.190214:0:8457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d948 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.190219:0:8457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d948 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.190239:0:8457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d948 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.190246:0:8457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f8363c000 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945949.190249:0:8457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d948 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.190255:0:8457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d948 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.190262:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d40bc937a00) 00010000:00010000:2.0:1790945949.190265:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945949.190268:0:8457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d948 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.190274:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27d948 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.190295:0:8457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d94f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.190301:0:8457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d94f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.190306:0:8457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d94f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.190311:0:8457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f8363d400 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945949.190314:0:8457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d94f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.190321:0:8457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d94f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.190329:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d40bc937800) 00010000:00010000:2.0:1790945949.190331:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945949.190333:0:8457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d94f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.190340:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d94f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945949.190817:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+51:11355:x1877942616515584:12345-192.168.204.20@tcp:34:lfs.0 Request processed in 1055us (1552us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945949.190828:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 112 00000100:00100000:3.0:1790945949.245824:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945949.246084:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616515840 00000100:00100000:2.0:1790945949.246096:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616515840 00000100:00100000:0.0:1790945949.246349:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 113 00000100:00100000:0.0:1790945949.246362:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+51:11358:x1877942616515840:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1790945949.246385:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945949.246406:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27d956 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330c4e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.246536:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d95d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.246552:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d95d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.246564:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d95d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.246575:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27d964 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.246582:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27d964 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.246588:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27d964 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.246705:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27d96b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.246714:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27d96b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.246721:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27d96b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945949.246732:0:6522:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1790945949.246817:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d95d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.246824:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d95d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.246837:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d95d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.246844:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0400 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945949.246849:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d95d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.246858:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d95d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.246882:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d40bc9ad200) 00010000:00010000:0.0:1790945949.246885:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945949.246891:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d95d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.246897:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d95d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.246912:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27d964 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.246918:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27d964 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.246924:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27d964 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.246929:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe1a00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945949.246933:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27d964 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.246948:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27d964 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.246956:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d40bc937a00) 00010000:00010000:0.0:1790945949.246958:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945949.246961:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27d964 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.246967:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27d964 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.247005:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27d956 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c4e expref: 54 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.247020:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27d96b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c4e expref: 53 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.247027:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d40bc937800) 00010000:00010000:0.0:1790945949.247029:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790945949.247032:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe1400, rc 0) 00000100:00100000:0.0:1790945949.247108:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+53:11358:x1877942616515840:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 749us (1295us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1790945949.247117:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 113 00000100:00100000:0.0:1790945949.250859:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945949.250951:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616515968 00000100:00100000:2.0:1790945949.250974:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616515968 00000100:00100000:2.0:1790945949.251037:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 114 00000100:00100000:2.0:1790945949.251047:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+53:11358:x1877942616515968:12345-192.168.204.20@tcp:54:lfs.0 00010000:00010000:2.0:1790945949.251112:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d979 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.251130:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d979 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.251140:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d979 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.251219:0:13005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d979 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.251238:0:13005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d979 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.251245:0:13005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d979 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.251251:0:13005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f8363d400 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945949.251255:0:13005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d979 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.251262:0:13005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d979 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.251273:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d40bc937800) 00010000:00010000:2.0:1790945949.251276:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790945949.251281:0:13005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d979 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.251298:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27d979 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945949.251382:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+53:11358:x1877942616515968:12345-192.168.204.20@tcp:54:lfs.0 Request processed in 335us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945949.251390:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 114 00000100:00100000:3.0:1790945949.254691:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945949.255129:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616516224 00000100:00100000:2.0:1790945949.255143:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616516224 00000100:00100000:2.0:1790945949.255248:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 28 00000100:00100000:2.0:1790945949.255259:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+53:11358:x1877942616516224:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:2.0:1790945949.255592:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+54:11358:x1877942616516224:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 334us (912us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1790945949.255601:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 28 00000100:00100000:0.0:1790945949.345496:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945949.346106:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616516480 00000100:00100000:3.0:1790945949.346118:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616516480 00000100:00100000:3.0:1790945949.346212:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 115 00000100:00100000:3.0:1790945949.346235:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+54:11368:x1877942616516480:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:3.0:1790945949.346265:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945949.346269:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790945949.346303:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27d8fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c32 expref: 54 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945949.346327:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d40bc9ad200) 00010000:00010000:3.0:1790945949.346333:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790945949.346350:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27d980 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330c55 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945949.346478:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27d987 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945949.346492:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27d96b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c4e expref: 54 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945949.346768:0:6523:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27d987 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945949.346803:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27d96b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c4e expref: 54 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945949.346818:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27d96b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c4e expref: 54 pid: 6522 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945949.346832:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83f69500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1877942638610816:192.168.204.20@tcp:104: 00000100:00100000:3.0:1790945949.347012:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408704ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1790945949.351337:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945949.351473:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83f69500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1877942638610816:192.168.204.20@tcp:104: 00010000:00010000:3.0:1790945949.351513:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27d987 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945949.351761:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616516608 00000100:00100000:2.0:1790945949.351769:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616516608 00010000:00010000:2.0:1790945949.351804:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27d96b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c4e expref: 55 pid: 6522 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945949.351846:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 70 00000100:00100000:2.0:1790945949.351855:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+55:2403:x1877942616516608:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790945949.351883:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945949.351890:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27d96b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c4e expref: 55 pid: 6522 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.351902:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27d96b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c4e expref: 55 pid: 6522 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.351944:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27d96b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c4e expref: 55 pid: 6522 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.351959:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d40bc937800) 00010000:00010000:2.0:1790945949.351964:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27d987 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.351973:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27d987 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.351981:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27d987 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.352019:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945949.352070:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+54:2403:x1877942616516608:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 216us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945949.352078:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 70 00010000:00010000:0.0:1790945949.352723:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27d987 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.352744:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27d987 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945949.352762:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1790945949.352912:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27d980 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c55 expref: 55 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.352930:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27d987 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c55 expref: 54 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.352937:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d40bc937800) 00010000:00010000:0.0:1790945949.352940:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790945949.352942:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40813fea00, rc 0) 00000100:00100000:0.0:1790945949.352995:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+54:11368:x1877942616516480:12345-192.168.204.20@tcp:101:bash.0 Request processed in 6763us (7500us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1790945949.353004:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 115 00000100:00100000:1.0:1790945949.358741:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945949.359120:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616516736 00000100:00100000:2.0:1790945949.359133:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616516736 00000100:00100000:2.0:1790945949.359239:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 116 00000100:00100000:2.0:1790945949.359250:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+54:11368:x1877942616516736:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:2.0:1790945949.359277:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945949.359296:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d995 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330c5c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.359335:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27d99c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.359362:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27d99c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.359373:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27d99c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.359483:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d995 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c5c expref: 56 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.359516:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27d99c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c5c expref: 55 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.359524:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d40bc937800) 00010000:00010000:2.0:1790945949.359526:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790945949.359529:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f8363c600, rc 0) 00000100:00100000:2.0:1790945949.359591:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+55:11368:x1877942616516736:12345-192.168.204.20@tcp:101:bash.0 Request processed in 344us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945949.359598:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 116 00000100:00100000:2.0:1790945949.363654:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945949.363935:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616516992 00000100:00100000:3.0:1790945949.363945:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616516992 00000100:00100000:3.0:1790945949.364012:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 117 00000100:00100000:3.0:1790945949.364023:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+55:11368:x1877942616516992:12345-192.168.204.20@tcp:36:bash.0 00010000:00010000:3.0:1790945949.364317:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d9a3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945949.364349:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d9a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945949.364361:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d9a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790945949.364405:0:8457:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:3.0:1790945949.364427:0:8457:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000060fc2cc9 reply state 0000000027f7a803 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d9a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945949.364439:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d9a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945949.364446:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d40bc937800) 00010000:00010000:3.0:1790945949.364450:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790945949.364453:0:8457:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790945949.364546:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+58:11368:x1877942616516992:12345-192.168.204.20@tcp:36:bash.0 Request processed in 524us (901us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1790945949.364554:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 117 00000020:00080000:3.0:1790945949.364559:0:8457:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1790945949.368490:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945949.368634:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616517120 00000100:00100000:0.0:1790945949.368645:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616517120 00000100:00100000:0.0:1790945949.368701:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 118 00000100:00100000:0.0:1790945949.368710:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+58:11368:x1877942616517120:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:0.0:1790945949.368733:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945949.368751:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27d9aa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330c63 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.368838:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27d9b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.368884:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27d987 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c55 expref: 59 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.368893:0:6523:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27d9b1 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.368929:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27d987 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c55 expref: 59 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.368943:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27d987 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c55 expref: 59 pid: 6523 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945949.368957:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83f3ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1877942638610944:192.168.204.20@tcp:104: 00000100:00100000:0.0:1790945949.369053:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4d056c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790945949.372329:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945949.372444:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616517248 00000100:00100000:2.0:1790945949.372452:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616517248 00010000:00010000:2.0:1790945949.372489:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27d987 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c55 expref: 60 pid: 6523 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945949.372533:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 71 00000100:00100000:2.0:1790945949.372542:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+60:2403:x1877942616517248:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790945949.372555:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945949.372576:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27d987 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c55 expref: 60 pid: 6523 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.372589:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27d987 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c55 expref: 60 pid: 6523 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.372611:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d40bc937800) 00010000:00010000:2.0:1790945949.372616:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27d9b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.372637:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27d9b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.372645:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27d9b1 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.372662:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945949.372714:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+60:2403:x1877942616517248:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 173us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945949.372722:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 71 00010000:00010000:0.0:1790945949.373545:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27d987 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c55 expref: 59 pid: 6523 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945949.373565:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83f3ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1877942638610944:192.168.204.20@tcp:104: 00010000:00010000:0.0:1790945949.373584:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27d9b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.373600:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27d9b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.373605:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27d9b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945949.373666:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1790945949.373678:0:6523:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790945949.373700:0:6523:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27d9b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.373729:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27d9aa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c63 expref: 59 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.373743:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27d9b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c63 expref: 58 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.373751:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d40bc937800) 00010000:00010000:0.0:1790945949.373754:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790945949.373757:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe1a00, rc 0) 00000100:00100000:0.0:1790945949.373804:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+58:11368:x1877942616517120:12345-192.168.204.20@tcp:101:bash.0 Request processed in 5094us (5323us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945949.373811:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 118 00000100:00100000:1.0:1790945949.377090:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945949.377243:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616517504 00000100:00100000:2.0:1790945949.377253:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616517504 00000100:00100000:2.0:1790945949.377303:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 29 00000100:00100000:2.0:1790945949.377311:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+58:11368:x1877942616517504:12345-192.168.204.20@tcp:35:bash.0 00000100:00100000:2.0:1790945949.377538:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+59:11368:x1877942616517504:12345-192.168.204.20@tcp:35:bash.0 Request processed in 227us (459us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1790945949.377546:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 29 00000100:00100000:3.0:1790945949.458572:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945949.463502:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616517632 00000100:00100000:0.0:1790945949.463519:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616517632 00000100:00100000:0.0:1790945949.463691:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 119 00000100:00100000:0.0:1790945949.463703:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+59:11374:x1877942616517632:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1790945949.463732:0:13005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945949.463754:0:13005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27d9b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330c6a expref: -99 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.463837:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d9bf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.463853:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d9bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.463901:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d9bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945949.463959:0:13005:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1790945949.463964:0:13005:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790945949.463987:0:13005:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d9bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.464014:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27d9b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c6a expref: 61 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.464034:0:13005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d9bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c6a expref: 60 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.464043:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d40bc9ad200) 00010000:00010000:0.0:1790945949.464047:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790945949.464050:0:13005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe0400, rc 0) 00000100:00100000:0.0:1790945949.464154:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+60:11374:x1877942616517632:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 453us (5592us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945949.464162:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 119 00000100:00100000:3.0:1790945949.470394:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945949.470703:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616517760 00000100:00100000:0.0:1790945949.470713:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616517760 00000100:00100000:0.0:1790945949.470780:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 120 00000100:00100000:0.0:1790945949.470790:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+60:11374:x1877942616517760:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1790945949.470813:0:13005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945949.470849:0:13005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27d9c6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330c71 expref: -99 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.470955:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27d9cd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.470971:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27d9cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.470982:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27d9cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.470993:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27d9d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.471002:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27d9d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.471009:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27d9d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.471080:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27d9db lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.471089:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27d9db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.471096:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27d9db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945949.471138:0:13005:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1790945949.471142:0:13005:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790945949.471161:0:13005:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27d9db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.471203:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27d9db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.471212:0:13005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27d9cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.471230:0:13005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27d9cd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.471238:0:13005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27d9cd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.471243:0:13005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe1400 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945949.471248:0:13005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27d9cd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.471255:0:13005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27d9cd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.471266:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d40bc9ad200) 00010000:00010000:0.0:1790945949.471270:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945949.471274:0:13005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27d9cd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.471279:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27d9cd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.471291:0:13005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27d9d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.471297:0:13005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27d9d4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.471309:0:13005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27d9d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.471315:0:13005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0e00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945949.471317:0:13005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27d9d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.471324:0:13005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27d9d4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.471332:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d40bc937a00) 00010000:00010000:0.0:1790945949.471335:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945949.471337:0:13005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27d9d4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.471343:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27d9d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.471371:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27d9c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c71 expref: 62 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.471386:0:13005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27d9db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c71 expref: 61 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.471393:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d40bc937800) 00010000:00010000:0.0:1790945949.471395:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790945949.471397:0:13005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe0a00, rc 0) 00000100:00100000:0.0:1790945949.471514:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+61:11374:x1877942616517760:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 724us (1129us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945949.471531:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 120 00000100:00100000:1.0:1790945949.475042:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945949.475130:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616518016 00000100:00100000:0.0:1790945949.475140:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616518016 00000100:00100000:0.0:1790945949.475234:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 121 00000100:00100000:0.0:1790945949.475245:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+61:11374:x1877942616518016:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1790945949.475271:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945949.475293:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27d9e2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330c78 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.475411:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d9e9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.475427:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27d9b1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c63 expref: 62 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.475435:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27d9db lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c71 expref: 62 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.475443:0:6523:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d9e9 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.475477:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27d9db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c71 expref: 62 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.475491:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27d9db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c71 expref: 62 pid: 13005 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945949.475517:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83f3ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1877942638611072:192.168.204.20@tcp:104: 00010000:00010000:0.0:1790945949.475630:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27d9b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c63 expref: 62 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.475639:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27d9b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c63 expref: 62 pid: 6523 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945949.475649:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83f3c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1877942638611200:192.168.204.20@tcp:104: 00000100:00100000:0.0:1790945949.475673:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4d056c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945949.481637:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945949.481788:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616518144 00000100:00100000:2.0:1790945949.481798:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616518144 00010000:00010000:2.0:1790945949.481877:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27d9db lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c71 expref: 63 pid: 13005 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945949.481920:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 72 00000100:00100000:2.0:1790945949.481931:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+63:2404:x1877942616518144:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790945949.481946:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945949.481954:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27d9db lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c71 expref: 63 pid: 13005 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.481968:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27d9db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c71 expref: 63 pid: 13005 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.481990:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d40bc937800) 00010000:00010000:2.0:1790945949.481995:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d9e9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.482004:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d9e9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.482010:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945949.482071:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+63:2404:x1877942616518144:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 142us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945949.482079:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 72 00010000:00010000:0.0:1790945949.484324:0:6523:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.20@tcp) returned -22 from blocking AST (req@0000000093d9d89e x1877942638611072) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27d9db lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c71 expref: 62 pid: 13005 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.484351:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27d9db lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c71 expref: 62 pid: 13005 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945949.484371:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83f3ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1877942638611072:192.168.204.20@tcp:104: 00000100:00100000:0.0:1790945949.484388:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83f3c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1877942638611200:192.168.204.20@tcp:104: 00010000:00010000:0.0:1790945949.484413:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d40bc937800) 00010000:00010000:0.0:1790945949.484419:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d9e9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.484429:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d9e9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.484437:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d9e9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945949.486748:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945949.486848:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616518272 00000100:00100000:2.0:1790945949.486868:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616518272 00010000:00010000:2.0:1790945949.486909:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27d9b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c63 expref: 62 pid: 6523 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945949.486951:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 73 00000100:00100000:2.0:1790945949.486975:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+62:2401:x1877942616518272:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790945949.486989:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945949.486996:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27d9b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c63 expref: 62 pid: 6523 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.487009:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27d9b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c63 expref: 62 pid: 6523 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.487029:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27d9b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c63 expref: 62 pid: 6523 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.487044:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d40bc937800) 00010000:00010000:2.0:1790945949.487050:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d9e9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.487059:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d9e9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.487067:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d9e9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.487092:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945949.487157:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+61:2401:x1877942616518272:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 184us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945949.487196:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 73 00010000:00010000:0.0:1790945949.488243:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d9e9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.488264:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d9e9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945949.488286:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1790945949.488418:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27d9e2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c78 expref: 62 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.488435:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d9e9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c78 expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.488443:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d40bc937800) 00010000:00010000:0.0:1790945949.488446:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790945949.488449:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe1600, rc 0) 00000100:00100000:0.0:1790945949.488491:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+61:11374:x1877942616518016:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 13248us (13458us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1790945949.488512:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 121 00000100:00100000:3.0:1790945949.493150:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945949.493373:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616518528 00000100:00100000:2.0:1790945949.493385:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616518528 00000100:00100000:2.0:1790945949.493455:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 8 00000100:00100000:2.0:1790945949.493465:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+61:11374:x1877942616518528:12345-192.168.204.20@tcp:103:lfs.0 00010000:00010000:2.0:1790945949.493508:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945949.493533:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27d93a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c47 expref: 61 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.493556:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d40bc937800) 00010000:00010000:2.0:1790945949.493562:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945949.493619:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+60:11374:x1877942616518528:12345-192.168.204.20@tcp:103:lfs.0 Request processed in 156us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945949.493627:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 8 00000100:00100000:1.0:1790945949.500590:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945949.500704:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616518656 00000100:00100000:0.0:1790945949.500715:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616518656 00000100:00100000:0.0:1790945949.500773:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 122 00000100:00100000:0.0:1790945949.500784:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+60:11374:x1877942616518656:12345-192.168.204.20@tcp:58:lfs.0 00010000:00010000:0.0:1790945949.500937:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27d9f7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.500955:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27d9f7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945949.500967:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27d9f7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790945949.501074:0:13005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1790945949.501162:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+60:11374:x1877942616518656:12345-192.168.204.20@tcp:58:lfs.0 Request processed in 379us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945949.501203:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 122 00000100:00100000:1.0:1790945949.503572:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945949.503675:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616518784 00000100:00100000:2.0:1790945949.503685:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616518784 00000100:00100000:2.0:1790945949.503740:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 123 00000100:00100000:2.0:1790945949.503749:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+60:11374:x1877942616518784:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1790945949.503768:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945949.503787:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d9fe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330c7f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.503837:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27d9f7 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.503849:0:6522:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d9fe lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c7f expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.503880:0:6522:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27d9f7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.503895:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d9fe lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c7f expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.503933:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d40bc937800) 00010000:00010000:2.0:1790945949.503936:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790945949.503941:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d9fe lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c7f expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945949.503949:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f8363d600, rc 0) 00000100:00100000:2.0:1790945949.504004:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+61:11374:x1877942616518784:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 256us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945949.504011:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 123 00010000:00010000:3.0:1790945950.175600:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790945950.176008:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790945950.176028:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790945950.176094:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1790945950.177209:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790945950.179476:0:13803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83f62680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13803:1877942638611328:192.168.204.20@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790945950.179766:0:13803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408fc76900 going to sleep for 11 seconds 00000100:00100000:1.0:1790945950.207554:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945950.207650:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616518912 00000100:00100000:0.0:1790945950.207678:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616518912 00000100:00100000:0.0:1790945950.207779:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 124 00000100:00100000:0.0:1790945950.207791:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+62:11375:x1877942616518912:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790945950.207824:0:6523:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790945950.207958:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+62:11375:x1877942616518912:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 Request processed in 170us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945950.207967:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 124 00000100:00080000:1.0:1790945950.210315:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790945950.211566:0:13803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83f62680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13803:1877942638611328:192.168.204.20@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790945950.215453:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945950.215724:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616519040 00000100:00100000:2.0:1790945950.215740:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616519040 00000100:00100000:2.0:1790945950.217257:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 125 00000100:00100000:2.0:1790945950.217269:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4083514380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+61:11375:x1877942616519040:12345-192.168.204.20@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1790945950.218276:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27da05 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.219865:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27da05 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.219910:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27da05 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.219935:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27da0c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.219945:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27da0c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.219952:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27da0c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.219980:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27da13 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.219989:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27da13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.219996:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27da13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945950.222475:0:6521:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1790945950.222485:0:6521:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790945950.222509:0:6521:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27da13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.222528:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27da05 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.222536:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27da05 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.222569:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27da05 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.222576:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f8363da00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945950.222580:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27da05 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.222588:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27da05 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.222603:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3f824ec400) 00010000:00010000:2.0:1790945950.222606:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945950.222610:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27da05 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.222617:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27da05 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.222634:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27da0c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.222641:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27da0c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.222647:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27da0c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.222653:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f8363ca00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945950.222655:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27da0c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.224241:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27da0c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.224258:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9d3f824eff00) 00010000:00010000:2.0:1790945950.224261:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945950.224270:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27da0c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.224278:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27da0c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.224314:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27da13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.224321:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27da13 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.224328:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27da13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.225775:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f8363c000 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945950.225782:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27da13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.225792:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27da13 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.225806:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d40bc937800) 00010000:00010000:2.0:1790945950.225810:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945950.225814:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27da13 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.226428:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27da13 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945950.226547:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4083514380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+61:11375:x1877942616519040:12345-192.168.204.20@tcp:34:lhsmtool_posix.0 Request processed in 9275us (11104us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945950.226558:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 125 00000100:00100000:1.0:1790945950.241402:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945950.244089:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616519296 00000100:00100000:3.0:1790945950.244105:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616519296 00000100:00100000:3.0:1790945950.244221:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 126 00000100:00100000:3.0:1790945950.244232:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+61:11375:x1877942616519296:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790945950.244255:0:8457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945950.244276:0:8457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27da1a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330c86 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.244393:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27da21 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.244411:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27da21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.244423:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27da21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945950.244435:0:8457:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1790945950.244548:0:8457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27da21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.244557:0:8457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27da21 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.244564:0:8457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27da21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.244570:0:8457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080030a00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945950.244574:0:8457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27da21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.244582:0:8457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27da21 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.244607:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d40bc937800) 00010000:00010000:3.0:1790945950.244610:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790945950.244615:0:8457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27da21 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.244622:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27da21 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.244664:0:8457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27da1a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c86 expref: 63 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.244674:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3f824ec400) 00010000:00010000:3.0:1790945950.244677:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790945950.244681:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27da1a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c86 expref: 63 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.244692:0:8457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4080031400, rc 0) 00000100:00100000:3.0:1790945950.244778:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+62:11375:x1877942616519296:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 548us (3450us total) trans 4294967399 rc 301/301 00000100:00100000:3.0:1790945950.244786:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 126 00000100:00100000:1.0:1790945950.254814:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945950.254954:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616519424 00000100:00100000:3.0:1790945950.254967:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616519424 00000100:00100000:3.0:1790945950.255046:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 127 00000100:00100000:3.0:1790945950.255056:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+62:11375:x1877942616519424:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790945950.255094:0:13005:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790945950.255241:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+62:11375:x1877942616519424:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 Request processed in 187us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945950.255267:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 127 00000100:00100000:2.0:1790945950.263970:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945950.264139:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616519680 00000100:00100000:1.0:1790945950.264151:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616519680 00000100:00100000:1.0:1790945950.264261:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 128 00000100:00100000:1.0:1790945950.264274:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+62:11375:x1877942616519680:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790945950.264297:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945950.264302:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1790945950.264331:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27d9bf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c6a expref: 62 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.264353:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d40bc9ad200) 00010000:00010000:1.0:1790945950.264358:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790945950.264374:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27da2f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330c8d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790945950.264973:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:1.0:1790945950.265985:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc400/0xd9f4181e0d27da36 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.266003:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc400/0xd9f4181e0d27da36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.266013:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc400/0xd9f4181e0d27da36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.266347:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27da2f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c8d expref: 64 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.266380:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc400/0xd9f4181e0d27da36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c8d expref: 63 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.266389:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d40928bd600) 00010000:00010000:1.0:1790945950.266392:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790945950.266395:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4092afc400, rc 0) 00000100:00100000:1.0:1790945950.266492:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+63:11375:x1877942616519680:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 2221us (2534us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1790945950.266500:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 128 00000100:00100000:1.0:1790945950.284933:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945950.285039:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616519936 00000100:00100000:0.0:1790945950.285053:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616519936 00000100:00100000:0.0:1790945950.285133:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 129 00000100:00100000:0.0:1790945950.285145:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+63:11375:x1877942616519936:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790945950.285248:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945950.285284:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc400/0xd9f4181e0d27da36 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c8d expref: 63 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.285304:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d40928bd600) 00010000:00010000:0.0:1790945950.285316:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790945950.285339:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27da44 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.285357:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27da44 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.285386:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27da44 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.285402:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27da4b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x5b3b6a5f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.285410:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27da4b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x5b3b6a5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.285416:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27da4b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x5b3b6a5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.285462:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27da44 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.285470:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27da44 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.285476:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27da44 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.285483:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945950.285487:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27da44 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.285494:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27da44 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.285502:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d40bc9ad200) 00010000:00010000:0.0:1790945950.285505:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945950.285509:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27da44 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.285522:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27da44 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.285533:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27da4b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x5b3b6a5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.285539:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27da4b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x5b3b6a5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.285545:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27da4b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x5b3b6a5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.285549:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe1e00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945950.285553:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27da4b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x5b3b6a5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.285558:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27da4b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x5b3b6a5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.285566:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x5b3b6a5f (ffff9d40bc937200) 00010000:00010000:0.0:1790945950.285569:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945950.285572:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27da4b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x5b3b6a5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.285578:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27da4b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x5b3b6a5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945950.285673:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+62:11375:x1877942616519936:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 529us (755us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790945950.285681:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 129 00000100:00100000:3.0:1790945950.289006:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945950.289118:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616520064 00000100:00100000:0.0:1790945950.289129:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616520064 00000100:00100000:0.0:1790945950.289211:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 130 00000100:00100000:0.0:1790945950.289223:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4083515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+62:11375:x1877942616520064:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790945950.289245:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945950.289269:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27da52 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330c94 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.289310:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27da59 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.289324:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27da59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.289737:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27da59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.289867:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27da52 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c94 expref: 64 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.289886:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27da59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c94 expref: 63 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.289896:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d40bc937500) 00010000:00010000:0.0:1790945950.289899:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790945950.289903:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe1400, rc 0) 00000100:00100000:0.0:1790945950.289962:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4083515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+63:11375:x1877942616520064:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 742us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945950.289970:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 130 00000100:00100000:2.0:1790945950.305333:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945950.305903:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616520320 00000100:00100000:1.0:1790945950.305915:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616520320 00000100:00100000:1.0:1790945950.305976:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 131 00000100:00100000:1.0:1790945950.305988:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+63:11375:x1877942616520320:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790945950.306099:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27da60 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.306120:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27da60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.306133:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27da60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790945950.306462:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:1.0:1790945950.306473:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 401122304587ns, next at 402122301497ns, rc = 0 00000004:00010000:1.0:1790945950.306526:0:6521:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005de1539d reply state 00000000bc48518e transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27da60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.306561:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27da60 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.306569:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d40bc937500) 00010000:00010000:1.0:1790945950.306573:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1790945950.306576:0:6521:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790945950.306681:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+65:11375:x1877942616520320:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 694us (1363us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1790945950.306689:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 131 00000100:00100000:1.0:1790945950.323512:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945950.323849:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616520448 00000100:00100000:3.0:1790945950.323859:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616520448 00000100:00100000:3.0:1790945950.323924:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 132 00000100:00100000:3.0:1790945950.323934:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+65:11375:x1877942616520448:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790945950.323958:0:13005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945950.323977:0:13005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27da67 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330c9b expref: -99 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.324034:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27da67 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c9b expref: 66 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.324048:0:13005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27da67 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c9b expref: 66 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.324066:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d40bc937500) 00010000:00010000:3.0:1790945950.324070:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790945950.324073:0:13005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4080031400, rc 0) 00000100:00100000:3.0:1790945950.324147:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+66:11375:x1877942616520448:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 214us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945950.324154:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 132 00000100:00100000:3.0:1790945950.331613:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945950.331730:0:8436:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616520576 00000100:00100000:1.0:1790945950.331748:0:8436:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616520576 00000100:00100000:1.0:1790945950.332087:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 45 00000100:00100000:1.0:1790945950.332100:0:8436:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408723a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+8:2404:x1877942616520576:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1790945950.332326:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790945950.335252:0:8436:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408723a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+9:2404:x1877942616520576:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 Request processed in 3146us (3646us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1790945950.335265:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 45 00000100:00100000:0.0:1790945950.345037:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945950.350039:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616520832 00000100:00100000:2.0:1790945950.350058:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616520832 00000100:00100000:2.0:1790945950.350262:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 30 00000100:00100000:2.0:1790945950.350274:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+66:11375:x1877942616520832:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790945950.350591:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+67:11375:x1877942616520832:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 Request processed in 319us (5568us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1790945950.350599:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 30 00000100:00100000:1.0:1790945950.354742:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945950.355095:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616521088 00000100:00100000:3.0:1790945950.355105:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616521088 00000100:00100000:3.0:1790945950.355157:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 133 00000100:00100000:3.0:1790945950.355187:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+67:11375:x1877942616521088:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790945950.355326:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+67:11375:x1877942616521088:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 159us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945950.355334:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 133 00000100:00100000:3.0:1790945950.361748:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945950.362002:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616521216 00000100:00100000:0.0:1790945950.362014:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616521216 00000100:00100000:0.0:1790945950.362083:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 134 00000100:00100000:0.0:1790945950.362092:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ec0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+67:11375:x1877942616521216:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790945950.362113:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945950.362211:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27da6e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330ca2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.362305:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27da75 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.362319:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27da75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.362330:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27da75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945950.362373:0:6523:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790945950.362391:0:6523:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27da75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.362417:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27da6e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ca2 expref: 69 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.362435:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27da75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ca2 expref: 68 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.362454:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d40bc937500) 00010000:00010000:0.0:1790945950.362457:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790945950.362462:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe1c00, rc 0) 00000100:00100000:0.0:1790945950.362517:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ec0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+68:11375:x1877942616521216:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 427us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945950.362525:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 134 00000100:00100000:0.0:1790945950.378220:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945950.378857:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616521344 00000100:00100000:1.0:1790945950.378868:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616521344 00000100:00100000:1.0:1790945950.378931:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 46 00000100:00100000:1.0:1790945950.378941:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+9:2403:x1877942616521344:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790945950.378960:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945950.378981:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000285ccc31/0xd9f4181e0d27da7c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330ca9 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790945950.379009:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abfaa9e, blocks: 0x0 00010000:00010000:1.0:1790945950.379030:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=401s v=(0 0) 00010000:00010000:1.0:1790945950.379035:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945950.379059:0:8435:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000285ccc31/0xd9f4181e0d27da7c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ca9 expref: 10 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.379080:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000285ccc31/0xd9f4181e0d27da7c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ca9 expref: 10 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.379093:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4092afc000, rc 0) 00000100:00100000:1.0:1790945950.379234:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+10:2403:x1877942616521344:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 293us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945950.379241:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 46 00000100:00100000:1.0:1790945950.387355:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945950.387483:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616521600 00000100:00100000:2.0:1790945950.387493:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616521600 00000100:00100000:2.0:1790945950.387556:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 135 00000100:00100000:2.0:1790945950.387566:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+68:11375:x1877942616521600:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790945950.387667:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+68:11375:x1877942616521600:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 102us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945950.387675:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 135 00000100:00100000:0.0:1790945950.392569:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945950.392706:0:10099:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616521728 00000100:00100000:3.0:1790945950.392715:0:10099:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616521728 00000100:00100000:3.0:1790945950.392782:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 47 00000100:00100000:3.0:1790945950.392793:0:10099:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+10:11375:x1877942616521728:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790945950.392822:0:10099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945950.392854:0:10099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6f1c9eb/0xd9f4181e0d27da83 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330cb0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.392886:0:10099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000285ccc31/0xd9f4181e0d27da7c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ca9 expref: 11 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.392896:0:10099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945950.392900:0:10099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945950.392905:0:10099:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6f1c9eb/0xd9f4181e0d27da83 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cb0 expref: 11 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.392939:0:10099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000285ccc31/0xd9f4181e0d27da7c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ca9 expref: 11 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.392952:0:10099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000285ccc31/0xd9f4181e0d27da7c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ca9 expref: 11 pid: 8435 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945950.392986:0:10099:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83ec3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10099:1877942638611456:192.168.204.20@tcp:104: 00000100:00100000:3.0:1790945950.393089:0:10099:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408704f840 going to sleep for 11 seconds 00000100:00100000:0.0:1790945950.403667:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945950.404069:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616521856 00000100:00100000:2.0:1790945950.404079:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616521856 00010000:00010000:2.0:1790945950.404133:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000285ccc31/0xd9f4181e0d27da7c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ca9 expref: 12 pid: 8435 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945950.404214:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 74 00000100:00100000:2.0:1790945950.404225:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4096cbe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+12:2403:x1877942616521856:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790945950.404240:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945950.404261:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000285ccc31/0xd9f4181e0d27da7c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ca9 expref: 12 pid: 8435 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.404276:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000285ccc31/0xd9f4181e0d27da7c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ca9 expref: 12 pid: 8435 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.404318:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790945950.404323:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790945950.404331:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e6f1c9eb/0xd9f4181e0d27da83 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cb0 expref: 12 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.404343:0:6507:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6f1c9eb/0xd9f4181e0d27da83 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cb0 expref: 12 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.404381:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e6f1c9eb/0xd9f4181e0d27da83 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cb0 expref: 12 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945950.404397:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83f63800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6507:1877942638611584:192.168.204.20@tcp:105: 00000100:00100000:2.0:1790945950.404467:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408fc76a80 going to sleep for 11 seconds 00010000:00010000:3.0:1790945950.405120:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000285ccc31/0xd9f4181e0d27da7c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ca9 expref: 12 pid: 8435 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945950.405136:0:10099:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83ec3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10099:1877942638611456:192.168.204.20@tcp:104: 00010000:00010000:3.0:1790945950.405160:0:10099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e6f1c9eb/0xd9f4181e0d27da83 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cb0 expref: 11 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.405214:0:10099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4080030a00, rc 0) 00000100:00100000:3.0:1790945950.405246:0:10099:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+11:11375:x1877942616521728:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 12456us (12687us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945950.405253:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 47 00000100:00100000:2.0:1790945950.409771:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83f63800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6507:1877942638611584:192.168.204.20@tcp:105: 00010000:00010000:2.0:1790945950.409824:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945950.409894:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4096cbe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+10:2403:x1877942616521856:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 5669us (6234us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945950.409905:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 74 00000100:00100000:0.0:1790945950.416381:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945950.416559:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616521984 00000100:00100000:3.0:1790945950.416571:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616521984 00002000:00100000:3.0:1790945950.416621:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9d3f83f3e300 x1877942616521984/t0(0) o4->0cadc7a5-c0ba-4320-984f-d871ffb3a3ef@192.168.204.20@tcp:646/0 lens 504/0 e 0 to 0 dl 1790945961 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790945950.416633:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3f83f3e300 with x1877942616521984 ext(0->12) 00002000:00010000:3.0:1790945950.416639:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d3f83f3e300 00000100:00100000:3.0:1790945950.416672:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2 00000100:00100000:3.0:1790945950.416681:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+10:2403:x1877942616521984:12345-192.168.204.20@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1790945950.424103:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+12:2403:x1877942616521984:12345-192.168.204.20@tcp:4:lhsmtool_posix.0 Request processed in 7413us (7722us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1790945950.424141:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2 00002000:00100000:0.0:1790945950.424154:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9d3f83f3e300 x1877942616521984/t4294967309(0) o4->0cadc7a5-c0ba-4320-984f-d871ffb3a3ef@192.168.204.20@tcp:646/0 lens 504/448 e 0 to 0 dl 1790945961 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790945950.424165:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3f83f3e300 with x1877942616521984 ext(0->12) 00002000:00010000:0.0:1790945950.424187:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d3f83f3e300 00000100:00100000:0.0:1790945950.432352:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945950.432496:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616522112 00000100:00100000:1.0:1790945950.432506:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616522112 00000100:00100000:1.0:1790945950.432570:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 136 00000100:00100000:1.0:1790945950.432580:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+68:11375:x1877942616522112:12345-192.168.204.20@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1790945950.446283:0:6500:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:2.0:1790945950.446305:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:2.0:1790945950.446354:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:2.0:1790945950.446375:0:6500:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d40b4d05540 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1790945950.446379:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d40bca9e000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d40b4d05900 00000020:00080000:2.0:1790945950.446382:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d40bca9e400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d3f835dfe00 00000004:00080000:2.0:1790945950.446404:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1790945950.446431:0:6500:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d4084073480 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1790945950.446434:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d40903d3000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d4090140c00 00000020:00080000:2.0:1790945950.446436:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d40903d3b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d40bff06800 00000020:00080000:0.0:1790945950.446865:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1790945950.446947:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1790945950.447012:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790945950.447031:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83f3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638611712:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1790945950.447102:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945950.447181:0:8436:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638611712 00000100:00100000:0.0:1790945950.447205:0:8436:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638611712 00000100:00100000:0.0:1790945950.447262:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790945950.447271:0:8436:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1877942638611712:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1790945950.447297:0:8436:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:0.0:1790945950.447329:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6abfaa9d, atime: 0x6abfaa9d, ctime: 0x6abfaa9d, blocks: 0x8 00010000:00010000:0.0:1790945950.447337:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000254e0b93/0xd9f4181e0d27da8a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.447354:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=401s v=(0 0) 00010000:00010000:0.0:1790945950.447358:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790945950.447365:0:8436:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000254e0b93/0xd9f4181e0d27da8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.447381:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000254e0b93/0xd9f4181e0d27da8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.447390:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000254e0b93/0xd9f4181e0d27da8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.447398:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000254e0b93/0xd9f4181e0d27da8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.447414:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790945950.447599:0:8436:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3650:x1877942638611712:12345-0@lo:6:osp-syn-1-0.0 Request processed in 329us (496us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1790945950.447607:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1790945950.447630:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1790945950.447666:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d3f83f3c380/2, rc 0, transno 4294967305 00000100:00100000:0.0:1790945950.447672:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83f3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638611712:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1790945950.447806:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+22:11375:x1877942616522112:12345-192.168.204.20@tcp:44:lhsmtool_posix.0 Request processed in 15226us (15463us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945950.447814:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 136 00010000:00010000:3.0:1790945950.448561:0:10339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790945950.448577:0:10339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000254e0b93/0xd9f4181e0d27da8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.448587:0:10339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe1800 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:3.0:1790945950.448592:0:10339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000254e0b93/0xd9f4181e0d27da8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.448602:0:10339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000254e0b93/0xd9f4181e0d27da8a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.448621:0:10339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000254e0b93/0xd9f4181e0d27da8a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.448629:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000254e0b93/0xd9f4181e0d27da8a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.448651:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945950.448653:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945950.448655:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945950.448661:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790945950.448699:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83ec3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638611840:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1790945950.448737:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945950.448786:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638611840 00000100:00100000:3.0:1790945950.448792:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638611840 00000100:00100000:3.0:1790945950.448835:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790945950.448994:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ec1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1877942638611840:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1790945950.449013:0:8437:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:3.0:1790945950.449034:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055df2cbd/0xd9f4181e0d27da91 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.449049:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009e978c91/0xd9f4181e0d27d83e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c08 expref: 11 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.449057:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1790945950.449061:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790945950.449065:0:8437:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055df2cbd/0xd9f4181e0d27da91 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.449089:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009e978c91/0xd9f4181e0d27d83e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c08 expref: 11 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.449101:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009e978c91/0xd9f4181e0d27d83e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c08 expref: 11 pid: 8916 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945950.449112:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83ec1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1877942638612096:192.168.204.20@tcp:104: 00000100:00100000:3.0:1790945950.449161:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408704f840 going to sleep for 11 seconds 00000100:00080000:3.0:1790945950.449215:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790945950.450449:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790945950.450467:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83ec3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638611968:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1790945950.450580:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945950.452693:0:10099:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638611968 00000100:00100000:3.0:1790945950.452706:0:10099:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638611968 00000100:00100000:3.0:1790945950.452770:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790945950.452791:0:10099:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3648:x1877942638611968:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1790945950.453092:0:10099:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1790945950.453096:0:10099:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1790945950 00002000:00010000:3.0:1790945950.453098:0:10099:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1790945950.453115:0:10099:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1790945950 -> 1790945950 00002000:00010000:3.0:1790945950.453117:0:10099:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1790945950.453207:0:10099:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3648:x1877942638611968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 428us (2626us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1790945950.453216:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:3.0:1790945950.453265:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d3f83ec3480/2, rc 0, transno 4294967310 00000100:00100000:3.0:1790945950.453272:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83ec3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638611968:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1790945950.459836:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945950.460030:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945950.460060:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616522368 00000100:00100000:0.0:1790945950.460069:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616522368 00010000:00010000:0.0:1790945950.460107:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009e978c91/0xd9f4181e0d27d83e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c08 expref: 12 pid: 8916 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945950.460143:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 75 00000100:00100000:0.0:1790945950.460153:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+12:2404:x1877942616522368:12345-192.168.204.20@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790945950.460264:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616522240 00000100:00100000:2.0:1790945950.460270:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616522240 00000100:00100000:2.0:1790945950.460312:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 51 00000100:00100000:2.0:1790945950.460320:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4f2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+13:2404:x1877942616522240:12345-192.168.204.20@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1790945950.461367:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83ec1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1877942638612096:192.168.204.20@tcp:104: 00010000:00010000:3.0:1790945950.461399:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000055df2cbd/0xd9f4181e0d27da91 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.461716:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945950.461723:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009e978c91/0xd9f4181e0d27d83e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c08 expref: 13 pid: 8916 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.461738:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009e978c91/0xd9f4181e0d27d83e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c08 expref: 13 pid: 8916 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.461764:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e978c91/0xd9f4181e0d27d83e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c08 expref: 13 pid: 8916 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.463764:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790945950.463769:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790945950.463777:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000055df2cbd/0xd9f4181e0d27da91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.463788:0:6506:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055df2cbd/0xd9f4181e0d27da91 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.464916:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27d788 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.464929:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27d788 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.464937:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27d788 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.464943:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe1200 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:1.0:1790945950.464948:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27d788 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.464956:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27d788 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.464984:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d3f83dbad00) 00010000:00010000:1.0:1790945950.464986:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945950.464992:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27d788 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.464998:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27d788 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.465027:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afce00/0xd9f4181e0d27d830 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.465033:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afce00/0xd9f4181e0d27d830 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.465039:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afce00/0xd9f4181e0d27d830 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.465044:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afce00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:1.0:1790945950.465047:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afce00/0xd9f4181e0d27d830 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.465053:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afce00/0xd9f4181e0d27d830 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.465061:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d40bc937e00) 00010000:00010000:1.0:1790945950.465064:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945950.465068:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afce00/0xd9f4181e0d27d830 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.465074:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afce00/0xd9f4181e0d27d830 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.465098:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d8ae lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.465105:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d8ae lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.465110:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d8ae lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.465115:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0000 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:1.0:1790945950.465118:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d8ae lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.465124:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d8ae lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.465131:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d40bc937a00) 00010000:00010000:1.0:1790945950.465134:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945950.465137:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d8ae lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.465142:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27d8ae lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.465151:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afcc00/0xd9f4181e0d27d8d1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.465157:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afcc00/0xd9f4181e0d27d8d1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.465163:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afcc00/0xd9f4181e0d27d8d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.465197:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afcc00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:1.0:1790945950.465201:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afcc00/0xd9f4181e0d27d8d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.465207:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afcc00/0xd9f4181e0d27d8d1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.465215:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d40bc937a00) 00010000:00010000:1.0:1790945950.465218:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945950.465221:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afcc00/0xd9f4181e0d27d8d1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.465227:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afcc00/0xd9f4181e0d27d8d1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.465242:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d9a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.465249:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d9a3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.465255:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d9a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.465260:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40813fe800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:1.0:1790945950.465263:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d9a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.465268:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d9a3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.465287:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d40bc937800) 00010000:00010000:1.0:1790945950.465290:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945950.465293:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d9a3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.465298:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27d9a3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.465309:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27da60 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.465315:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27da60 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.465320:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27da60 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.465325:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afde00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:1.0:1790945950.465327:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27da60 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.465333:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27da60 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.465340:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d40bc937500) 00010000:00010000:1.0:1790945950.465342:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790945950.465345:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27da60 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.465351:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27da60 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.465960:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945950.466051:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+12:2404:x1877942616522368:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 5894us (6015us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945950.466063:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 75 00010000:00010000:3.0:1790945950.466477:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000055df2cbd/0xd9f4181e0d27da91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.466489:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055df2cbd/0xd9f4181e0d27da91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.466499:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055df2cbd/0xd9f4181e0d27da91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.466506:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055df2cbd/0xd9f4181e0d27da91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.466522:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790945950.467955:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790945950.467966:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055df2cbd/0xd9f4181e0d27da91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.467978:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080031800 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790945950.467983:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055df2cbd/0xd9f4181e0d27da91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.468017:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055df2cbd/0xd9f4181e0d27da91 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.468037:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055df2cbd/0xd9f4181e0d27da91 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.468044:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055df2cbd/0xd9f4181e0d27da91 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.468070:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945950.468072:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945950.468074:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945950.469423:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ec1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3649:x1877942638611840:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20428us (20681us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1790945950.469434:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:2.0:1790945950.469655:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d3f83ec3b80/2, rc 0, transno 4294967311 00000100:00100000:2.0:1790945950.469663:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83ec3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638611840:0@lo:6:osp-syn-0-0.0 00000001:00080000:1.0:1790945950.476249:0:8429:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:1.0:1790945950.476261:0:8429:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:2.0:1790945950.476464:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4f2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2404:x1877942616522240:12345-192.168.204.20@tcp:16:lhsmtool_posix.0 Request processed in 16139us (16634us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945950.476477:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 51 00000100:00100000:0.0:1790945950.489547:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945950.492680:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616522624 00000100:00100000:3.0:1790945950.492708:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616522624 00000100:00100000:3.0:1790945950.492861:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 137 00000100:00100000:3.0:1790945950.492875:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+16:11375:x1877942616522624:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790945950.492968:0:13005:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945950.493004:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27da75 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ca2 expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.493657:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d40bc937500) 00010000:00010000:3.0:1790945950.493664:0:13005:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790945950.494104:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27da98 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.494134:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27da98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.494149:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27da98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790945950.494330:0:13005:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000cc79bd08 reply state 00000000c6a47bdf transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27da98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.494357:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27da98 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.494365:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d40bc937500) 00010000:00010000:2.0:1790945950.494368:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790945950.494373:0:13005:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790945950.494511:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+17:11375:x1877942616522624:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 1636us (4969us total) trans 4294967403 rc 0/0 00000100:00100000:2.0:1790945950.494521:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 137 00000100:00100000:0.0:1790945950.516371:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945950.519042:0:10099:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616522752 00000100:00100000:3.0:1790945950.519059:0:10099:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616522752 00000100:00100000:3.0:1790945950.519146:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 52 00000100:00100000:3.0:1790945950.519157:0:10099:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2404:x1877942616522752:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1790945950.519351:0:10099:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1790945950.519355:0:10099:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1790945950 -> 1790945949 00002000:00010000:3.0:1790945950.519358:0:10099:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1790945949 00002000:00010000:3.0:1790945950.519360:0:10099:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1790945950 -> 1790945949 00002000:00010000:3.0:1790945950.519362:0:10099:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1790945950.519499:0:10099:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:2404:x1877942616522752:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 Request processed in 343us (3136us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1790945950.519508:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 52 00000100:00100000:0.0:1790945950.536397:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945950.536505:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616523008 00000100:00100000:3.0:1790945950.536515:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616523008 00000100:00100000:3.0:1790945950.536578:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 138 00000100:00100000:3.0:1790945950.536589:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+17:11375:x1877942616523008:12345-192.168.204.20@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1790945950.536658:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27da9f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.536695:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27da59 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c94 expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.536705:0:6522:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27da9f lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.536740:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27da59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c94 expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.536754:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27da59 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c94 expref: 17 pid: 6522 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945950.536767:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83ec1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1877942638612224:192.168.204.20@tcp:104: 00000100:00100000:3.0:1790945950.537122:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408704f840 going to sleep for 11 seconds 00000100:00100000:2.0:1790945950.551323:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945950.551454:0:7471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616523136 00000100:00100000:1.0:1790945950.551464:0:7471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616523136 00010000:00010000:1.0:1790945950.551517:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27da59 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c94 expref: 18 pid: 6522 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945950.551564:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 76 00000100:00100000:1.0:1790945950.551575:0:7471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+18:2404:x1877942616523136:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790945950.551591:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945950.551598:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27da59 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c94 expref: 18 pid: 6522 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.551612:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27da59 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c94 expref: 18 pid: 6522 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.551633:0:7471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d40bc937500) 00010000:00010000:1.0:1790945950.551639:0:7471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27da9f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.551649:0:7471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27da9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.551657:0:7471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27da9f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.551677:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945950.551748:0:7471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+18:2404:x1877942616523136:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 175us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945950.551771:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 76 00010000:00010000:3.0:1790945950.552604:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27da59 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c94 expref: 17 pid: 6522 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945950.552624:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83ec1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1877942638612224:192.168.204.20@tcp:104: 00010000:00010000:3.0:1790945950.552646:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27da9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.552654:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27da9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.552660:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27da9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.552695:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27da9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.552710:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27da9f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.552717:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27da9f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.552722:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080031800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945950.552726:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27da9f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.552733:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27da9f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.552743:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d40bc937500) 00010000:00010000:3.0:1790945950.552746:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1790945950.552750:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27da9f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.552755:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27da9f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945950.552882:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+16:11375:x1877942616523008:12345-192.168.204.20@tcp:55:lhsmtool_posix.0 Request processed in 16294us (16494us total) trans 0 rc -22/-22 00000100:00100000:3.0:1790945950.552891:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 138 00000100:00100000:0.0:1790945950.559471:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83ec1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638612352:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790945950.559556:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945950.559667:0:11925:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638612352 00000100:00100000:3.0:1790945950.559675:0:11925:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638612352 00000100:00100000:3.0:1790945950.559753:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1790945950.559763:0:11925:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638612352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790945950.559785:0:11925:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:3.0:1790945950.559864:0:11925:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638612352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945950.559872:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:0.0:1790945950.559938:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790945950.559990:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83ec1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638612352:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790945950.561116:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83f3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638612480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790945950.561154:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945950.561244:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638612480 00000100:00100000:1.0:1790945950.561250:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638612480 00000100:00100000:1.0:1790945950.561281:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1790945950.561290:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1877942638612480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790945950.561303:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:1.0:1790945950.562453:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1877942638612480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1162us (1295us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945950.562463:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1790945950.562577:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1790945950.562583:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:2.0:1790945950.562602:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d3f83ec3480, transno 4294967310 00000100:00100000:2.0:1790945950.562660:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9d3f83ec3b80 x1877942638611840/t4294967311(4294967311) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1790945966 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945950.562678:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83f3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638612480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790945950.569150:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945950.569343:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616523264 00000100:00100000:3.0:1790945950.569355:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616523264 00000100:00100000:3.0:1790945950.569472:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 53 00000100:00100000:3.0:1790945950.569493:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:2403:x1877942616523264:12345-192.168.204.20@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1790945950.569919:0:8916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000055df2cbd/0xd9f4181e0d27daa6 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.569941:0:8916:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e6f1c9eb/0xd9f4181e0d27da83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cb0 expref: 7 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.569950:0:8916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945950.569954:0:8916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790945950.569959:0:8916:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055df2cbd/0xd9f4181e0d27daa6 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.569993:0:8916:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e6f1c9eb/0xd9f4181e0d27da83 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cb0 expref: 7 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.570008:0:8916:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e6f1c9eb/0xd9f4181e0d27da83 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cb0 expref: 7 pid: 10099 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945950.570023:0:8916:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83ec3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8916:1877942638612608:192.168.204.20@tcp:104: 00000100:00100000:3.0:1790945950.570119:0:8916:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408704f840 going to sleep for 11 seconds 00000100:00100000:3.0:1790945950.574013:0:8916:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83ec3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8916:1877942638612608:192.168.204.20@tcp:104: 00010000:00010000:3.0:1790945950.574054:0:8916:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000055df2cbd/0xd9f4181e0d27daa6 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945950.576464:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945950.576686:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616523392 00000100:00100000:3.0:1790945950.576695:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616523392 00010000:00010000:3.0:1790945950.576737:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e6f1c9eb/0xd9f4181e0d27da83 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cb0 expref: 8 pid: 10099 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945950.576781:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 77 00000100:00100000:3.0:1790945950.576791:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+8:2404:x1877942616523392:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790945950.576926:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945950.576951:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e6f1c9eb/0xd9f4181e0d27da83 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cb0 expref: 8 pid: 10099 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.576966:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e6f1c9eb/0xd9f4181e0d27da83 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cb0 expref: 8 pid: 10099 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.576990:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6f1c9eb/0xd9f4181e0d27da83 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cb0 expref: 8 pid: 10099 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.577006:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790945950.577010:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790945950.577015:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000055df2cbd/0xd9f4181e0d27daa6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.577025:0:6508:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055df2cbd/0xd9f4181e0d27daa6 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.577066:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945950.577712:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:2404:x1877942616523392:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 337us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945950.577722:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 77 00010000:00010000:1.0:1790945950.578662:0:8916:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000055df2cbd/0xd9f4181e0d27daa6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.578677:0:8916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055df2cbd/0xd9f4181e0d27daa6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.578702:0:8916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000055df2cbd/0xd9f4181e0d27daa6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.578710:0:8916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055df2cbd/0xd9f4181e0d27daa6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.578719:0:8916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055df2cbd/0xd9f4181e0d27daa6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.578727:0:8916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080031800 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:1.0:1790945950.578731:0:8916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055df2cbd/0xd9f4181e0d27daa6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.578752:0:8916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055df2cbd/0xd9f4181e0d27daa6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.578767:0:8916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055df2cbd/0xd9f4181e0d27daa6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.578776:0:8916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055df2cbd/0xd9f4181e0d27daa6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945950.580451:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2403:x1877942616523264:12345-192.168.204.20@tcp:1:lhsmtool_posix.0 Request processed in 10963us (11304us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945950.580463:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 53 00000100:00100000:2.0:1790945950.586001:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945950.586089:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616523648 00000100:00100000:0.0:1790945950.586100:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616523648 00000100:00100000:0.0:1790945950.586202:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 139 00000100:00100000:0.0:1790945950.586226:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+16:11375:x1877942616523648:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790945950.586303:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27daad lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.586320:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27d99c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c5c expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.586330:0:6521:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27daad lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.586364:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27d99c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c5c expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.586378:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27d99c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c5c expref: 16 pid: 6521 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945950.586392:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83f3f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1877942638612736:192.168.204.20@tcp:104: 00000100:00100000:0.0:1790945950.586491:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4084073840 going to sleep for 11 seconds 00000100:00100000:1.0:1790945950.590721:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83f3f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1877942638612736:192.168.204.20@tcp:104: 00010000:00010000:1.0:1790945950.590751:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27daad lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945950.592493:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945950.592616:0:7471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616523776 00000100:00100000:1.0:1790945950.592625:0:7471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616523776 00010000:00010000:1.0:1790945950.592659:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27d99c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c5c expref: 17 pid: 6521 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945950.592695:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 78 00000100:00100000:1.0:1790945950.592703:0:7471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+17:2403:x1877942616523776:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790945950.592717:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945950.592723:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27d99c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c5c expref: 17 pid: 6521 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.592748:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27d99c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c5c expref: 17 pid: 6521 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.592773:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27d99c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c5c expref: 17 pid: 6521 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.592789:0:7471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d40bc937800) 00010000:00010000:1.0:1790945950.592795:0:7471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d9fe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c7f expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.592814:0:7471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27daad lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.592822:0:7471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27daad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.592829:0:7471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27daad lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.592864:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945950.592916:0:7471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+16:2403:x1877942616523776:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 213us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945950.592923:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 78 00010000:00010000:0.0:1790945950.593418:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27daad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.593436:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27daad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.593622:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27dab4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.593634:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27da67 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c9b expref: 16 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.593653:0:6521:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27dab4 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.593679:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27da67 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c9b expref: 16 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.593691:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27da67 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c9b expref: 16 pid: 13005 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945950.593704:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83f3ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1877942638612864:192.168.204.20@tcp:104: 00000100:00100000:0.0:1790945950.593761:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4082f95840 going to sleep for 11 seconds 00000100:00100000:0.0:1790945950.604736:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83f3ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1877942638612864:192.168.204.20@tcp:104: 00010000:00010000:0.0:1790945950.604770:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27dab4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945950.607311:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945950.607406:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616523904 00000100:00100000:0.0:1790945950.607416:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616523904 00010000:00010000:0.0:1790945950.607466:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27da67 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c9b expref: 17 pid: 13005 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945950.607513:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 79 00000100:00100000:0.0:1790945950.607524:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ec3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+17:2404:x1877942616523904:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790945950.607539:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945950.607545:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27da67 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c9b expref: 17 pid: 13005 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.607576:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27da67 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c9b expref: 17 pid: 13005 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.607598:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27da67 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c9b expref: 17 pid: 13005 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.607616:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d40bc937500) 00010000:00010000:0.0:1790945950.607621:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27dab4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.607630:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27dab4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.607639:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27dab4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.607674:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945950.607741:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ec3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+16:2404:x1877942616523904:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 218us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945950.607748:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 79 00010000:00010000:1.0:1790945950.607832:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27dab4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.607850:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27dab4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790945950.607978:0:6521:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:1.0:1790945950.608115:0:6521:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:1.0:1790945950.608155:0:6521:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:1.0:1790945950.608286:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83f43480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1877942638612992:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1790945950.608392:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945950.608419:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f83588000 going to sleep for 11 seconds 00000100:00100000:0.0:1790945950.608662:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638612992 00000100:00100000:0.0:1790945950.608668:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638612992 00000100:00100000:0.0:1790945950.608713:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1790945950.608720:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6521:x1877942638612992:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790945950.608994:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83f43480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1877942638612992:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1790945950.609114:0:6521:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:2.0:1790945950.609157:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83f61500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1877942638613120:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790945950.615933:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945950.615990:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638613120 00000100:00100000:2.0:1790945950.616000:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638613120 00000100:00100000:2.0:1790945950.616052:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1790945950.616062:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6521:x1877942638613120:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790945950.616639:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6521:x1877942638613120:12345-0@lo:1000:mdt00_000.0 Request processed in 578us (711us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1790945950.616648:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1790945950.616678:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408fc76f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790945950.616707:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83f61500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1877942638613120:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1790945950.616757:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27dab4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.616768:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27dab4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.616976:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27dab4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.616983:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe1a00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945950.616987:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27dab4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.616995:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27dab4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.617011:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d40bc937500) 00010000:00010000:2.0:1790945950.617013:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790945950.617018:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27dab4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.617041:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27dab4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.617066:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27d9f7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.617072:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27d9f7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.617078:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27d9f7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.617082:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0a00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945950.617085:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27d9f7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.617091:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27d9f7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.617099:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d40bc937800) 00010000:00010000:2.0:1790945950.617102:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790945950.617110:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d9fe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c7f expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.617119:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d9fe lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c7f expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.617128:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d9fe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c7f expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945950.617319:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6521:x1877942638612992:12345-0@lo:1000:mdt00_000.0 Request processed in 8597us (8924us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945950.617327:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00010000:00010000:2.0:1790945950.618629:0:6521:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d9fe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c7f expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945950.618648:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83c35f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1877942638613248:192.168.204.20@tcp:105: 00000100:00100000:2.0:1790945950.618719:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4083509e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790945950.630638:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83c35f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1877942638613248:192.168.204.20@tcp:105: 00010000:00010000:1.0:1790945950.630668:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27d9f7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.630680:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27d9f7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.630711:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afcc00/0xd9f4181e0d27dabb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.630725:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afcc00/0xd9f4181e0d27dabb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.630737:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afcc00/0xd9f4181e0d27dabb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.630748:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afcc00/0xd9f4181e0d27dabb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.630755:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afcc00/0xd9f4181e0d27dabb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.630761:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afcc00/0xd9f4181e0d27dabb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.630785:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afcc00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:1.0:1790945950.630790:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afcc00/0xd9f4181e0d27dabb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.630798:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afcc00/0xd9f4181e0d27dabb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.630819:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d40bc937800) 00010000:00010000:1.0:1790945950.630822:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945950.630826:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afcc00/0xd9f4181e0d27dabb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.630831:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afcc00/0xd9f4181e0d27dabb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.630851:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27daad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.630857:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27daad lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.630862:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27daad lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.630867:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0600 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:1.0:1790945950.630870:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27daad lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.630875:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27daad lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.630892:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d40bc937800) 00010000:00010000:1.0:1790945950.630894:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790945950.630897:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27daad lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945950.630902:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27daad lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945950.631068:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+19:11375:x1877942616523648:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 44843us (45074us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1790945950.631078:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 139 00000020:00080000:1.0:1790945950.631084:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1790945950.631781:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790945950.631787:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790945950.632416:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1790945950.632425:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790945950.636353:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945950.636463:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616524160 00000100:00100000:0.0:1790945950.636475:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616524160 00000100:00100000:0.0:1790945950.636540:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 31 00000100:00100000:0.0:1790945950.636551:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ec1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+19:11375:x1877942616524160:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1790945950.636824:0:6525:0:(mdd_object.c:4180:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1790945950.636866:0:6525:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:0.0:1790945950.636897:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27dac2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.636913:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27dac2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.636924:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27dac2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.636932:0:6525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27dac2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.636938:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27dac2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.636957:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27dac2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.636979:0:6525:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790945950.637078:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ec1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+21:11375:x1877942616524160:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 Request processed in 529us (737us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1790945950.637085:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 31 00000020:00080000:0.0:1790945950.637090:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790945950.637472:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790945950.637480:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27dac2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.637487:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe1a00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:3.0:1790945950.637492:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27dac2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.637500:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27dac2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.637513:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d40bc937500) 00010000:00010000:3.0:1790945950.637516:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790945950.637520:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27dac2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.637525:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27dac2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.637538:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945950.637539:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945950.637541:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945950.665745:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945950.665867:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616524288 00000100:00100000:0.0:1790945950.665878:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616524288 00000100:00100000:0.0:1790945950.665992:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 32 00000100:00100000:0.0:1790945950.666003:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4096ddb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+21:11374:x1877942616524288:12345-192.168.204.20@tcp:49:lfs.0 00000100:00100000:0.0:1790945950.666143:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4096ddb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+21:11374:x1877942616524288:12345-192.168.204.20@tcp:49:lfs.0 Request processed in 142us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945950.666151:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 32 00000100:00100000:1.0:1790945950.684690:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945950.685640:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616524544 00000100:00100000:2.0:1790945950.685651:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616524544 00000100:00100000:2.0:1790945950.685714:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 140 00000100:00100000:2.0:1790945950.685724:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+21:11374:x1877942616524544:12345-192.168.204.20@tcp:58:lfs.0 00000040:00080000:2.0:1790945950.685895:0:13005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1790945950.685983:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+21:11374:x1877942616524544:12345-192.168.204.20@tcp:58:lfs.0 Request processed in 260us (1302us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945950.685991:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 140 00000100:00100000:3.0:1790945950.744680:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945950.747040:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616524672 00000100:00100000:0.0:1790945950.747056:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616524672 00000100:00100000:0.0:1790945950.747135:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 141 00000100:00100000:0.0:1790945950.747147:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ec2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+21:11377:x1877942616524672:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1790945950.747275:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945950.747297:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27dac9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330cb7 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.747364:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27dad0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.747379:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27dad0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.747390:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27dad0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.747404:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dad7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.747411:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dad7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.747417:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dad7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.747513:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27dade lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.747525:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d9e9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c78 expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.747533:0:6522:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27dade lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.747567:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d9e9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c78 expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945950.747580:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d9e9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c78 expref: 22 pid: 6523 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945950.747592:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83f3ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1877942638613376:192.168.204.20@tcp:104: 00000100:00100000:0.0:1790945950.748063:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d409c65ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790945950.762418:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945950.762517:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616524928 00000100:00100000:2.0:1790945950.762527:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616524928 00000100:00100000:2.0:1790945950.762592:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 33 00000100:00100000:2.0:1790945950.762603:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+23:6171:x1877942616524928:12345-192.168.204.20@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1790945950.762848:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+24:6171:x1877942616524928:12345-192.168.204.20@tcp:35:ldlm_bl.0 Request processed in 247us (441us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1790945950.762856:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 33 00000100:00100000:0.0:1790945950.763592:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83f3ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1877942638613376:192.168.204.20@tcp:104: 00010000:00010000:0.0:1790945950.763620:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27dade lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945950.769657:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945950.769984:0:7471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616525056 00000100:00100000:2.0:1790945950.770007:0:7471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616525056 00010000:00010000:2.0:1790945950.770048:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d9e9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c78 expref: 24 pid: 6523 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945950.770094:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 80 00000100:00100000:2.0:1790945950.770104:0:7471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f42d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+24:2404:x1877942616525056:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790945950.770120:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945950.770127:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d9e9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c78 expref: 24 pid: 6523 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.770141:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d9e9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c78 expref: 24 pid: 6523 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.770164:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27d9e9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c78 expref: 24 pid: 6523 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.770222:0:7471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d40bc937800) 00010000:00010000:2.0:1790945950.770228:0:7471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27dade lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.770238:0:7471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27dade lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.770245:0:7471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27dade lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945950.770416:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945950.770566:0:7471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f42d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+23:2404:x1877942616525056:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 463us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945950.770584:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 80 00010000:00010000:3.0:1790945950.771921:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27dade lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.771934:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27dade lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945950.771989:0:6522:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1790945950.771994:0:6522:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790945950.772014:0:6522:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27dade lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.772028:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27dade lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.772038:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27dad0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.772045:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27dad0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.772052:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27dad0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.772059:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe1400 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945950.772063:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27dad0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.772071:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27dad0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.772085:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d40bc9ad200) 00010000:00010000:3.0:1790945950.772088:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945950.772120:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27dad0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.772127:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27dad0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.772144:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dad7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.772150:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dad7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.772156:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dad7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.772162:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0e00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945950.772165:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dad7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.772226:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dad7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.772234:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d40bc937d00) 00010000:00010000:3.0:1790945950.772236:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945950.772239:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dad7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.772245:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dad7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.772297:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27dac9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cb7 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.772325:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27dade lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cb7 expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945950.772333:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d40bc937800) 00010000:00010000:3.0:1790945950.772335:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790945950.772337:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe1c00, rc 0) 00000100:00100000:3.0:1790945950.772380:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ec2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+22:11377:x1877942616524672:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 25236us (27718us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945950.772388:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 141 00010000:00010000:3.0:1790945951.199425:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790945951.647370:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790945951.647380:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790945951.647402:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1790945951.647409:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790945951.647553:0:13803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83c35f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13803:1877942638613504:192.168.204.20@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790945951.647673:0:13803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408fc76c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790945951.651650:0:13803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83c35f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13803:1877942638613504:192.168.204.20@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790945951.657753:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945951.657918:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616525184 00000100:00100000:2.0:1790945951.657930:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616525184 00000100:00100000:2.0:1790945951.658622:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 142 00000100:00100000:2.0:1790945951.658634:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+22:11388:x1877942616525184:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790945951.658668:0:6521:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790945951.658783:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+22:11388:x1877942616525184:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 Request processed in 152us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945951.658791:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 142 00000100:00100000:1.0:1790945951.663068:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945951.670827:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616525440 00000100:00100000:0.0:1790945951.670841:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616525440 00000100:00100000:0.0:1790945951.671004:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 143 00000100:00100000:0.0:1790945951.671078:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+22:11388:x1877942616525440:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790945951.671100:0:13005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945951.671125:0:13005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27dae5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330cbe expref: -99 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945951.671247:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27daec lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945951.671262:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27daec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945951.671272:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27daec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945951.671283:0:13005:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1790945951.671381:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27dae5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cbe expref: 25 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945951.671396:0:13005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27daec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cbe expref: 24 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945951.671405:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d40bc937800) 00010000:00010000:0.0:1790945951.671408:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790945951.671412:0:13005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe1800, rc 0) 00000100:00100000:0.0:1790945951.671471:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+24:11388:x1877942616525440:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 459us (8412us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1790945951.671479:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 143 00000100:00100000:1.0:1790945951.680012:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945951.680062:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945951.680461:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616525696 00000100:00100000:0.0:1790945951.680472:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616525696 00000100:00100000:0.0:1790945951.680522:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 144 00000100:00100000:0.0:1790945951.680531:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+24:11388:x1877942616525696:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790945951.680634:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27dafa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945951.680652:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27dafa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945951.680664:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27dafa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945951.680832:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27dafa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945951.680841:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27dafa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945951.680847:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27dafa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945951.680853:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0200 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945951.680858:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27dafa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945951.680866:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27dafa lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945951.680878:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d40bc937800) 00010000:00010000:0.0:1790945951.680881:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790945951.680886:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27dafa lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945951.680892:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27dafa lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945951.681022:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+25:11388:x1877942616525696:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 491us (1019us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1790945951.681030:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 144 00000040:00080000:0.0:1790945951.681130:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790945951.681135:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1790945951.681384:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616525824 00000100:00100000:2.0:1790945951.681390:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616525824 00000100:00100000:2.0:1790945951.681424:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:2.0:1790945951.681430:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4096cbd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+25:2404:x1877942616525824:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790945951.681441:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945951.681467:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27daec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cbe expref: 25 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945951.681479:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d40bc937800) 00010000:00010000:2.0:1790945951.681488:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945951.681510:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4096cbd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+24:2404:x1877942616525824:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 80us (1448us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945951.681517:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 9 00000040:00080000:0.0:1790945951.681659:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1790945951.681667:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790945951.685925:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945951.688535:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616526080 00000100:00100000:2.0:1790945951.688558:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616526080 00000100:00100000:2.0:1790945951.688610:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 34 00000100:00100000:2.0:1790945951.688618:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+24:11388:x1877942616526080:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790945951.688846:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+25:11388:x1877942616526080:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 Request processed in 227us (2930us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1790945951.688855:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 34 00000040:00080000:0.0:1790945951.899649:0:14315:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790945951.899659:0:14315:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790945951.899690:0:14315:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1790945951.899696:0:14315:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790945952.097570:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790945952.097591:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83ec0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638613632:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790945952.097654:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945952.098337:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638613632 00000100:00100000:3.0:1790945952.098345:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638613632 00000100:00100000:3.0:1790945952.098405:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1790945952.098414:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638613632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790945952.098446:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1790945952.098494:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638613632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945952.098501:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1790945952.098541:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83ec0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638613632:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790945952.102018:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945952.102881:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616526336 00000100:00100000:2.0:1790945952.102892:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616526336 00000100:00100000:2.0:1790945952.102956:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 145 00000100:00100000:2.0:1790945952.102964:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ec0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+25:11401:x1877942616526336:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1790945952.102988:0:13005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945952.103008:0:13005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27db01 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330cc5 expref: -99 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945952.103109:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d000/0xd9f4181e0d27db08 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945952.103123:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d000/0xd9f4181e0d27db08 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945952.103145:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d000/0xd9f4181e0d27db08 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945952.103156:0:13005:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1790945952.103262:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ce00/0xd9f4181e0d27db01 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cc5 expref: 28 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945952.103279:0:13005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d000/0xd9f4181e0d27db08 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cc5 expref: 27 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945952.103288:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d40bc937800) 00010000:00010000:2.0:1790945952.103291:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1790945952.103295:0:13005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f8363d000, rc 0) 00000100:00100000:2.0:1790945952.103350:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ec0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+27:11401:x1877942616526336:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 387us (1342us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1790945952.103357:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 145 00000100:00080000:3.0:1790945952.103437:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790945952.125718:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945952.125904:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616526464 00000100:00100000:3.0:1790945952.125914:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616526464 00000100:00100000:3.0:1790945952.125997:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 146 00000100:00100000:3.0:1790945952.126008:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+27:11401:x1877942616526464:12345-192.168.204.20@tcp:54:lfs.0 00010000:00010000:3.0:1790945952.126081:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27db16 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945952.126098:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27db16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945952.126110:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27db16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945952.126142:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27db16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945952.126149:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27db16 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945952.126157:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27db16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945952.126163:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080031800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945952.126210:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27db16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945952.126219:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27db16 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945952.126229:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d40bc937800) 00010000:00010000:3.0:1790945952.126232:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790945952.126236:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27db16 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945952.126243:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27db16 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945952.126313:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+27:11401:x1877942616526464:12345-192.168.204.20@tcp:54:lfs.0 Request processed in 307us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945952.126321:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 146 00010000:00010000:2.0:1790945952.223421:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945952.281155:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945952.282310:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616526592 00000100:00100000:2.0:1790945952.282322:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616526592 00000100:00100000:2.0:1790945952.282456:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 54 00000100:00100000:2.0:1790945952.282467:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2403:x1877942616526592:12345-192.168.204.20@tcp:101:cat.0 00010000:00010000:2.0:1790945952.282486:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945952.282507:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000089c8595/0xd9f4181e0d27db1d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330ccc expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790945952.282533:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6abfaa9d, atime: 0x6abfaa9d, ctime: 0x6abfaa9d, blocks: 0x8 00010000:00010000:2.0:1790945952.282553:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=403s v=(0 0) 00010000:00010000:2.0:1790945952.282569:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790945952.282578:0:8435:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000089c8595/0xd9f4181e0d27db1d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ccc expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945952.282599:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000089c8595/0xd9f4181e0d27db1d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ccc expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945952.282613:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f8363ce00, rc 0) 00000100:00100000:2.0:1790945952.282683:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:2403:x1877942616526592:12345-192.168.204.20@tcp:101:cat.0 Request processed in 211us (1530us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945952.282690:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 54 00000100:00080000:3.0:1790945952.291891:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790945952.292434:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945952.292620:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616526720 00000100:00100000:3.0:1790945952.292630:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616526720 00002000:00100000:3.0:1790945952.292694:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9d40bcbbca80 x1877942616526720/t0(0) o3->0cadc7a5-c0ba-4320-984f-d871ffb3a3ef@192.168.204.20@tcp:648/0 lens 488/0 e 0 to 0 dl 1790945963 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790945952.292705:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d40bcbbca80 with x1877942616526720 ext(0->4095) 00002000:00010000:3.0:1790945952.292710:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d40bcbbca80 00000100:00100000:3.0:1790945952.292960:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 3 00000100:00100000:3.0:1790945952.292972:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcbbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:2401:x1877942616526720:12345-192.168.204.20@tcp:3:cat.0 00000100:00100000:3.0:1790945952.293200:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcbbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:2401:x1877942616526720:12345-192.168.204.20@tcp:3:cat.0 Request processed in 230us (771us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1790945952.308466:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 3 00002000:00100000:3.0:1790945952.308492:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9d40bcbbca80 x1877942616526720/t0(0) o3->0cadc7a5-c0ba-4320-984f-d871ffb3a3ef@192.168.204.20@tcp:648/0 lens 488/4536 e 0 to 0 dl 1790945963 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790945952.308504:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d40bcbbca80 with x1877942616526720 ext(0->4095) 00002000:00010000:3.0:1790945952.308512:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d40bcbbca80 00000100:00100000:1.0:1790945952.344316:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945952.344360:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945952.344399:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945952.344431:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945952.344477:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616527360 00000100:00100000:1.0:1790945952.344488:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616527360 00000100:00100000:1.0:1790945952.344562:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616526976 00000100:00100000:1.0:1790945952.344566:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616526976 00000100:00100000:1.0:1790945952.344592:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 283 00000100:00100000:1.0:1790945952.344602:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2402:x1877942616527360:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945952.344691:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2402:x1877942616527360:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 74us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945952.344700:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 283 00000100:00100000:1.0:1790945952.344718:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 284 00000100:00100000:1.0:1790945952.344724:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2402:x1877942616526976:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945952.344760:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2402:x1877942616526976:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 37us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945952.344767:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 284 00000100:00100000:0.0:1790945952.344876:0:10099:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616527104 00000100:00100000:0.0:1790945952.344880:0:10099:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616527104 00000100:00100000:0.0:1790945952.344911:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 112 00000100:00100000:0.0:1790945952.344917:0:10099:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83647800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:2402:x1877942616527104:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790945952.344957:0:10099:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83647800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:2402:x1877942616527104:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 40us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945952.344963:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 112 00000100:00080000:0.0:1790945952.345006:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790945952.345010:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790945952.345035:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945952.345152:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616527232 00000100:00100000:0.0:1790945952.345156:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616527232 00000100:00100000:0.0:1790945952.345217:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 285 00000100:00100000:0.0:1790945952.345224:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2402:x1877942616527232:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790945952.345265:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2402:x1877942616527232:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 41us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945952.345272:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 285 00000100:00080000:0.0:1790945952.345290:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790945952.345985:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616526848 00000100:00100000:3.0:1790945952.345990:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616526848 00000100:00100000:3.0:1790945952.346056:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 381 00000100:00100000:3.0:1790945952.346064:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a71e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:2402:x1877942616526848:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790945952.346115:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a71e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:2402:x1877942616526848:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 51us (1808us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945952.346128:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 381 00000100:00100000:1.0:1790945952.608533:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83f63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638613760:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790945952.608613:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945952.610745:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638613760 00000100:00100000:2.0:1790945952.610758:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638613760 00000100:00100000:2.0:1790945952.610840:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1790945952.610850:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8301b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638613760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790945952.610886:0:6526:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790945952.611016:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8301b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638613760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 168us (2402us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945952.611024:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1790945952.611912:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83f63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638613760:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1790945953.255563:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945953.631943:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83ec1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638614016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790945953.632017:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945953.632097:0:11925:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638614016 00000100:00100000:3.0:1790945953.632105:0:11925:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638614016 00000100:00100000:3.0:1790945953.632192:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1790945953.632204:0:11925:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ec2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1877942638614016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790945953.632487:0:11925:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790945953.632537:0:11925:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ec2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1877942638614016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 335us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945953.632545:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:3.0:1790945953.632568:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790945953.632605:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83ec1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638614016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790945953.632699:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83f60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638613888:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790945953.632730:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945953.633199:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83f62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638614144:0@lo:400:kworker.0 00000100:00100000:0.0:1790945953.633249:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945953.633271:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638614656:0@lo:400:kworker.0 00000100:00100000:0.0:1790945953.633297:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945953.633311:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83cd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638615168:0@lo:400:kworker.0 00000100:00100000:0.0:1790945953.633332:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945953.633351:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1790945953.633357:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877942638614528:0@lo:400:kworker.0 00000100:00100000:0.0:1790945953.633448:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945953.633467:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638615040:0@lo:400:kworker.0 00000100:00100000:0.0:1790945953.633489:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945953.633519:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638614528 00000100:00100000:0.0:1790945953.633524:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638614528 00000100:00100000:0.0:1790945953.633559:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1790945953.633568:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877942638614528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945953.633608:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877942638614528:12345-0@lo:400:kworker.0 Request processed in 41us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945953.633614:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1790945953.633635:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638615168 00000100:00100000:0.0:1790945953.633664:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638615168 00000100:00100000:0.0:1790945953.633693:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638615040 00000100:00100000:0.0:1790945953.633696:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638615040 00000100:00100000:0.0:1790945953.633717:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1790945953.633723:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3650:x1877942638615168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945953.633766:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3650:x1877942638615168:12345-0@lo:400:kworker.0 Request processed in 43us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945953.633772:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1790945953.633794:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1790945953.633801:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638615040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945953.633828:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638615040:12345-0@lo:400:kworker.0 Request processed in 28us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945953.633833:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1790945953.633861:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83f63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638614272:0@lo:400:kworker.0 00000100:00100000:2.0:1790945953.634202:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638614144 00000100:00100000:2.0:1790945953.634208:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638614144 00000100:00100000:2.0:1790945953.634250:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1790945953.634256:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a71e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3650:x1877942638614144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945953.634324:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638613888 00000100:00100000:3.0:1790945953.634328:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638613888 00000100:00100000:3.0:1790945953.634356:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1790945953.634363:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638613888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790945953.634374:0:8438:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790945953.636852:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a71e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3650:x1877942638614144:12345-0@lo:400:kworker.0 Request processed in 2588us (3594us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945953.636866:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1790945953.637038:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638613888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2674us (4305us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945953.637049:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1790945953.637088:0:12418:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638614656 00000100:00100000:3.0:1790945953.637096:0:12418:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638614656 00000100:00100000:3.0:1790945953.637138:0:12418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1790945953.637146:0:12418:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638614656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945953.637216:0:12418:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638614656:12345-0@lo:400:kworker.0 Request processed in 71us (3918us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945953.637223:0:12418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1790945953.637482:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945953.637517:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1877942638614784:0@lo:400:kworker.0 00000100:00100000:0.0:1790945953.637546:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945953.637564:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d408723ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1877942638615296:0@lo:400:kworker.0 00000100:00100000:0.0:1790945953.637584:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945953.637607:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1790945953.637614:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83f42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638614400:0@lo:400:kworker.0 00000100:00100000:0.0:1790945953.637634:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945953.637789:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638614272 00000100:00100000:2.0:1790945953.637794:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638614272 00000100:00100000:2.0:1790945953.637822:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638614784 00000100:00100000:2.0:1790945953.637825:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638614784 00000100:00100000:2.0:1790945953.637844:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638615296 00000100:00100000:2.0:1790945953.637847:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638615296 00000100:00100000:2.0:1790945953.637863:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1790945953.637870:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638614272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945953.637916:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638614272:12345-0@lo:400:kworker.0 Request processed in 46us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945953.637922:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1790945953.637935:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1790945953.637940:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1877942638614784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945953.637983:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1877942638614784:12345-0@lo:400:kworker.0 Request processed in 43us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945953.637988:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1790945953.637998:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1790945953.638004:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1877942638615296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945953.638029:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1877942638615296:12345-0@lo:400:kworker.0 Request processed in 26us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945953.638035:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1790945953.638356:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1877942638614912:0@lo:400:kworker.0 00000100:00100000:0.0:1790945953.638380:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945953.638392:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4087238a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1877942638615424:0@lo:400:kworker.0 00000100:00100000:0.0:1790945953.638476:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945953.638504:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83f63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638614272:0@lo:400:kworker.0 00000100:00100000:0.0:1790945953.638514:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1877942638614784:0@lo:400:kworker.0 00000100:00100000:0.0:1790945953.638522:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d408723ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1877942638615296:0@lo:400:kworker.0 00000100:00100000:0.0:1790945953.638560:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638614912 00000100:00100000:0.0:1790945953.638563:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638614912 00000100:00100000:0.0:1790945953.638580:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638615424 00000100:00100000:0.0:1790945953.638583:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638615424 00000100:00100000:0.0:1790945953.638593:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1790945953.638599:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1877942638614912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945953.638630:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1877942638614912:12345-0@lo:400:kworker.0 Request processed in 31us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945953.638635:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1790945953.638710:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1790945953.638717:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1877942638615424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945953.638810:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1877942638615424:12345-0@lo:400:kworker.0 Request processed in 27us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945953.638817:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1790945953.638857:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83f60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638613888:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790945953.642514:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877942638614528:0@lo:400:kworker.0 00000100:00100000:0.0:1790945953.642534:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638615040:0@lo:400:kworker.0 00000100:00100000:0.0:1790945953.642546:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83f62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638614144:0@lo:400:kworker.0 00000100:00100000:0.0:1790945953.642556:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638614656:0@lo:400:kworker.0 00000100:00100000:0.0:1790945953.642587:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83cd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638615168:0@lo:400:kworker.0 00010000:00080000:0.0:1790945953.642638:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bff72d80 x1877942638614912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945953.642853:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1877942638614912:0@lo:400:kworker.0 00010000:00080000:0.0:1790945953.642869:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d4087238a80 x1877942638615424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945953.643076:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4087238a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1877942638615424:0@lo:400:kworker.0 00000100:00100000:3.0:1790945953.643337:0:12418:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638614400 00000100:00100000:3.0:1790945953.643345:0:12418:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638614400 00000100:00100000:3.0:1790945953.643381:0:12418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1790945953.643390:0:12418:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638614400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945953.643495:0:12418:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638614400:12345-0@lo:400:kworker.0 Request processed in 106us (5859us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945953.643502:0:12418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:3.0:1790945953.643534:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790945953.643539:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790945953.643542:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790945953.643545:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790945953.643566:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83f42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638614400:0@lo:400:kworker.0 00010000:00010000:1.0:1790945954.272971:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790945955.178674:0:9515:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:1.0:1790945955.178693:0:9515:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00010000:00010000:3.0:1790945955.296110:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945955.680488:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790945955.680513:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83ec1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638615552:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790945955.680592:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945955.682898:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638615680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790945955.682980:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945955.697261:0:11925:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638615552 00000100:00100000:3.0:1790945955.697281:0:11925:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638615552 00000100:00080000:1.0:1790945955.697463:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790945955.697501:0:11925:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638615680 00000100:00100000:3.0:1790945955.697505:0:11925:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638615680 00000100:00100000:3.0:1790945955.697550:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1790945955.697559:0:11925:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638615552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790945955.697593:0:11925:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00080000:1.0:1790945955.697692:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790945955.697912:0:11925:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638615552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 353us (17318us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945955.697921:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1790945955.697943:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1790945955.697957:0:11925:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4cee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1877942638615680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790945955.697971:0:11925:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1790945955.697998:0:11925:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4cee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1877942638615680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (15019us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945955.698002:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1790945955.698509:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638615680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790945955.698530:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83ec1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638615552:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1790945956.064405:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:2.0:1790945956.196256:0:6500:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:2.0:1790945956.196286:0:6500:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d408fc76540 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1790945956.196292:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d40af701900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d408fc76d80 00000020:00080000:2.0:1790945956.196295:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d40af701700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d3f83c06200 00000020:00080000:2.0:1790945956.196312:0:6500:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:0.0:1790945956.196398:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27da98 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945956.196411:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27da98 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945956.196419:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27da98 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945956.196425:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f8363da00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945956.196430:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27da98 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945956.196437:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27da98 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945956.196457:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d40bc937500) 00010000:00010000:0.0:1790945956.196466:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945956.196472:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27da98 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945956.196478:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27da98 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1790945956.196511:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1790945956.196585:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:1.0:1790945956.197088:0:8429:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:1.0:1790945956.197103:0:8429:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00010000:00010000:3.0:1790945956.320589:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790945956.836765:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790945956.836773:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790945956.836793:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1790945956.836800:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790945957.222590:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83ec0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638615808:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790945957.222777:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945957.226120:0:12418:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638615808 00000100:00100000:3.0:1790945957.226147:0:12418:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638615808 00000100:00100000:3.0:1790945957.226281:0:12418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1790945957.226294:0:12418:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638615808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790945957.226364:0:12418:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1790945957.226532:0:12418:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638615808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 240us (3754us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945957.226541:0:12418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1790945957.226622:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83ec0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638615808:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1790945957.346584:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945957.447025:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945957.447076:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945957.447113:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945957.447137:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945957.447156:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945957.447198:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945957.447237:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945957.447326:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616527488 00000100:00100000:1.0:1790945957.447338:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616527488 00000100:00100000:1.0:1790945957.447393:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 383 00000100:00100000:1.0:1790945957.447403:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a71e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:2401:x1877942616527488:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945957.447486:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a71e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:2401:x1877942616527488:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 84us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945957.447494:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 383 00000100:00100000:0.0:1790945957.453423:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616528000 00000100:00100000:0.0:1790945957.453442:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616528000 00000100:00100000:0.0:1790945957.453504:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616527872 00000100:00100000:0.0:1790945957.453508:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616527872 00000100:00100000:0.0:1790945957.453535:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 115 00000100:00100000:0.0:1790945957.453544:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2401:x1877942616528000:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790945957.453628:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2401:x1877942616528000:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 85us (6515us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945957.453650:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 115 00000100:00100000:0.0:1790945957.453668:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 116 00000100:00100000:0.0:1790945957.453675:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2401:x1877942616527872:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790945957.453714:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2401:x1877942616527872:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 27us (6503us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945957.453721:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 116 00000100:00080000:0.0:1790945957.456542:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790945957.456555:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790945957.458489:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616527744 00000100:00100000:3.0:1790945957.458504:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616527744 00000100:00100000:0.0:1790945957.458646:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616528256 00000100:00100000:0.0:1790945957.458652:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616528256 00000100:00100000:0.0:1790945957.458729:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616527616 00000100:00100000:0.0:1790945957.458734:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616527616 00000100:00100000:0.0:1790945957.458748:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616528128 00000100:00100000:0.0:1790945957.458750:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616528128 00000100:00100000:0.0:1790945957.458771:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 292 00000100:00100000:0.0:1790945957.458781:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2401:x1877942616528256:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790945957.458883:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2401:x1877942616528256:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 103us (11745us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945957.458891:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 292 00000100:00100000:0.0:1790945957.458910:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 293 00000100:00100000:0.0:1790945957.458916:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+13:2401:x1877942616527616:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790945957.458944:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+13:2401:x1877942616527616:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 29us (11789us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945957.458963:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 293 00000100:00100000:0.0:1790945957.458975:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 294 00000100:00100000:0.0:1790945957.458997:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2401:x1877942616528128:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790945957.459025:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2401:x1877942616528128:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 29us (11799us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945957.459031:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 294 00000100:00080000:0.0:1790945957.459049:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790945957.459052:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790945957.462941:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 295 00000100:00080000:1.0:1790945957.463094:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790945957.464607:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2401:x1877942616527744:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790945957.464698:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2401:x1877942616527744:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 117us (17621us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945957.464717:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 295 00000100:00100000:2.0:1790945957.729455:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d408723aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638615936:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790945957.729521:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945957.729713:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638615936 00000100:00100000:3.0:1790945957.729722:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638615936 00000100:00100000:3.0:1790945957.729775:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1790945957.729800:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408723a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638615936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790945957.729847:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790945957.729897:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408723a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638615936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945957.729904:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1790945957.729950:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d408723aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638615936:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790945957.928297:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945957.928662:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616528384 00000100:00100000:0.0:1790945957.928672:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616528384 00000100:00100000:0.0:1790945957.928741:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 147 00000100:00100000:0.0:1790945957.928751:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+13:11054:x1877942616528384:12345-192.168.204.20@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1790945957.928893:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+13:11054:x1877942616528384:12345-192.168.204.20@tcp:60:lhsmtool_posix.0 Request processed in 142us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945957.928901:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 147 00000100:00100000:0.0:1790945957.934486:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945957.943611:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616528512 00000100:00100000:3.0:1790945957.943628:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616528512 00000100:00100000:3.0:1790945957.943723:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 148 00000100:00100000:3.0:1790945957.943734:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:11054:x1877942616528512:12345-192.168.204.20@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1790945957.944267:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:11054:x1877942616528512:12345-192.168.204.20@tcp:60:lhsmtool_posix.0 Request processed in 532us (9788us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945957.944288:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 148 00000100:00100000:2.0:1790945957.963112:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945957.963269:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616528768 00000100:00100000:1.0:1790945957.963280:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616528768 00000100:00100000:1.0:1790945957.963345:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 35 00000100:00100000:1.0:1790945957.963365:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408723aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+13:11054:x1877942616528768:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790945957.963611:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408723aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+14:11054:x1877942616528768:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 Request processed in 257us (510us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1790945957.963619:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 35 00010000:00010000:3.0:1790945958.368491:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945958.751889:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83ec2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638616192:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790945958.751969:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945958.752189:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83eb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877942638616448:0@lo:400:kworker.0 00000100:00100000:0.0:1790945958.752224:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945958.752296:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83eb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1877942638616960:0@lo:400:kworker.0 00000100:00100000:0.0:1790945958.752317:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945958.752336:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83eb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1877942638617472:0@lo:400:kworker.0 00000100:00100000:0.0:1790945958.752368:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945958.752391:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1790945958.752397:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83f63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8841fcfb-fb47-4307-92c2-97500c1c82bd:3648:1877942638616320:0@lo:400:kworker.0 00000100:00100000:0.0:1790945958.752423:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945958.752445:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83eb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638616832:0@lo:400:kworker.0 00000100:00100000:0.0:1790945958.752473:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945958.752507:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83eb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638617344:0@lo:400:kworker.0 00000100:00100000:0.0:1790945958.752530:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945958.752547:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638617856:0@lo:400:kworker.0 00000100:00100000:0.0:1790945958.752566:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945958.752598:0:12418:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638616832 00000100:00100000:0.0:1790945958.752606:0:12418:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638616832 00000100:00100000:1.0:1790945958.752639:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83ec3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638616064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790945958.752686:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638617344 00000100:00100000:1.0:1790945958.752690:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638617344 00000100:00100000:1.0:1790945958.752726:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638617856 00000100:00100000:1.0:1790945958.752729:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638617856 00000100:00100000:1.0:1790945958.752750:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1790945958.752759:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638617344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945958.752990:0:12418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1790945958.752998:0:12418:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638616832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945958.758909:0:11925:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638616192 00000100:00100000:3.0:1790945958.758925:0:11925:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638616192 00000100:00100000:3.0:1790945958.759003:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1790945958.759301:0:11925:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087238a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638616192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790945958.759510:0:11925:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790945958.759751:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83eb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877942638616704:0@lo:400:kworker.0 00000100:00100000:2.0:1790945958.759800:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945958.759823:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83eb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638617216:0@lo:400:kworker.0 00000100:00100000:2.0:1790945958.759850:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945958.759870:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638617728:0@lo:400:kworker.0 00000100:00100000:1.0:1790945958.760012:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638617344:12345-0@lo:400:kworker.0 Request processed in 7252us (7479us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945958.760038:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1790945958.760072:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638617216 00000100:00100000:1.0:1790945958.760077:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638617216 00000100:00100000:1.0:1790945958.760638:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1790945958.760647:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638617856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945958.760714:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638617856:12345-0@lo:400:kworker.0 Request processed in 68us (8145us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945958.760720:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1790945958.760732:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1790945958.760738:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4083514700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638617216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945958.760765:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4083514700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638617216:12345-0@lo:400:kworker.0 Request processed in 28us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945958.760770:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:1.0:1790945958.761699:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790945958.761706:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790945958.761732:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945958.761787:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83eb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638616576:0@lo:400:kworker.0 00000100:00100000:1.0:1790945958.761828:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945958.761848:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83eb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1877942638617088:0@lo:400:kworker.0 00000100:00100000:1.0:1790945958.761880:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945958.761899:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83eb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1877942638617600:0@lo:400:kworker.0 00000100:00100000:1.0:1790945958.762755:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945958.763028:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638616448 00000100:00100000:1.0:1790945958.763037:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638616448 00000100:00100000:1.0:1790945958.763645:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638616960 00000100:00100000:1.0:1790945958.763651:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638616960 00000100:00100000:1.0:1790945958.763710:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638617472 00000100:00100000:1.0:1790945958.763714:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638617472 00000100:00100000:1.0:1790945958.763730:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638616704 00000100:00100000:1.0:1790945958.763733:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638616704 00000100:00100000:1.0:1790945958.763743:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638617088 00000100:00100000:1.0:1790945958.763746:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638617088 00000100:00100000:1.0:1790945958.763757:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638617600 00000100:00100000:1.0:1790945958.763760:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638617600 00000100:00100000:1.0:1790945958.763839:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1790945958.763850:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1877942638616448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945958.764637:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1877942638616448:12345-0@lo:400:kworker.0 Request processed in 787us (12410us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945958.764647:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1790945958.764687:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1790945958.764696:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1877942638616960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945958.764733:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1877942638616960:12345-0@lo:400:kworker.0 Request processed in 39us (12415us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945958.764738:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1790945958.764752:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1790945958.764758:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1877942638617472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945958.764861:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1877942638617472:12345-0@lo:400:kworker.0 Request processed in 103us (12491us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945958.764867:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1790945958.764891:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1790945958.764897:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408723ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877942638616704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945958.765414:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408723ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877942638616704:12345-0@lo:400:kworker.0 Request processed in 517us (5613us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945958.765439:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1790945958.765455:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1790945958.765462:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83deea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877942638617088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945958.766014:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83deea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877942638617088:12345-0@lo:400:kworker.0 Request processed in 550us (4140us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945958.766020:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1790945958.766035:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1790945958.766426:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877942638617600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945958.766473:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877942638617600:12345-0@lo:400:kworker.0 Request processed in 432us (3721us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945958.766480:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00080000:1.0:1790945958.766506:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790945958.766716:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790945958.766773:0:11925:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087238a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638616192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 7759us (14803us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945958.766783:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1790945958.766803:0:11925:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638616064 00000100:00100000:3.0:1790945958.766810:0:11925:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638616064 00000100:00100000:3.0:1790945958.766854:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1790945958.766872:0:11925:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40accd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638616064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790945958.766889:0:11925:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790945958.766921:0:11925:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40accd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638616064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (5190us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945958.766927:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1790945958.766950:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638616320 00000100:00100000:3.0:1790945958.766954:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638616320 00000100:00100000:3.0:1790945958.766983:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1790945958.766989:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087036850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3648:x1877942638616320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945958.767022:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087036850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3648:x1877942638616320:12345-0@lo:400:kworker.0 Request processed in 34us (14598us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945958.767028:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1790945958.767204:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638616576 00000100:00100000:3.0:1790945958.767209:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638616576 00000100:00100000:1.0:1790945958.767650:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1790945958.767657:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:1.0:1790945958.767694:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d3f83f3c380, transno 4294967305 00000100:00100000:1.0:1790945958.767720:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83ec3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638616064:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1790945958.767738:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f83eb0a80 x1877942638617088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945958.767763:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83eb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1877942638617088:0@lo:400:kworker.0 00010000:00080000:1.0:1790945958.767787:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f83eb2d80 x1877942638617600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945958.767797:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83eb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1877942638617600:0@lo:400:kworker.0 00000100:00100000:1.0:1790945958.768342:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83f63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8841fcfb-fb47-4307-92c2-97500c1c82bd:3648:1877942638616320:0@lo:400:kworker.0 00000100:00100000:1.0:1790945958.768371:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:1.0:1790945958.768374:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d3f83ec3b80, transno 4294967311 00000004:00080000:1.0:1790945958.768387:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:1.0:1790945958.768403:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83eb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638617344:0@lo:400:kworker.0 00000100:00100000:1.0:1790945958.768414:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638617856:0@lo:400:kworker.0 00000100:00100000:1.0:1790945958.768425:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83eb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877942638616448:0@lo:400:kworker.0 00000100:00100000:1.0:1790945958.768436:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83eb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1877942638616960:0@lo:400:kworker.0 00000100:00100000:1.0:1790945958.768448:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83eb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1877942638617472:0@lo:400:kworker.0 00000100:00100000:0.0:1790945958.768561:0:12418:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638616832:12345-0@lo:400:kworker.0 Request processed in 15562us (16084us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945958.769474:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83eb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638616832:0@lo:400:kworker.0 00000100:00100000:3.0:1790945958.769529:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1790945958.769545:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83deed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638616576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945958.769624:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83deed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638616576:12345-0@lo:400:kworker.0 Request processed in 87us (7794us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945958.770037:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83eb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638616576:0@lo:400:kworker.0 00000100:00100000:2.0:1790945958.770192:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945958.770255:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83ec2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638616192:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790945958.770282:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83eb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877942638616704:0@lo:400:kworker.0 00000100:00100000:2.0:1790945958.770293:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83eb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638617216:0@lo:400:kworker.0 00000100:00100000:2.0:1790945958.770318:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638617728 00000100:00100000:2.0:1790945958.770324:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638617728 00000100:00100000:2.0:1790945958.770375:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1790945958.770388:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4083515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638617728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945958.770433:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4083515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638617728:12345-0@lo:400:kworker.0 Request processed in 51us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945958.775163:0:12418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1790945958.775375:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1790945958.775446:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638617728:0@lo:400:kworker.0 00000100:00100000:3.0:1790945958.777960:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00010000:00010000:3.0:1790945959.394595:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945960.423084:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790945960.534850:0:14512:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 08:59:19 (1790945959) 00000100:00100000:0.0:1790945960.799924:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790945960.799948:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638617984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790945960.800019:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945960.800086:0:11925:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638617984 00000100:00100000:0.0:1790945960.800095:0:11925:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638617984 00000100:00100000:0.0:1790945960.800151:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1790945960.800161:0:11925:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638617984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790945960.800215:0:11925:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1790945960.800262:0:11925:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638617984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945960.800270:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1790945960.800316:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638617984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790945960.800434:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790945960.800443:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83fbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638618112:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790945960.800478:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945960.800505:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638618112 00000100:00100000:2.0:1790945960.800509:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638618112 00000100:00100000:2.0:1790945960.800535:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1790945960.800543:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83fbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638618112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790945960.800553:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1790945960.800584:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83fbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638618112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945960.800590:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1790945960.800631:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83fbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638618112:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1790945960.800806:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790945961.439656:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945962.234782:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945962.234936:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616529024 00000100:00100000:1.0:1790945962.234947:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616529024 00000100:00100000:1.0:1790945962.235042:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 149 00000100:00100000:1.0:1790945962.235054:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+14:12121:x1877942616529024:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790945962.235077:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945962.235097:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afce00/0xd9f4181e0d27db24 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330cd3 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945962.235213:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27db2b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945962.235230:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27db2b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945962.235284:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27db2b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945962.235349:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afcc00/0xd9f4181e0d27db32 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945962.235357:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afcc00/0xd9f4181e0d27db32 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945962.235364:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afcc00/0xd9f4181e0d27db32 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945962.235453:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afda00/0xd9f4181e0d27db39 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945962.235462:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afda00/0xd9f4181e0d27db39 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945962.235469:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afda00/0xd9f4181e0d27db39 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790945962.235478:0:6522:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1790945962.235571:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27db2b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945962.235579:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27db2b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945962.235586:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27db2b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945962.235591:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afde00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:1.0:1790945962.235601:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27db2b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945962.235623:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27db2b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945962.235635:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d3f824ecd00) 00010000:00010000:1.0:1790945962.235638:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945962.235642:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27db2b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945962.235649:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27db2b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945962.235664:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afcc00/0xd9f4181e0d27db32 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945962.235670:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afcc00/0xd9f4181e0d27db32 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945962.235676:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afcc00/0xd9f4181e0d27db32 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945962.235681:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afcc00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:1.0:1790945962.235684:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afcc00/0xd9f4181e0d27db32 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945962.235690:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afcc00/0xd9f4181e0d27db32 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945962.235697:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9d40928bd100) 00010000:00010000:1.0:1790945962.235699:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945962.235708:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afcc00/0xd9f4181e0d27db32 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945962.235714:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afcc00/0xd9f4181e0d27db32 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945962.235976:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afce00/0xd9f4181e0d27db24 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cd3 expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945962.235991:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afda00/0xd9f4181e0d27db39 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cd3 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945962.235998:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3f824ec400) 00010000:00010000:1.0:1790945962.236000:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945962.236002:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4092afda00, rc 0) 00000100:00100000:1.0:1790945962.236066:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+16:12121:x1877942616529024:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 1014us (1293us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1790945962.236074:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 149 00000100:00080000:2.0:1790945962.236500:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790945962.253276:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945962.253313:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945962.253497:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616529280 00000100:00100000:3.0:1790945962.253508:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616529280 00000100:00100000:3.0:1790945962.253579:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 150 00000100:00100000:3.0:1790945962.253589:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83fbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+16:12121:x1877942616529280:12345-192.168.204.20@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1790945962.253738:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83fbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+16:12121:x1877942616529280:12345-192.168.204.20@tcp:59:lhsmtool_posix.0 Request processed in 150us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945962.253747:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 150 00000100:00100000:0.0:1790945962.254161:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616529152 00000100:00100000:0.0:1790945962.254196:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616529152 00000100:00100000:0.0:1790945962.254241:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:0.0:1790945962.254260:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83fbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+16:2402:x1877942616529152:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790945962.254280:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945962.254305:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afda00/0xd9f4181e0d27db39 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cd3 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945962.254324:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3f824ec400) 00010000:00010000:0.0:1790945962.254330:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945962.254359:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83fbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+15:2402:x1877942616529152:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 101us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945962.254365:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:2.0:1790945962.257216:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945962.259536:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616529408 00000100:00100000:1.0:1790945962.259551:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616529408 00000100:00100000:1.0:1790945962.259651:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 151 00000100:00100000:1.0:1790945962.259662:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83fbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:12121:x1877942616529408:12345-192.168.204.20@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1790945962.259764:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83fbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:12121:x1877942616529408:12345-192.168.204.20@tcp:59:lhsmtool_posix.0 Request processed in 105us (2555us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945962.259772:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 151 00000100:00080000:2.0:1790945962.260765:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00080000:0.0:1790945962.261449:0:6500:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000020:00080000:0.0:1790945962.261466:0:6500:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1790945962.265639:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1790945962.265657:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1790945962.337816:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790945962.337838:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83f6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638618240:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790945962.337903:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945962.338007:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638618240 00000100:00100000:0.0:1790945962.338015:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638618240 00000100:00100000:0.0:1790945962.338068:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1790945962.338077:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ec2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638618240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790945962.338111:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1790945962.338183:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ec2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638618240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945962.338191:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1790945962.338385:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83f6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638618240:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1790945962.463409:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945962.562503:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945962.564138:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616529536 00000100:00100000:1.0:1790945962.564151:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616529536 00000100:00100000:1.0:1790945962.564224:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 385 00000100:00100000:1.0:1790945962.564234:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087035050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:2403:x1877942616529536:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945962.564321:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087035050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:2403:x1877942616529536:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 89us (1827us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945962.564329:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 385 00000100:00100000:3.0:1790945962.567225:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945962.567265:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945962.567285:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945962.567304:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945962.567327:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616530048 00000100:00100000:3.0:1790945962.567337:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616530048 00000100:00100000:3.0:1790945962.567386:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616529920 00000100:00100000:3.0:1790945962.567389:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616529920 00000100:00100000:3.0:1790945962.567408:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 302 00000100:00100000:3.0:1790945962.567417:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ec3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2403:x1877942616530048:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790945962.567482:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ec3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2403:x1877942616530048:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 66us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945962.567489:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 302 00000100:00100000:3.0:1790945962.567505:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 303 00000100:00100000:3.0:1790945962.567511:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ec1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2403:x1877942616529920:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790945962.567532:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ec1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2403:x1877942616529920:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 21us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945962.567537:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 303 00000100:00100000:1.0:1790945962.567923:0:10099:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616529792 00000100:00100000:1.0:1790945962.567929:0:10099:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616529792 00000100:00100000:1.0:1790945962.567962:0:10099:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616529664 00000100:00100000:1.0:1790945962.567964:0:10099:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616529664 00000100:00100000:1.0:1790945962.567985:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 121 00000100:00100000:1.0:1790945962.567991:0:10099:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ec0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2403:x1877942616529792:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945962.568028:0:10099:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ec0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2403:x1877942616529792:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 37us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945962.568034:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 121 00000100:00100000:1.0:1790945962.568047:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 122 00000100:00100000:1.0:1790945962.568053:0:10099:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ec0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2403:x1877942616529664:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945962.568075:0:10099:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ec0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2403:x1877942616529664:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 23us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945962.568081:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 122 00000100:00080000:2.0:1790945962.568280:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790945962.568284:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790945962.568287:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790945962.568289:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790945962.851861:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638618368:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790945962.851933:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945962.852213:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638618368 00000100:00100000:3.0:1790945962.852223:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638618368 00000100:00100000:3.0:1790945962.852277:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1790945962.852287:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83fbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638618368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790945962.852322:0:6526:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790945962.852419:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83fbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638618368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 132us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945962.852420:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638618368:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790945962.852434:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000040:00080000:1.0:1790945962.983552:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790945962.983562:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790945962.984061:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1790945962.984071:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1790945963.234931:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790945963.487300:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945963.872591:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83ec2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638618496:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790945963.872662:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945963.872729:0:11925:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638618496 00000100:00100000:1.0:1790945963.872736:0:11925:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638618496 00000100:00100000:1.0:1790945963.872784:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1790945963.872805:0:11925:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638618496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790945963.873191:0:11925:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790945963.873239:0:11925:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638618496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 436us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945963.873246:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:1.0:1790945963.873267:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790945963.873299:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83ec2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638618496:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790945963.874986:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877942638618752:0@lo:400:kworker.0 00000100:00100000:1.0:1790945963.875041:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945963.875065:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83eb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1877942638619264:0@lo:400:kworker.0 00000100:00100000:1.0:1790945963.875081:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945963.875093:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83eb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1877942638619776:0@lo:400:kworker.0 00000100:00100000:1.0:1790945963.875110:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945963.875126:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1790945963.875130:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638618624:0@lo:400:kworker.0 00000100:00100000:1.0:1790945963.875151:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945963.875192:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83eb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638619136:0@lo:400:kworker.0 00000100:00100000:1.0:1790945963.875213:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945963.875230:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83eb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638619648:0@lo:400:kworker.0 00000100:00100000:1.0:1790945963.875264:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945963.875301:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638618752 00000100:00100000:1.0:1790945963.875308:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638618752 00000100:00100000:1.0:1790945963.875352:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638619264 00000100:00100000:1.0:1790945963.875356:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638619264 00000100:00100000:1.0:1790945963.875383:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638619776 00000100:00100000:1.0:1790945963.875385:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638619776 00000100:00100000:0.0:1790945963.875652:0:12418:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638619136 00000100:00100000:0.0:1790945963.875657:0:12418:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638619136 00000100:00100000:0.0:1790945963.875686:0:12418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1790945963.875699:0:12418:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638619136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945963.875750:0:12418:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638619136:12345-0@lo:400:kworker.0 Request processed in 51us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945963.875756:0:12418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1790945963.876085:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83f63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638618880:0@lo:400:kworker.0 00000100:00100000:2.0:1790945963.876116:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945963.876139:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83eb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1877942638619392:0@lo:400:kworker.0 00000100:00100000:2.0:1790945963.876159:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945963.876211:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83eb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1877942638619904:0@lo:400:kworker.0 00000100:00100000:2.0:1790945963.876234:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945963.876248:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1790945963.876254:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83f61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1877942638619008:0@lo:400:kworker.0 00000100:00100000:2.0:1790945963.876271:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945963.876279:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83eb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638619520:0@lo:400:kworker.0 00000100:00100000:2.0:1790945963.876296:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945963.876313:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83eb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638620032:0@lo:400:kworker.0 00000100:00100000:2.0:1790945963.876329:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945963.877299:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638619648 00000100:00100000:2.0:1790945963.877309:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638619648 00000100:00100000:0.0:1790945963.877366:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638618624 00000100:00100000:0.0:1790945963.877370:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638618624 00000100:00100000:0.0:1790945963.877423:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1790945963.877432:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087037850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3650:x1877942638618624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945963.877488:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087037850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3650:x1877942638618624:12345-0@lo:400:kworker.0 Request processed in 56us (2334us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945963.877494:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1790945963.877543:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638619392 00000100:00100000:0.0:1790945963.877547:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638619392 00000100:00100000:0.0:1790945963.877566:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638619904 00000100:00100000:0.0:1790945963.877569:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638619904 00000100:00100000:0.0:1790945963.877602:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638619008 00000100:00100000:0.0:1790945963.877605:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638619008 00000100:00100000:0.0:1790945963.877618:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1790945963.877624:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83eb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877942638618752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945963.877657:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83eb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877942638618752:12345-0@lo:400:kworker.0 Request processed in 33us (2616us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945963.877664:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1790945963.877676:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1790945963.877681:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877942638619264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945963.877707:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877942638619264:12345-0@lo:400:kworker.0 Request processed in 25us (2624us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945963.877712:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1790945963.877732:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1790945963.877737:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877942638619776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945963.877761:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877942638619776:12345-0@lo:400:kworker.0 Request processed in 24us (2650us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945963.877766:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1790945963.877774:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1790945963.877779:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83fbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1877942638619392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945963.877806:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83fbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1877942638619392:12345-0@lo:400:kworker.0 Request processed in 27us (1646us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945963.877812:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1790945963.877834:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1790945963.877839:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83fbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1877942638619904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945963.877878:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83fbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1877942638619904:12345-0@lo:400:kworker.0 Request processed in 39us (1642us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945963.877884:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1790945963.877894:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1790945963.877899:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1877942638619008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945963.877921:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1877942638619008:12345-0@lo:400:kworker.0 Request processed in 23us (1649us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945963.877926:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1790945963.877946:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638618880 00000100:00100000:0.0:1790945963.877948:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638618880 00000100:00100000:0.0:1790945963.877969:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1790945963.877974:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83fbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638618880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945963.878000:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83fbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638618880:12345-0@lo:400:kworker.0 Request processed in 26us (1883us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945963.878011:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1790945963.878029:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83fbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638620160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790945963.878055:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945963.878083:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638620160 00000100:00100000:0.0:1790945963.878086:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638620160 00000100:00100000:0.0:1790945963.878108:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1790945963.878113:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638620160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790945963.878127:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790945963.878157:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638620160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945963.878163:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1790945963.878214:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83fbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638620160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790945963.881270:0:10099:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638619520 00000100:00100000:3.0:1790945963.881285:0:10099:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638619520 00000100:00100000:2.0:1790945963.881959:0:8436:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638620032 00000100:00100000:2.0:1790945963.881966:0:8436:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638620032 00000100:00100000:1.0:1790945963.882021:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1790945963.882034:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84569180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638619648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945963.882120:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84569180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638619648:12345-0@lo:400:kworker.0 Request processed in 90us (6854us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945963.882128:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1790945963.882195:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1790945963.882269:0:10099:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83fbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638619520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945963.882305:0:10099:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83fbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638619520:12345-0@lo:400:kworker.0 Request processed in 104us (6007us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945963.882311:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1790945963.882351:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638618624:0@lo:400:kworker.0 00000100:00100000:3.0:1790945963.882364:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83eb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638619136:0@lo:400:kworker.0 00000100:00100000:3.0:1790945963.882374:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83eb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638619648:0@lo:400:kworker.0 00000100:00100000:3.0:1790945963.882385:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877942638618752:0@lo:400:kworker.0 00000100:00100000:3.0:1790945963.882395:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83eb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1877942638619264:0@lo:400:kworker.0 00000100:00100000:3.0:1790945963.882419:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83eb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1877942638619776:0@lo:400:kworker.0 00000100:00080000:3.0:1790945963.884042:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790945963.884053:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790945963.884055:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790945963.884065:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790945963.889799:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1790945963.889829:0:8436:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83fbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638620032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945963.889926:0:8436:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83fbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638620032:12345-0@lo:400:kworker.0 Request processed in 116us (13595us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945963.889933:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1790945963.889985:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83f61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1877942638619008:0@lo:400:kworker.0 00000100:00100000:2.0:1790945963.889999:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83eb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638619520:0@lo:400:kworker.0 00000100:00100000:2.0:1790945963.890009:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83eb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638620032:0@lo:400:kworker.0 00000100:00100000:2.0:1790945963.890019:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83f63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638618880:0@lo:400:kworker.0 00010000:00080000:2.0:1790945963.890032:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f83eb3b80 x1877942638619392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945979 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945963.890042:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83eb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1877942638619392:0@lo:400:kworker.0 00010000:00080000:2.0:1790945963.890064:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f83eb3800 x1877942638619904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945979 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945963.890071:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83eb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1877942638619904:0@lo:400:kworker.0 00000100:00100000:3.0:1790945964.048722:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945964.049704:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616530176 00000100:00100000:1.0:1790945964.049714:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616530176 00000100:00100000:1.0:1790945964.049780:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 152 00000100:00100000:1.0:1790945964.049791:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+13:12163:x1877942616530176:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:1.0:1790945964.049821:0:13005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945964.049841:0:13005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afdc00/0xd9f4181e0d27db47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330cda expref: -99 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.049908:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd200/0xd9f4181e0d27db4e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.049923:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd200/0xd9f4181e0d27db4e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.049933:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd200/0xd9f4181e0d27db4e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.049946:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27db55 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.049968:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27db55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.049975:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27db55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.050019:0:13005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd200/0xd9f4181e0d27db4e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.050027:0:13005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd200/0xd9f4181e0d27db4e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.050033:0:13005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd200/0xd9f4181e0d27db4e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.050039:0:13005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afd200 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:1.0:1790945964.050043:0:13005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd200/0xd9f4181e0d27db4e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.050050:0:13005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd200/0xd9f4181e0d27db4e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.050060:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3f824ef800) 00010000:00010000:1.0:1790945964.050063:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945964.050068:0:13005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd200/0xd9f4181e0d27db4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.050075:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd200/0xd9f4181e0d27db4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.050088:0:13005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27db55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.050100:0:13005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27db55 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.050106:0:13005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27db55 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.050111:0:13005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afca00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:1.0:1790945964.050114:0:13005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27db55 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.050121:0:13005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27db55 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.050130:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9d40928bd100) 00010000:00010000:1.0:1790945964.050133:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945964.050135:0:13005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27db55 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.050140:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27db55 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.050197:0:13005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afdc00/0xd9f4181e0d27db47 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cda expref: 14 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.050208:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3f824ef800) 00010000:00010000:1.0:1790945964.050223:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945964.050227:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afdc00/0xd9f4181e0d27db47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cda expref: 14 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.050248:0:13005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4092afdc00, rc 0) 00000100:00100000:1.0:1790945964.050315:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+13:12163:x1877942616530176:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 527us (1602us total) trans 0 rc 301/301 00000100:00100000:1.0:1790945964.050323:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 152 00000100:00080000:3.0:1790945964.051367:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790945964.064829:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945964.064904:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616530432 00000100:00100000:2.0:1790945964.064915:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616530432 00000100:00100000:2.0:1790945964.064976:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 153 00000100:00100000:2.0:1790945964.064986:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+13:12163:x1877942616530432:12345-192.168.204.20@tcp:36:lfs.0 00010000:00010000:2.0:1790945964.065045:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945964.065072:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c400/0xd9f4181e0d27d4a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b05 expref: 13 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.065090:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3f824ef800) 00010000:00010000:2.0:1790945964.065104:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790945964.065164:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27db5c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.065199:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27db5c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.065220:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27db5c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.065235:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27db63 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.065243:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27db63 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.065249:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27db63 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.068076:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27db6a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.068099:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27db6a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.068111:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27db6a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790945964.068128:0:6523:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005bd58e54 reply state 00000000e2fd79fc transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27db6a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.068138:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27db6a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.068145:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d3f824ef900) 00010000:00010000:2.0:1790945964.068148:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790945964.068152:0:6523:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1790945964.068158:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1790945964.072736:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27db5c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.072757:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27db5c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.072765:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27db5c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.072770:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f8363c000 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945964.072775:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27db5c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.072795:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27db5c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.072820:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3f824ef400) 00010000:00010000:2.0:1790945964.072823:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945964.072828:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27db5c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.072833:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27db5c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790945964.072854:0:6523:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005bd58e54 reply state 00000000e2fd79fc transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27db63 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.072865:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27db63 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.072871:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9d3f824efd00) 00010000:00010000:2.0:1790945964.072873:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790945964.072876:0:6523:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1790945964.073214:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+14:12163:x1877942616530432:12345-192.168.204.20@tcp:36:lfs.0 Request processed in 8224us (8401us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1790945964.073223:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 153 00000100:00100000:1.0:1790945964.198585:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945964.198657:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616530560 00000100:00100000:2.0:1790945964.198668:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616530560 00000100:00100000:2.0:1790945964.198730:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 154 00000100:00100000:2.0:1790945964.198740:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8456bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+14:12171:x1877942616530560:12345-192.168.204.20@tcp:101:lctl.0 00010000:00010000:2.0:1790945964.198765:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945964.198789:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27db71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330ce1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.198895:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c400/0xd9f4181e0d27db78 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.198910:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c400/0xd9f4181e0d27db78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.198923:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c400/0xd9f4181e0d27db78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945964.198969:0:6521:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790945964.198973:0:6521:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790945964.198993:0:6521:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c400/0xd9f4181e0d27db78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.199016:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27db71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ce1 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.199033:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c400/0xd9f4181e0d27db78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ce1 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.199041:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3f824ef400) 00010000:00010000:2.0:1790945964.199044:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790945964.199048:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f8363c400, rc 0) 00000100:00100000:2.0:1790945964.199106:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8456bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+15:12171:x1877942616530560:12345-192.168.204.20@tcp:101:lctl.0 Request processed in 368us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945964.199113:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 154 00000100:00100000:2.0:1790945964.260031:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945964.260225:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616530688 00000100:00100000:1.0:1790945964.260236:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616530688 00000100:00100000:3.0:1790945964.260416:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 155 00000100:00100000:3.0:1790945964.260430:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83fbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+15:12177:x1877942616530688:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:3.0:1790945964.260452:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945964.260469:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27db7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330ce8 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.260549:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27db86 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.260564:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27db86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.260589:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27db86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.260601:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27db8d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.260608:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27db8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.260614:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27db8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.260690:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27db94 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.260699:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27db94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.260721:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27db94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945964.260755:0:6522:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1790945964.260759:0:6522:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790945964.260777:0:6522:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27db94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.260788:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27db86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.260795:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27db86 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.260801:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27db86 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.260807:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080030a00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945964.260811:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27db86 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.260818:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27db86 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.260829:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3f824ef400) 00010000:00010000:3.0:1790945964.260832:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945964.260837:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27db86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.260843:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27db86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.260866:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27db8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.260872:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27db8d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.260877:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27db8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.260882:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080031400 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945964.260885:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27db8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.260890:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27db8d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.260898:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9d3f824efd00) 00010000:00010000:3.0:1790945964.260900:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945964.260903:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27db8d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.260908:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27db8d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.260935:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27db7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ce8 expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.260947:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27db94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ce8 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.260964:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d3f824ef900) 00010000:00010000:3.0:1790945964.260966:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1790945964.260969:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40813fe800, rc 0) 00000100:00100000:3.0:1790945964.261032:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83fbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+16:12177:x1877942616530688:12345-192.168.204.20@tcp:101:bash.0 Request processed in 606us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945964.261039:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 155 00000100:00100000:1.0:1790945964.269718:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945964.269832:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616530944 00000100:00100000:2.0:1790945964.269969:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616530944 00000100:00100000:2.0:1790945964.270032:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 156 00000100:00100000:2.0:1790945964.270042:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8456b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+16:12177:x1877942616530944:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:2.0:1790945964.270138:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945964.270160:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27db9b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330cef expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.270311:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27dba2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.270326:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27dba2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.270336:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27dba2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.270354:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27dba9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.270361:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27dba9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.270367:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27dba9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790945964.272500:0:6523:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:2.0:1790945964.272670:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27dbb0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.272685:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27dbb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.272711:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27dbb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.272744:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27dba2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.272752:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27dba2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.272758:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27dba2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.272765:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f8363da00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945964.272769:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27dba2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.272776:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27dba2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.272788:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d3f824ef900) 00010000:00010000:2.0:1790945964.272791:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945964.272795:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27dba2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.272802:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363da00/0xd9f4181e0d27dba2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790945964.272816:0:6523:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004e778409 reply state 00000000bf1268f4 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27dba9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.272826:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27dba9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.272838:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d3f824ef800) 00010000:00010000:2.0:1790945964.272841:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790945964.272844:0:6523:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790945964.272881:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c000/0xd9f4181e0d27db9b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cef expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.272896:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27dbb0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cef expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.272904:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d3f824ef500) 00010000:00010000:2.0:1790945964.272906:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790945964.272908:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f8363c600, rc 0) 00000100:00100000:2.0:1790945964.272993:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8456b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+19:12177:x1877942616530944:12345-192.168.204.20@tcp:101:bash.0 Request processed in 2952us (3423us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1790945964.273001:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 156 00000100:00100000:1.0:1790945964.277638:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945964.277734:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616531072 00000100:00100000:3.0:1790945964.277744:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616531072 00000100:00100000:3.0:1790945964.277835:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 55 00000100:00080000:1.0:1790945964.278556:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790945964.278629:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84569f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2403:x1877942616531072:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:3.0:1790945964.278649:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945964.278672:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a7d99fb/0xd9f4181e0d27dbbe lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330cf6 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790945964.278697:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790945964.278716:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=415s v=(0 0) 00010000:00010000:3.0:1790945964.278721:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945964.278730:0:8437:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a7d99fb/0xd9f4181e0d27dbbe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cf6 expref: 6 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.278747:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004a7d99fb/0xd9f4181e0d27dbbe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cf6 expref: 6 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.278759:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40813fea00, rc 0) 00000100:00100000:3.0:1790945964.278830:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84569f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2403:x1877942616531072:12345-192.168.204.20@tcp:101:bash.0 Request processed in 987us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945964.285786:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 55 00000100:00100000:2.0:1790945964.286383:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945964.286730:0:8436:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616531200 00000100:00100000:3.0:1790945964.286741:0:8436:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616531200 00000100:00100000:3.0:1790945964.286794:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 56 00000100:00100000:3.0:1790945964.286805:0:8436:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83fbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:12177:x1877942616531200:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:3.0:1790945964.286825:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945964.286844:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f89886d8/0xd9f4181e0d27dbc5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330cfd expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.286892:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004a7d99fb/0xd9f4181e0d27dbbe lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cf6 expref: 7 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.286902:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945964.286906:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945964.286911:0:8436:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f89886d8/0xd9f4181e0d27dbc5 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cfd expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.286945:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004a7d99fb/0xd9f4181e0d27dbbe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cf6 expref: 7 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.286960:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004a7d99fb/0xd9f4181e0d27dbbe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cf6 expref: 7 pid: 8437 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945964.286973:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83ec3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1877942638620288:192.168.204.20@tcp:104: 00000100:00100000:3.0:1790945964.287386:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f81b86c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790945964.289683:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83ec3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1877942638620288:192.168.204.20@tcp:104: 00010000:00010000:3.0:1790945964.289721:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f89886d8/0xd9f4181e0d27dbc5 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cfd expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.289740:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40813ff800, rc 0) 00000100:00100000:3.0:1790945964.289795:0:8436:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83fbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:12177:x1877942616531200:12345-192.168.204.20@tcp:101:bash.0 Request processed in 2992us (3414us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945964.289804:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 56 00000100:00100000:1.0:1790945964.291254:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945964.291339:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616531328 00000100:00100000:2.0:1790945964.291346:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616531328 00010000:00010000:2.0:1790945964.291383:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004a7d99fb/0xd9f4181e0d27dbbe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cf6 expref: 7 pid: 8437 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945964.291437:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 81 00000100:00100000:2.0:1790945964.291446:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84569c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:2404:x1877942616531328:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790945964.291461:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945964.291483:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004a7d99fb/0xd9f4181e0d27dbbe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cf6 expref: 7 pid: 8437 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.291513:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004a7d99fb/0xd9f4181e0d27dbbe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cf6 expref: 7 pid: 8437 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.291535:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a7d99fb/0xd9f4181e0d27dbbe lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cf6 expref: 7 pid: 8437 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.291562:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790945964.291577:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790945964.291585:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f89886d8/0xd9f4181e0d27dbc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cfd expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.291596:0:6506:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f89886d8/0xd9f4181e0d27dbc5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cfd expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.291631:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f89886d8/0xd9f4181e0d27dbc5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cfd expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945964.291645:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83fbd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6506:1877942638620416:192.168.204.20@tcp:105: 00000100:00100000:2.0:1790945964.291717:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40914abe40 going to sleep for 11 seconds 00000100:00100000:2.0:1790945964.300095:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945964.300371:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83fbd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6506:1877942638620416:192.168.204.20@tcp:105: 00010000:00010000:0.0:1790945964.300404:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945964.300469:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84569c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2404:x1877942616531328:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 9023us (9218us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945964.300478:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 81 00000100:00100000:1.0:1790945964.300671:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616531584 00000100:00100000:1.0:1790945964.300679:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616531584 00000100:00100000:1.0:1790945964.300728:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 36 00000100:00100000:1.0:1790945964.300736:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83fbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+19:12177:x1877942616531584:12345-192.168.204.20@tcp:35:bash.0 00000100:00100000:1.0:1790945964.300993:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83fbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+20:12177:x1877942616531584:12345-192.168.204.20@tcp:35:bash.0 Request processed in 257us (908us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1790945964.301000:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 36 00000100:00100000:1.0:1790945964.397959:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945964.398077:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616531840 00000100:00100000:2.0:1790945964.398089:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616531840 00000100:00100000:2.0:1790945964.398155:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 157 00000100:00100000:2.0:1790945964.398164:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+20:12187:x1877942616531840:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1790945964.398346:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945964.398366:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64600/0xd9f4181e0d27dbcc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330d04 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945964.398533:0:6521:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1790945964.398709:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64600/0xd9f4181e0d27dbcc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d04 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.398722:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3f824ef400) 00010000:00010000:2.0:1790945964.398725:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790945964.398730:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64600/0xd9f4181e0d27dbcc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d04 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.398742:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c64600, rc 0) 00000100:00100000:2.0:1790945964.398851:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+21:12187:x1877942616531840:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 688us (903us total) trans 4294967421 rc 301/301 00000100:00100000:2.0:1790945964.398858:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 157 00000100:00100000:3.0:1790945964.413786:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945964.413992:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616532096 00000100:00100000:1.0:1790945964.414003:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616532096 00000100:00100000:1.0:1790945964.414070:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 37 00000100:00100000:1.0:1790945964.414081:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ec3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+21:12187:x1877942616532096:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:1.0:1790945964.414662:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ec3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+22:12187:x1877942616532096:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 580us (882us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1790945964.414686:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 37 00000100:00100000:3.0:1790945964.494398:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945964.494705:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616532224 00000100:00100000:1.0:1790945964.494717:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616532224 00000100:00100000:1.0:1790945964.494784:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 158 00000100:00100000:1.0:1790945964.494795:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ec1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+22:12193:x1877942616532224:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:1.0:1790945964.494823:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945964.494842:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd000/0xd9f4181e0d27dbda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330d0b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.494930:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc800/0xd9f4181e0d27dbe1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.494946:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc800/0xd9f4181e0d27dbe1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.494958:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc800/0xd9f4181e0d27dbe1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790945964.495001:0:6522:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1790945964.495004:0:6522:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790945964.495024:0:6522:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc800/0xd9f4181e0d27dbe1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.495050:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd000/0xd9f4181e0d27dbda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d0b expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.495069:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc800/0xd9f4181e0d27dbe1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d0b expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.495098:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d3f824ef900) 00010000:00010000:1.0:1790945964.495101:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790945964.495104:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4092afc800, rc 0) 00000100:00100000:1.0:1790945964.495399:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ec1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+23:12193:x1877942616532224:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 605us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945964.495408:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 158 00000100:00100000:2.0:1790945964.506374:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945964.507529:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616532480 00000100:00100000:3.0:1790945964.507544:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616532480 00000100:00100000:3.0:1790945964.507629:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 159 00000100:00100000:3.0:1790945964.507640:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83fbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+23:12193:x1877942616532480:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1790945964.507665:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945964.507688:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27dbe8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330d12 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.507802:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27dbef lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.507819:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27dbef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.507831:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27dbef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945964.507843:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1790945964.507970:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27dbe8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d12 expref: 26 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.507991:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27dbef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d12 expref: 25 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.507999:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d3f824ef500) 00010000:00010000:3.0:1790945964.508001:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790945964.508004:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4080031800, rc 0) 00000100:00100000:3.0:1790945964.508076:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83fbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+25:12193:x1877942616532480:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 438us (1714us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1790945964.508083:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 159 00010000:00010000:3.0:1790945964.511773:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945964.512470:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945964.513059:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616532736 00000100:00100000:0.0:1790945964.513070:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616532736 00000100:00100000:0.0:1790945964.513134:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 160 00000100:00100000:0.0:1790945964.513144:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ec3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+25:12193:x1877942616532736:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1790945964.513358:0:8457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945964.513379:0:8457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27dbfd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330d19 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.513506:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dc04 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.513522:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dc04 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.513656:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dc04 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945964.513670:0:8457:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1790945964.513774:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27dbfd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d19 expref: 28 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.513792:0:8457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dc04 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d19 expref: 27 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.513801:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d3f824ef500) 00010000:00010000:0.0:1790945964.513804:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790945964.513807:0:8457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe0e00, rc 0) 00000100:00100000:0.0:1790945964.513925:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ec3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+27:12193:x1877942616532736:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 782us (1462us total) trans 4294967424 rc 0/0 00000100:00100000:0.0:1790945964.513932:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 160 00000100:00100000:2.0:1790945964.519383:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945964.524190:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945964.524540:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616532992 00000100:00100000:2.0:1790945964.524553:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616532992 00000100:00100000:2.0:1790945964.524619:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 57 00000100:00100000:2.0:1790945964.524628:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ec1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2404:x1877942616532992:12345-192.168.204.20@tcp:1:lfs.0 00010000:00010000:2.0:1790945964.524675:0:8916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001775282a/0xd9f4181e0d27dc12 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.524696:0:8916:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f89886d8/0xd9f4181e0d27dbc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cfd expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.524716:0:8916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790945964.524721:0:8916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790945964.524726:0:8916:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001775282a/0xd9f4181e0d27dc12 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.524760:0:8916:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f89886d8/0xd9f4181e0d27dbc5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cfd expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.524774:0:8916:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f89886d8/0xd9f4181e0d27dbc5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cfd expref: 6 pid: 8436 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945964.524789:0:8916:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83fbd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8916:1877942638620544:192.168.204.20@tcp:104: 00000100:00100000:2.0:1790945964.524877:0:8916:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40914abe40 going to sleep for 11 seconds 00000100:00100000:3.0:1790945964.528894:0:8916:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83fbd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8916:1877942638620544:192.168.204.20@tcp:104: 00010000:00010000:3.0:1790945964.528926:0:8916:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001775282a/0xd9f4181e0d27dc12 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945964.529044:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945964.529126:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616533120 00000100:00100000:0.0:1790945964.529133:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616533120 00002000:00100000:0.0:1790945964.529247:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9d3f83fbd180 x1877942616533120/t0(0) o4->0cadc7a5-c0ba-4320-984f-d871ffb3a3ef@192.168.204.20@tcp:660/0 lens 504/0 e 0 to 0 dl 1790945975 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790945964.529258:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3f83fbd180 with x1877942616533120 ext(0->12) 00010000:00010000:0.0:1790945964.529285:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f89886d8/0xd9f4181e0d27dbc5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cfd expref: 7 pid: 8436 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.529300:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f89886d8/0xd9f4181e0d27dbc5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cfd expref: 7 pid: 8436 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790945964.529307:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9d3f83fbd180 00000100:00100000:0.0:1790945964.529343:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2 00000100:00100000:0.0:1790945964.529352:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83fbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:2403:x1877942616533120:12345-192.168.204.20@tcp:4:lfs.0 00000100:00100000:0.0:1790945964.530336:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83fbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+9:2403:x1877942616533120:12345-192.168.204.20@tcp:4:lfs.0 Request processed in 981us (1290us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1790945964.530346:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2 00002000:00100000:0.0:1790945964.530356:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9d3f83fbd180 x1877942616533120/t4294967306(0) o4->0cadc7a5-c0ba-4320-984f-d871ffb3a3ef@192.168.204.20@tcp:660/0 lens 504/448 e 0 to 0 dl 1790945975 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790945964.530365:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3f83fbd180 with x1877942616533120 ext(0->12) 00010000:00010000:0.0:1790945964.530372:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f89886d8/0xd9f4181e0d27dbc5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cfd expref: 9 pid: 8436 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.530386:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f89886d8/0xd9f4181e0d27dbc5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cfd expref: 9 pid: 8436 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790945964.530393:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9d3f83fbd180 00000100:00100000:1.0:1790945964.531222:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616532864 00000100:00100000:1.0:1790945964.531233:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616532864 00000100:00100000:1.0:1790945964.531290:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:1.0:1790945964.531301:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83fbf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+27:2403:x1877942616532864:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790945964.531314:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945964.531339:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27dbef lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d12 expref: 27 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.531360:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d3f824ef500) 00010000:00010000:1.0:1790945964.531365:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945964.531406:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83fbf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+26:2403:x1877942616532864:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 107us (12035us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945964.531413:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:3.0:1790945964.533753:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945964.534897:0:7471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616533248 00000100:00100000:1.0:1790945964.534911:0:7471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616533248 00010000:00010000:1.0:1790945964.534952:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f89886d8/0xd9f4181e0d27dbc5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cfd expref: 9 pid: 8436 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945964.535032:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 82 00000100:00100000:1.0:1790945964.535055:0:7471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ec1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+9:2402:x1877942616533248:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790945964.535069:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1790945964.535086:0:7471:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1790945964.535089:0:7471:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1790945964 00002000:00010000:1.0:1790945964.535091:0:7471:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1790945964 00002000:00010000:1.0:1790945964.535093:0:7471:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1790945964 00002000:00010000:1.0:1790945964.535095:0:7471:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1790945964.535102:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f89886d8/0xd9f4181e0d27dbc5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cfd expref: 9 pid: 8436 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.535116:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f89886d8/0xd9f4181e0d27dbc5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cfd expref: 9 pid: 8436 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.535138:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f89886d8/0xd9f4181e0d27dbc5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cfd expref: 9 pid: 8436 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.535180:0:7471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790945964.535186:0:7471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790945964.535191:0:7471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001775282a/0xd9f4181e0d27dc12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.535210:0:7471:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001775282a/0xd9f4181e0d27dc12 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.535252:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945964.535304:0:7471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ec1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+8:2402:x1877942616533248:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 251us (1558us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945964.535323:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 82 00010000:00010000:3.0:1790945964.535998:0:8916:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001775282a/0xd9f4181e0d27dc12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.536012:0:8916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001775282a/0xd9f4181e0d27dc12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.536036:0:8916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001775282a/0xd9f4181e0d27dc12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.536053:0:8916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001775282a/0xd9f4181e0d27dc12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.536060:0:8916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001775282a/0xd9f4181e0d27dc12 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.536067:0:8916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65200 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:3.0:1790945964.536072:0:8916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001775282a/0xd9f4181e0d27dc12 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.536082:0:8916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001775282a/0xd9f4181e0d27dc12 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.536095:0:8916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001775282a/0xd9f4181e0d27dc12 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945964.536102:0:8916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001775282a/0xd9f4181e0d27dc12 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945964.536195:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ec1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:2404:x1877942616532992:12345-192.168.204.20@tcp:1:lfs.0 Request processed in 11566us (12044us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945964.536214:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 57 00000100:00100000:0.0:1790945964.539628:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945964.539763:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616533504 00000100:00100000:1.0:1790945964.539775:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616533504 00000100:00100000:1.0:1790945964.539833:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 38 00000100:00100000:1.0:1790945964.539843:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4096dd8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+26:12193:x1877942616533504:12345-192.168.204.20@tcp:35:lfs.0 00000004:00010000:1.0:1790945964.539906:0:6525:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dc04 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d19 expref: 26 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790945964.540086:0:6525:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1790945964.540121:0:6525:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1790945964.540731:0:6525:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:1.0:1790945964.540771:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd000/0xd9f4181e0d27dc19 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.540788:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27dbb0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cef expref: 30 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.540798:0:6525:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd000/0xd9f4181e0d27dc19 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.540833:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27dbb0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cef expref: 30 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.540848:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27dbb0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cef expref: 30 pid: 6523 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945964.540861:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8456aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6525:1877942638620672:192.168.204.20@tcp:104: 00000100:00100000:1.0:1790945964.541026:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408704fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1790945964.546504:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945964.547062:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616533632 00000100:00100000:2.0:1790945964.547074:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616533632 00010000:00010000:2.0:1790945964.547122:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27dbb0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cef expref: 31 pid: 6523 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945964.547214:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 83 00000100:00100000:2.0:1790945964.547223:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+31:2404:x1877942616533632:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790945964.547240:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945964.547247:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27dbb0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cef expref: 31 pid: 6523 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.547275:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27dbb0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cef expref: 31 pid: 6523 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.547301:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d3f824ef500) 00010000:00010000:2.0:1790945964.547307:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd000/0xd9f4181e0d27dc19 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.547316:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd000/0xd9f4181e0d27dc19 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.547324:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd000/0xd9f4181e0d27dc19 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945964.547344:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945964.547399:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+31:2404:x1877942616533632:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 176us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945964.547407:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 83 00010000:00010000:1.0:1790945964.548373:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c600/0xd9f4181e0d27dbb0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cef expref: 30 pid: 6523 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945964.548391:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8456aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6525:1877942638620672:192.168.204.20@tcp:104: 00010000:00010000:1.0:1790945964.548412:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd000/0xd9f4181e0d27dc19 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.548421:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd000/0xd9f4181e0d27dc19 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.548428:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd000/0xd9f4181e0d27dc19 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790945964.548687:0:6525:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:1.0:1790945964.548805:0:6525:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:1.0:1790945964.548892:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8456aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1877942638620800:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790945964.548945:0:6525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945964.549020:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408704f600 going to sleep for 11 seconds 00000100:00100000:0.0:1790945964.550106:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638620800 00000100:00100000:0.0:1790945964.550116:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638620800 00000100:00100000:0.0:1790945964.550669:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1790945964.550680:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6525:x1877942638620800:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790945964.550830:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6525:x1877942638620800:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 151us (1883us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945964.550838:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1790945964.550918:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8456aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1877942638620800:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1790945964.551047:0:6525:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:1.0:1790945964.551106:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8456aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1877942638620928:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790945964.551138:0:6525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945964.551341:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638620928 00000100:00100000:3.0:1790945964.551349:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638620928 00000100:00100000:3.0:1790945964.551387:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1790945964.551405:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6525:x1877942638620928:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790945964.551539:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408704fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1790945964.551843:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6525:x1877942638620928:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 440us (703us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1790945964.551851:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1790945964.551915:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8456aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1877942638620928:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1790945964.551959:0:6525:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:1.0:1790945964.551993:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd000/0xd9f4181e0d27dc19 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.552004:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd000/0xd9f4181e0d27dc19 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.552019:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd000/0xd9f4181e0d27dc19 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.552025:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afd000 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:1.0:1790945964.552030:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd000/0xd9f4181e0d27dc19 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.552040:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd000/0xd9f4181e0d27dc19 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.552055:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d3f824ef500) 00010000:00010000:1.0:1790945964.552059:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1790945964.552064:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd000/0xd9f4181e0d27dc19 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945964.552071:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd000/0xd9f4181e0d27dc19 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790945964.552501:0:6525:0:(mdd_object.c:4180:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1790945964.552713:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1790945964.552727:0:6525:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 415368558403ns, next at 416368555031ns, rc = 0 00000001:00080000:0.0:1790945964.552734:0:6525:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:0.0:1790945964.552765:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d3f824ef500) 00010000:00010000:0.0:1790945964.552768:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790945964.552776:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dc04 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d19 expref: 34 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945964.552929:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4096dd8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+33:12193:x1877942616533504:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 13086us (13308us total) trans 4294967433 rc 0/0 00000100:00100000:0.0:1790945964.552938:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 38 00000020:00080000:0.0:1790945964.552942:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1790945964.556056:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945964.556376:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616533760 00000100:00100000:1.0:1790945964.556388:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616533760 00000100:00100000:0.0:1790945964.556554:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 161 00000100:00100000:0.0:1790945964.556575:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83fa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+33:12193:x1877942616533760:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1790945964.556601:0:13005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945964.556625:0:13005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27dc20 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330d20 expref: -99 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.556688:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27dc20 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d20 expref: 34 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.556724:0:13005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27dc20 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d20 expref: 34 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.556744:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d40bc937700) 00010000:00010000:0.0:1790945964.556748:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790945964.556752:0:13005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe1600, rc 0) 00000100:00100000:0.0:1790945964.556857:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83fa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+34:12193:x1877942616533760:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 293us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945964.556865:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 161 00000100:00100000:2.0:1790945964.560494:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945964.560720:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616534016 00000100:00100000:1.0:1790945964.560730:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616534016 00000100:00100000:1.0:1790945964.560786:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 39 00000100:00100000:1.0:1790945964.560797:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83fbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+34:12193:x1877942616534016:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:1.0:1790945964.561018:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83fbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+35:12193:x1877942616534016:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 222us (532us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1790945964.561025:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 39 00000100:00100000:2.0:1790945964.654900:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945964.655008:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616534272 00000100:00100000:0.0:1790945964.655019:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616534272 00000100:00100000:0.0:1790945964.655083:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 162 00000100:00100000:0.0:1790945964.655091:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83fbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+35:12203:x1877942616534272:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1790945964.655114:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945964.655133:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dc27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330d27 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945964.655278:0:6521:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1790945964.655378:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dc27 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d27 expref: 37 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.655393:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3f824ef400) 00010000:00010000:0.0:1790945964.655396:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790945964.655401:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dc27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d27 expref: 37 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.655435:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe0e00, rc 0) 00000100:00100000:0.0:1790945964.655498:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83fbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+36:12203:x1877942616534272:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 406us (615us total) trans 4294967435 rc 301/301 00000100:00100000:0.0:1790945964.655505:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 162 00000100:00100000:2.0:1790945964.657979:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945964.658055:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616534400 00000100:00100000:0.0:1790945964.658065:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616534400 00000100:00100000:0.0:1790945964.658118:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 163 00000100:00100000:0.0:1790945964.658127:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+36:12203:x1877942616534400:12345-192.168.204.20@tcp:34:lfs.0 00010000:00010000:0.0:1790945964.658370:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27dc35 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.658390:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27dc35 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.658402:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27dc35 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.658416:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27dc3c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.658424:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27dc3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.658431:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27dc3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.658504:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27dc43 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.658542:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27dc43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.658550:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27dc43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790945964.658608:0:8457:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27dc43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.658621:0:8457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27dc35 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.658629:0:8457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27dc35 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.658637:0:8457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27dc35 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.658643:0:8457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe1e00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945964.658648:0:8457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27dc35 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.658656:0:8457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27dc35 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.658667:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d3f824ef900) 00010000:00010000:0.0:1790945964.658670:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945964.658674:0:8457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27dc35 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.658680:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27dc35 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.658699:0:8457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27dc3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.658706:0:8457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27dc3c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.658712:0:8457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27dc3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.658717:0:8457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945964.658720:0:8457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27dc3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.658727:0:8457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27dc3c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.658735:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d3f824ef800) 00010000:00010000:0.0:1790945964.658737:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945964.658740:0:8457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27dc3c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.658746:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27dc3c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.658756:0:8457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27dc43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.658763:0:8457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27dc43 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.658769:0:8457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27dc43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.658780:0:8457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0000 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945964.658783:0:8457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27dc43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.658789:0:8457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27dc43 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.658798:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d40bc937700) 00010000:00010000:0.0:1790945964.658801:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945964.658804:0:8457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27dc43 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.658809:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27dc43 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945964.658892:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+36:12203:x1877942616534400:12345-192.168.204.20@tcp:34:lfs.0 Request processed in 764us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945964.658901:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 163 00000100:00100000:2.0:1790945964.661889:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945964.662070:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616534656 00000100:00100000:1.0:1790945964.662082:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616534656 00000100:00100000:1.0:1790945964.662234:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 40 00000100:00100000:1.0:1790945964.662245:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+36:12203:x1877942616534656:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:1.0:1790945964.662474:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+37:12203:x1877942616534656:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 230us (597us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1790945964.662482:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 40 00000100:00100000:2.0:1790945964.700922:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945964.701053:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616534912 00000100:00100000:0.0:1790945964.701067:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616534912 00000100:00100000:0.0:1790945964.701132:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 164 00000100:00100000:0.0:1790945964.701142:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+37:12206:x1877942616534912:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1790945964.701221:0:13005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945964.701242:0:13005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27dc4a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330d2e expref: -99 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.701329:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27dc51 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.701356:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27dc51 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.701367:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27dc51 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.701379:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27dc58 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.701387:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27dc58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.701393:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27dc58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.701504:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dc5f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.701514:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dc5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.701521:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dc5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945964.701843:0:13005:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1790945964.701928:0:13005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27dc51 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.701936:0:13005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27dc51 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.701943:0:13005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27dc51 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.701957:0:13005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945964.701961:0:13005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27dc51 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.701969:0:13005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27dc51 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.701982:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d3f824ef900) 00010000:00010000:0.0:1790945964.701985:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945964.701990:0:13005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27dc51 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.701997:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27dc51 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.702011:0:13005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27dc58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.702017:0:13005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27dc58 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.702023:0:13005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27dc58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.702028:0:13005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe1e00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945964.702031:0:13005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27dc58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.702037:0:13005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27dc58 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.702056:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d3f824ef800) 00010000:00010000:0.0:1790945964.702059:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945964.702062:0:13005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27dc58 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.702069:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27dc58 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.702107:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27dc4a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d2e expref: 40 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.702119:0:13005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dc5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d2e expref: 39 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.702126:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d40bc937700) 00010000:00010000:0.0:1790945964.702129:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790945964.702131:0:13005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe0e00, rc 0) 00000100:00100000:0.0:1790945964.702333:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+39:12206:x1877942616534912:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 1191us (1421us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1790945964.702341:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 164 00000100:00100000:2.0:1790945964.705108:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945964.705881:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616535040 00000100:00100000:0.0:1790945964.705895:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616535040 00000100:00100000:0.0:1790945964.706002:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 165 00000100:00100000:0.0:1790945964.706013:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+39:12206:x1877942616535040:12345-192.168.204.20@tcp:54:lfs.0 00010000:00010000:0.0:1790945964.706075:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27dc6d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.706091:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27dc6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.709780:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27dc6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.709828:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27dc6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.709835:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27dc6d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.709844:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27dc6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.709849:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe1800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945964.709854:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27dc6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.709860:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27dc6d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.709873:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d40bc937700) 00010000:00010000:0.0:1790945964.709876:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790945964.709880:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27dc6d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.709886:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27dc6d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945964.709986:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+39:12206:x1877942616535040:12345-192.168.204.20@tcp:54:lfs.0 Request processed in 3970us (4882us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945964.709996:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 165 00000100:00100000:2.0:1790945964.712266:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945964.712398:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616535296 00000100:00100000:3.0:1790945964.712409:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616535296 00000100:00100000:3.0:1790945964.712467:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 41 00000100:00100000:3.0:1790945964.712477:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84470380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+39:12206:x1877942616535296:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:3.0:1790945964.712902:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84470380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+40:12206:x1877942616535296:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 426us (644us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1790945964.712911:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 41 00000100:00100000:2.0:1790945964.982023:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945964.982180:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616535552 00000100:00100000:0.0:1790945964.982205:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616535552 00000100:00100000:0.0:1790945964.982331:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 166 00000100:00100000:0.0:1790945964.982340:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84473800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+40:12237:x1877942616535552:12345-192.168.204.20@tcp:101:cat.0 00010000:00010000:0.0:1790945964.982377:0:8457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945964.982406:0:8457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27dc74 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330d35 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.982544:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27dc7b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.982569:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27dc7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.982582:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27dc7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945964.982592:0:8457:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1790945964.982690:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27dc74 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d35 expref: 43 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.982709:0:8457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27dc7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d35 expref: 42 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.982717:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d40bc937700) 00010000:00010000:0.0:1790945964.982720:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790945964.982724:0:8457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe0000, rc 0) 00000100:00100000:0.0:1790945964.982783:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84473800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+42:12237:x1877942616535552:12345-192.168.204.20@tcp:101:cat.0 Request processed in 444us (769us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1790945964.982791:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 166 00000100:00100000:3.0:1790945964.989737:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945964.989774:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945964.989835:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616535936 00000100:00100000:1.0:1790945964.989848:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616535936 00000100:00100000:1.0:1790945964.989911:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 42 00000100:00100000:1.0:1790945964.989921:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ec3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+42:12237:x1877942616535936:12345-192.168.204.20@tcp:35:cat.0 00000100:00100000:0.0:1790945964.989987:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616535680 00000100:00100000:0.0:1790945964.989993:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616535680 00000100:00100000:0.0:1790945964.990088:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:0.0:1790945964.990098:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ec1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+43:2401:x1877942616535680:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790945964.990111:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945964.990134:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27dc7b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d35 expref: 43 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945964.990153:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d40bc937700) 00010000:00010000:0.0:1790945964.990158:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945964.990246:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ec1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+42:2401:x1877942616535680:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 150us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945964.990255:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:1.0:1790945964.990439:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ec3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+42:12237:x1877942616535936:12345-192.168.204.20@tcp:35:cat.0 Request processed in 519us (662us total) trans 4294967440 rc 0/0 00000100:00100000:1.0:1790945964.990446:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 42 00000100:00100000:3.0:1790945965.055481:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945965.055881:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616536192 00000100:00100000:0.0:1790945965.055891:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616536192 00000100:00100000:0.0:1790945965.055952:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 167 00000100:00100000:0.0:1790945965.055962:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ec2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+42:12243:x1877942616536192:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:0.0:1790945965.055986:0:13005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945965.055989:0:13005:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790945965.056015:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc800/0xd9f4181e0d27dbe1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d0b expref: 42 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.056034:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d3f824ef900) 00010000:00010000:0.0:1790945965.056038:0:13005:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790945965.056050:0:13005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27dc89 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330d3c expref: -99 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.056291:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27dc90 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.056306:0:13005:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dc5f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d2e expref: 42 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.056315:0:13005:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27dc90 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.056359:0:13005:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dc5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d2e expref: 42 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.056374:0:13005:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dc5f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d2e expref: 42 pid: 13005 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945965.056388:0:13005:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83faaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13005:1877942638621056:192.168.204.20@tcp:104: 00000100:00100000:0.0:1790945965.056607:0:13005:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40812edcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790945965.065760:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945965.065872:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616536320 00000100:00100000:1.0:1790945965.065881:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616536320 00010000:00010000:1.0:1790945965.065924:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dc5f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d2e expref: 43 pid: 13005 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945965.065982:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 84 00000100:00100000:1.0:1790945965.065992:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4096cba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+43:2403:x1877942616536320:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790945965.066009:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945965.066016:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dc5f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d2e expref: 43 pid: 13005 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945965.066030:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dc5f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d2e expref: 43 pid: 13005 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945965.066075:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d40bc937700) 00010000:00010000:1.0:1790945965.066080:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27dc90 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945965.066089:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27dc90 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945965.066097:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27dc90 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945965.066118:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945965.066690:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4096cba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+43:2403:x1877942616536320:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 177us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945965.066700:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 84 00010000:00010000:0.0:1790945965.067420:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dc5f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d2e expref: 42 pid: 13005 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945965.067439:0:13005:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83faaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13005:1877942638621056:192.168.204.20@tcp:104: 00010000:00010000:0.0:1790945965.067459:0:13005:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27dc90 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.067468:0:13005:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27dc90 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.067488:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27dc90 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945965.067508:0:13005:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1790945965.067989:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27dc89 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d3c expref: 43 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.068006:0:13005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27dc90 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d3c expref: 42 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.068015:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d40bc937700) 00010000:00010000:0.0:1790945965.068019:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790945965.068021:0:13005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe1800, rc 0) 00000100:00100000:0.0:1790945965.068086:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ec2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+42:12243:x1877942616536192:12345-192.168.204.20@tcp:101:dd.0 Request processed in 12124us (12615us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1790945965.068095:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 167 00000100:00100000:2.0:1790945965.075110:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945965.075233:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616536448 00000100:00100000:0.0:1790945965.075244:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616536448 00000100:00100000:0.0:1790945965.075296:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 168 00000100:00100000:0.0:1790945965.075305:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84470e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+42:12243:x1877942616536448:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:0.0:1790945965.075331:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945965.075352:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27dc9e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330d43 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.075390:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27dca5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.075422:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27dca5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.075434:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27dca5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.075580:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27dc9e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d43 expref: 44 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.075599:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27dca5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d43 expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.075608:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d40bc937700) 00010000:00010000:0.0:1790945965.075610:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790945965.075613:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe0800, rc 0) 00000100:00100000:0.0:1790945965.075668:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84470e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+43:12243:x1877942616536448:12345-192.168.204.20@tcp:101:dd.0 Request processed in 363us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945965.075675:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 168 00000100:00100000:1.0:1790945965.081689:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945965.082098:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616536704 00000100:00100000:0.0:1790945965.082109:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616536704 00000100:00100000:0.0:1790945965.082433:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 169 00000100:00100000:0.0:1790945965.082445:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+43:12243:x1877942616536704:12345-192.168.204.20@tcp:36:dd.0 00010000:00010000:0.0:1790945965.082701:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27dcac lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.082720:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27dcac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.082752:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27dcac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790945965.082799:0:8457:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:0.0:1790945965.082826:0:8457:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007be33ab4 reply state 00000000e2eb0a1c transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27dcac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.082840:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27dcac lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.082848:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d40bc937700) 00010000:00010000:0.0:1790945965.082851:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790945965.082855:0:8457:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790945965.082953:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+46:12243:x1877942616536704:12345-192.168.204.20@tcp:36:dd.0 Request processed in 509us (1273us total) trans 4294967443 rc 0/0 00000100:00100000:0.0:1790945965.083891:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 169 00000020:00080000:0.0:1790945965.083899:0:8457:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1790945965.407909:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945965.408762:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616536832 00000100:00100000:0.0:1790945965.408774:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616536832 00000100:00100000:0.0:1790945965.408858:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 170 00000100:00100000:0.0:1790945965.408869:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ec1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+46:12257:x1877942616536832:12345-192.168.204.20@tcp:101:stat.0 00010000:00010000:0.0:1790945965.408897:0:13005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945965.408923:0:13005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27dcb3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330d4a expref: -99 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.409015:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dcba lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.409030:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dcba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.409052:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dcba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.409062:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27dcc1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.409068:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27dcc1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.409074:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27dcc1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.409142:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27dcc8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.409153:0:13005:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27dc90 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d3c expref: 47 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.409161:0:13005:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27dcc8 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.409248:0:13005:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27dc90 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d3c expref: 47 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.409265:0:13005:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27dc90 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d3c expref: 47 pid: 13005 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945965.409279:0:13005:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83faaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13005:1877942638621184:192.168.204.20@tcp:104: 00000100:00100000:0.0:1790945965.409407:0:13005:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4087172480 going to sleep for 11 seconds 00000100:00100000:2.0:1790945965.411534:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945965.411744:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616537088 00000100:00100000:1.0:1790945965.411754:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616537088 00000100:00100000:1.0:1790945965.411875:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 43 00000100:00100000:1.0:1790945965.411885:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84471180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+48:6171:x1877942616537088:12345-192.168.204.20@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1790945965.412220:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84471180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+49:6171:x1877942616537088:12345-192.168.204.20@tcp:35:ldlm_bl.0 Request processed in 334us (691us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1790945965.412472:0:13005:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83faaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13005:1877942638621184:192.168.204.20@tcp:104: 00010000:00010000:0.0:1790945965.412496:0:13005:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27dcc8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945965.412556:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 43 00000100:00100000:1.0:1790945965.416511:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945965.419959:0:7471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616537216 00000100:00100000:3.0:1790945965.419973:0:7471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616537216 00010000:00010000:3.0:1790945965.420024:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27dc90 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d3c expref: 49 pid: 13005 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945965.420071:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 85 00000100:00100000:3.0:1790945965.420080:0:7471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8456ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+49:2403:x1877942616537216:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790945965.420094:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945965.420101:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27dc90 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d3c expref: 49 pid: 13005 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945965.420133:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27dc90 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d3c expref: 49 pid: 13005 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945965.420157:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27dc90 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d3c expref: 49 pid: 13005 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945965.420203:0:7471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d40bc937700) 00010000:00010000:3.0:1790945965.420209:0:7471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27dcc8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945965.420220:0:7471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27dcc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945965.421407:0:7471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27dcc8 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945965.421459:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945965.421533:0:7471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8456ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+48:2403:x1877942616537216:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 1452us (5032us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945965.421552:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 85 00010000:00010000:0.0:1790945965.422859:0:13005:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27dcc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.422873:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27dcc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945965.422932:0:13005:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1790945965.422937:0:13005:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790945965.422967:0:13005:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27dcc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.422982:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27dcc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.422992:0:13005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dcba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.422998:0:13005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dcba lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.423006:0:13005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dcba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.423011:0:13005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0e00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945965.423015:0:13005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dcba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.423022:0:13005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dcba lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.423050:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d3f824ef900) 00010000:00010000:0.0:1790945965.423053:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945965.423058:0:13005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dcba lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.423064:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dcba lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.423079:0:13005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27dcc1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.423086:0:13005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27dcc1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.423092:0:13005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27dcc1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.423098:0:13005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0200 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945965.423101:0:13005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27dcc1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.423107:0:13005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27dcc1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.423115:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d3f824ef800) 00010000:00010000:0.0:1790945965.423117:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945965.423120:0:13005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27dcc1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.423127:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27dcc1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.423210:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27dcb3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d4a expref: 48 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.423227:0:13005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27dcc8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d4a expref: 47 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.423235:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d40bc937700) 00010000:00010000:0.0:1790945965.423237:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790945965.423239:0:13005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe1200, rc 0) 00000100:00100000:0.0:1790945965.423304:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ec1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+47:12257:x1877942616536832:12345-192.168.204.20@tcp:101:stat.0 Request processed in 14437us (15404us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945965.423314:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 170 00000100:00100000:1.0:1790945965.527553:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945965.527760:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616537472 00000100:00100000:3.0:1790945965.527772:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616537472 00000100:00100000:3.0:1790945965.527836:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 171 00000100:00100000:3.0:1790945965.527846:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+47:12263:x1877942616537472:12345-192.168.204.20@tcp:36:truncate.0 00010000:00010000:3.0:1790945965.527905:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945965.527930:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27dcc8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d4a expref: 47 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945965.527978:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d40bc937700) 00010000:00010000:3.0:1790945965.527983:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790945965.528166:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27dccf lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945965.529019:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27dccf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945965.529030:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27dccf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790945965.529095:0:6522:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:3.0:1790945965.529129:0:6522:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000024d8049d reply state 0000000036482043 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27dccf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945965.529141:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27dccf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945965.529148:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d40bc937700) 00010000:00010000:3.0:1790945965.529151:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790945965.529155:0:6522:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790945965.529864:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+49:12263:x1877942616537472:12345-192.168.204.20@tcp:36:truncate.0 Request processed in 1937us (2248us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1790945965.529875:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 171 00000020:00080000:3.0:1790945965.529881:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790945965.537847:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945965.790295:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945965.790462:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616537600 00000100:00100000:0.0:1790945965.790473:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616537600 00000100:00100000:0.0:1790945965.790558:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 172 00000100:00100000:0.0:1790945965.790569:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ec1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+49:12278:x1877942616537600:12345-192.168.204.20@tcp:101:stat.0 00010000:00010000:0.0:1790945965.790603:0:8457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945965.790625:0:8457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27dcd6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330d51 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.790691:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27dcdd lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.790706:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27dcdd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.790716:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27dcdd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.790743:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dce4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.790751:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dce4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.790758:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dce4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.790835:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27dceb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.790845:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27dceb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.790852:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27dceb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945965.790893:0:8457:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1790945965.790898:0:8457:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790945965.790930:0:8457:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27dceb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.791315:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27dceb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.791327:0:8457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27dcdd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.791334:0:8457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27dcdd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.791352:0:8457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27dcdd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.791358:0:8457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0200 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945965.791362:0:8457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27dcdd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.791370:0:8457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27dcdd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.791381:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d3f824ef900) 00010000:00010000:0.0:1790945965.791384:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945965.791388:0:8457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27dcdd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.791393:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27dcdd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.791407:0:8457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dce4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.791411:0:8457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dce4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.791416:0:8457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dce4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.791420:0:8457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0e00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945965.791423:0:8457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dce4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.791437:0:8457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dce4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.791445:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d3f824ef800) 00010000:00010000:0.0:1790945965.791447:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945965.791450:0:8457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dce4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.791454:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27dce4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.791483:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27dcd6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d51 expref: 51 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.791494:0:8457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27dceb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d51 expref: 50 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.792759:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d40bc937700) 00010000:00010000:0.0:1790945965.792768:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790945965.792784:0:8457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe0c00, rc 0) 00000100:00100000:0.0:1790945965.792868:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ec1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+50:12278:x1877942616537600:12345-192.168.204.20@tcp:101:stat.0 Request processed in 2299us (2581us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945965.792878:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 172 00000100:00100000:1.0:1790945965.919727:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83eb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638621312:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790945965.919799:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945965.920609:0:11925:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638621312 00000100:00100000:3.0:1790945965.920620:0:11925:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638621312 00000100:00100000:3.0:1790945965.920700:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1790945965.920711:0:11925:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8456b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638621312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790945965.920743:0:11925:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1790945965.920793:0:11925:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8456b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638621312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945965.920800:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:1.0:1790945965.921125:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790945965.921240:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83eb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638621312:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790945965.923559:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8456a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638621440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790945965.923626:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945965.924269:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638621440 00000100:00100000:1.0:1790945965.924279:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638621440 00000100:00100000:1.0:1790945965.924397:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1790945965.924408:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84470700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638621440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790945965.924430:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1790945965.924484:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84470700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638621440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945965.924492:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:3.0:1790945965.924548:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790945965.924604:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8456a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638621440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790945965.945492:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945965.945570:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616537856 00000100:00100000:0.0:1790945965.945589:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616537856 00000100:00100000:0.0:1790945965.945654:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 173 00000100:00100000:0.0:1790945965.945664:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8456a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+50:12288:x1877942616537856:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1790945965.945699:0:13005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945965.945730:0:13005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27dcf2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330d58 expref: -99 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945965.945836:0:13005:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1790945965.945951:0:13005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27dcf2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d58 expref: 52 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.945965:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3f824ef400) 00010000:00010000:0.0:1790945965.945968:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790945965.945973:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27dcf2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d58 expref: 52 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945965.945988:0:13005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe0000, rc 0) 00000100:00100000:0.0:1790945965.946054:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8456a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+51:12288:x1877942616537856:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 391us (571us total) trans 4294967447 rc 301/301 00000100:00100000:0.0:1790945965.946062:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 173 00000100:00100000:1.0:1790945965.968670:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945965.968772:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616538112 00000100:00100000:3.0:1790945965.968795:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616538112 00000100:00100000:3.0:1790945965.968859:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 44 00000100:00100000:3.0:1790945965.968871:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4096dd8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+51:12288:x1877942616538112:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:3.0:1790945965.969136:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4096dd8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+52:12288:x1877942616538112:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 266us (479us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1790945965.969144:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 44 00000040:00080000:1.0:1790945966.047560:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790945966.047580:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790945966.047738:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1790945966.047748:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790945966.089908:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945966.091297:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616538368 00000100:00100000:1.0:1790945966.091309:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616538368 00000100:00100000:1.0:1790945966.091973:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 174 00000100:00100000:1.0:1790945966.091984:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+52:12294:x1877942616538368:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:1.0:1790945966.092012:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945966.092033:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc400/0xd9f4181e0d27dd00 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330d5f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945966.092153:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27dd07 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945966.092204:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27dceb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d51 expref: 53 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945966.092231:0:6522:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27dd07 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945966.092268:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27dceb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d51 expref: 53 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945966.092283:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27dceb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d51 expref: 53 pid: 8457 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945966.092296:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84568380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1877942638621568:192.168.204.20@tcp:104: 00000100:00100000:1.0:1790945966.092714:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408704f0c0 going to sleep for 11 seconds 00000100:00080000:3.0:1790945966.096654:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790945966.097131:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945966.097218:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616538496 00000100:00100000:0.0:1790945966.097239:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616538496 00010000:00010000:0.0:1790945966.097280:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27dceb lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d51 expref: 54 pid: 8457 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945966.097318:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 86 00000100:00100000:0.0:1790945966.097328:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8456b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+54:2404:x1877942616538496:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790945966.097343:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945966.097350:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27dceb lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d51 expref: 54 pid: 8457 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945966.097398:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27dceb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d51 expref: 54 pid: 8457 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945966.097423:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d40bc937700) 00010000:00010000:0.0:1790945966.097428:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27dd07 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945966.097439:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27dd07 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945966.097447:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27dd07 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945966.097465:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945966.097546:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8456b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+54:2404:x1877942616538496:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 219us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945966.097553:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 86 00010000:00010000:3.0:1790945966.099109:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27dceb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d51 expref: 53 pid: 8457 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945966.099131:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84568380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1877942638621568:192.168.204.20@tcp:104: 00010000:00010000:3.0:1790945966.099156:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27dd07 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945966.099215:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27dd07 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945966.099249:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27dd07 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945966.099269:0:6522:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1790945966.099774:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc400/0xd9f4181e0d27dd00 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d5f expref: 54 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945966.099790:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27dd07 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d5f expref: 53 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945966.099799:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d40bc937700) 00010000:00010000:3.0:1790945966.099801:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790945966.099804:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4092afd600, rc 0) 00000100:00100000:3.0:1790945966.099862:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+53:12294:x1877942616538368:12345-192.168.204.20@tcp:101:bash.0 Request processed in 7881us (9964us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1790945966.099870:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 174 00000100:00100000:1.0:1790945966.108586:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945966.108771:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616538752 00000100:00100000:0.0:1790945966.108781:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616538752 00000100:00100000:0.0:1790945966.108841:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 175 00000100:00100000:0.0:1790945966.108849:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+53:12294:x1877942616538752:12345-192.168.204.20@tcp:36:bash.0 00010000:00010000:0.0:1790945966.109081:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27dd15 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945966.109101:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27dd15 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945966.109112:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27dd15 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790945966.109457:0:8457:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:0.0:1790945966.109483:0:8457:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000039384425 reply state 0000000065730e7a transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27dd15 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945966.109496:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27dd15 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945966.109660:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d40bc937700) 00010000:00010000:0.0:1790945966.109664:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790945966.109667:0:8457:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790945966.109811:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+56:12294:x1877942616538752:12345-192.168.204.20@tcp:36:bash.0 Request processed in 960us (1233us total) trans 4294967451 rc 0/0 00000100:00100000:0.0:1790945966.109818:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 175 00000020:00080000:0.0:1790945966.109823:0:8457:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790945966.130246:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945966.130466:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616538880 00000100:00100000:2.0:1790945966.130477:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616538880 00000100:00100000:2.0:1790945966.130551:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 176 00000100:00100000:2.0:1790945966.130560:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83faaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+56:12294:x1877942616538880:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:2.0:1790945966.130588:0:13005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945966.130606:0:13005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64a00/0xd9f4181e0d27dd1c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330d66 expref: -99 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.130703:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65200/0xd9f4181e0d27dd23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.130719:0:13005:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27dd07 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d5f expref: 57 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.130729:0:13005:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65200/0xd9f4181e0d27dd23 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.130761:0:13005:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27dd07 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d5f expref: 57 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.130773:0:13005:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27dd07 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d5f expref: 57 pid: 6522 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945966.130786:0:13005:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84473b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13005:1877942638621696:192.168.204.20@tcp:104: 00000100:00100000:2.0:1790945966.130881:0:13005:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40914abe40 going to sleep for 11 seconds 00000100:00100000:1.0:1790945966.136665:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945966.136756:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616539008 00000100:00100000:0.0:1790945966.136765:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616539008 00010000:00010000:0.0:1790945966.136803:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27dd07 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d5f expref: 58 pid: 6522 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945966.136844:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 87 00000100:00100000:0.0:1790945966.136853:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84568380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+58:2404:x1877942616539008:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790945966.136867:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945966.136874:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27dd07 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d5f expref: 58 pid: 6522 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945966.136887:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27dd07 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d5f expref: 58 pid: 6522 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945966.136925:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d40bc937700) 00010000:00010000:0.0:1790945966.136929:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65200/0xd9f4181e0d27dd23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945966.136938:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65200/0xd9f4181e0d27dd23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945966.136956:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65200/0xd9f4181e0d27dd23 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945966.136975:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945966.137031:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84568380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+58:2404:x1877942616539008:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 179us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945966.137045:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 87 00010000:00010000:2.0:1790945966.138159:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27dd07 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d5f expref: 57 pid: 6522 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945966.138758:0:13005:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84473b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13005:1877942638621696:192.168.204.20@tcp:104: 00010000:00010000:2.0:1790945966.138781:0:13005:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65200/0xd9f4181e0d27dd23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.138791:0:13005:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65200/0xd9f4181e0d27dd23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.138797:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65200/0xd9f4181e0d27dd23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945966.138853:0:13005:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1790945966.138858:0:13005:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790945966.138881:0:13005:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65200/0xd9f4181e0d27dd23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.138913:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64a00/0xd9f4181e0d27dd1c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d66 expref: 57 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.138927:0:13005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65200/0xd9f4181e0d27dd23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d66 expref: 56 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.138934:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d40bc937700) 00010000:00010000:2.0:1790945966.138937:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790945966.138940:0:13005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c65200, rc 0) 00000100:00100000:2.0:1790945966.139015:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83faaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+56:12294:x1877942616538880:12345-192.168.204.20@tcp:101:bash.0 Request processed in 8456us (8788us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945966.139023:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 176 00000100:00100000:1.0:1790945966.145685:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945966.146667:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616539264 00000100:00100000:3.0:1790945966.146679:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616539264 00000100:00100000:3.0:1790945966.146744:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 45 00000100:00100000:3.0:1790945966.146755:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8456a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+56:12294:x1877942616539264:12345-192.168.204.20@tcp:35:bash.0 00000100:00100000:3.0:1790945966.146980:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8456a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+57:12294:x1877942616539264:12345-192.168.204.20@tcp:35:bash.0 Request processed in 227us (1306us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1790945966.146987:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 45 00000100:00100000:1.0:1790945966.232433:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945966.232525:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616539520 00000100:00100000:3.0:1790945966.232567:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616539520 00000100:00100000:3.0:1790945966.232629:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 177 00000100:00100000:3.0:1790945966.232654:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83fbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+57:12304:x1877942616539520:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1790945966.232681:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945966.232704:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27dd2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330d6d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945966.232800:0:6522:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1790945966.232895:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27dd2a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d6d expref: 59 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945966.232909:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3f824ef400) 00010000:00010000:3.0:1790945966.232912:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790945966.232917:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27dd2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d6d expref: 59 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945966.232942:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4080030a00, rc 0) 00000100:00100000:3.0:1790945966.233003:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83fbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+58:12304:x1877942616539520:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 352us (579us total) trans 4294967453 rc 301/301 00000100:00100000:3.0:1790945966.233011:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 177 00000100:00100000:0.0:1790945966.240815:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945966.241012:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616539648 00000100:00100000:2.0:1790945966.241022:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616539648 00000100:00100000:2.0:1790945966.241081:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 178 00000100:00100000:2.0:1790945966.241092:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+58:12304:x1877942616539648:12345-192.168.204.20@tcp:34:lfs.0 00010000:00010000:2.0:1790945966.241482:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64a00/0xd9f4181e0d27dd38 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.241511:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64a00/0xd9f4181e0d27dd38 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.241525:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64a00/0xd9f4181e0d27dd38 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.241550:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64400/0xd9f4181e0d27dd3f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.241557:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64400/0xd9f4181e0d27dd3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.241563:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64400/0xd9f4181e0d27dd3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.241678:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27dd46 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.241688:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27dd46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.241696:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27dd46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790945966.241739:0:8457:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27dd46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.241763:0:8457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64a00/0xd9f4181e0d27dd38 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.241770:0:8457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64a00/0xd9f4181e0d27dd38 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.241776:0:8457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64a00/0xd9f4181e0d27dd38 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.241780:0:8457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c64a00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945966.241784:0:8457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64a00/0xd9f4181e0d27dd38 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.241791:0:8457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64a00/0xd9f4181e0d27dd38 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.241802:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d3f824ef900) 00010000:00010000:2.0:1790945966.241804:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945966.241808:0:8457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64a00/0xd9f4181e0d27dd38 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.241813:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64a00/0xd9f4181e0d27dd38 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.241826:0:8457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64400/0xd9f4181e0d27dd3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.241831:0:8457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64400/0xd9f4181e0d27dd3f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.241836:0:8457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64400/0xd9f4181e0d27dd3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.241847:0:8457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c64400 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945966.241851:0:8457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64400/0xd9f4181e0d27dd3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.241857:0:8457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64400/0xd9f4181e0d27dd3f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.241863:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d3f824ef800) 00010000:00010000:2.0:1790945966.241865:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945966.241868:0:8457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64400/0xd9f4181e0d27dd3f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.241873:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64400/0xd9f4181e0d27dd3f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.241882:0:8457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27dd46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.241887:0:8457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27dd46 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.241892:0:8457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27dd46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.241897:0:8457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c64800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945966.241900:0:8457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27dd46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.241905:0:8457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27dd46 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.241922:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d40bc937700) 00010000:00010000:2.0:1790945966.241924:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945966.241928:0:8457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27dd46 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.241933:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27dd46 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945966.242053:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+58:12304:x1877942616539648:12345-192.168.204.20@tcp:34:lfs.0 Request processed in 962us (1246us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945966.242062:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 178 00000100:00100000:1.0:1790945966.245509:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945966.245712:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616539904 00000100:00100000:3.0:1790945966.245721:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616539904 00000100:00100000:3.0:1790945966.245797:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 46 00000100:00100000:3.0:1790945966.245807:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83fbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+58:12304:x1877942616539904:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:3.0:1790945966.246005:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83fbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+59:12304:x1877942616539904:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 198us (512us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1790945966.246013:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 46 00000040:00080000:0.0:1790945966.304761:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790945966.306752:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945966.306855:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616540160 00000100:00100000:2.0:1790945966.306866:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616540160 00000100:00100000:2.0:1790945966.307002:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 179 00000100:00100000:2.0:1790945966.307013:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83fbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+59:12307:x1877942616540160:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1790945966.307048:0:13005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945966.307079:0:13005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27dd4d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330d74 expref: -99 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.307208:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64400/0xd9f4181e0d27dd54 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.307224:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64400/0xd9f4181e0d27dd54 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.307235:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64400/0xd9f4181e0d27dd54 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.307247:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64a00/0xd9f4181e0d27dd5b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.307271:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64a00/0xd9f4181e0d27dd5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.307277:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64a00/0xd9f4181e0d27dd5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.307379:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27dd62 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.307390:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27dd62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.307396:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27dd62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945966.307405:0:13005:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1790945966.307476:0:13005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64400/0xd9f4181e0d27dd54 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.307483:0:13005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64400/0xd9f4181e0d27dd54 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.307490:0:13005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64400/0xd9f4181e0d27dd54 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.307495:0:13005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c64400 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945966.307499:0:13005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64400/0xd9f4181e0d27dd54 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.307505:0:13005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64400/0xd9f4181e0d27dd54 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.307537:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d3f824ef900) 00010000:00010000:2.0:1790945966.307541:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945966.307546:0:13005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64400/0xd9f4181e0d27dd54 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.307552:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64400/0xd9f4181e0d27dd54 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.307565:0:13005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64a00/0xd9f4181e0d27dd5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.307571:0:13005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64a00/0xd9f4181e0d27dd5b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.307576:0:13005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64a00/0xd9f4181e0d27dd5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.307581:0:13005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c64a00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945966.307584:0:13005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64a00/0xd9f4181e0d27dd5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.307589:0:13005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64a00/0xd9f4181e0d27dd5b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.307596:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d3f824ef800) 00010000:00010000:2.0:1790945966.307599:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945966.307601:0:13005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64a00/0xd9f4181e0d27dd5b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.307608:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64a00/0xd9f4181e0d27dd5b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.307654:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27dd4d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d74 expref: 62 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.307668:0:13005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27dd62 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d74 expref: 61 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.307675:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d40bc937700) 00010000:00010000:2.0:1790945966.307677:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790945966.307680:0:13005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c65000, rc 0) 00000100:00100000:2.0:1790945966.307848:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83fbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+61:12307:x1877942616540160:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 835us (1105us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1790945966.307856:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 179 00000100:00100000:0.0:1790945966.311803:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945966.311849:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945966.311875:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616540288 00000100:00100000:2.0:1790945966.311897:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616540288 00000100:00100000:2.0:1790945966.311960:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 180 00000100:00100000:2.0:1790945966.311971:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83fa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+61:12307:x1877942616540288:12345-192.168.204.20@tcp:54:lfs.0 00010000:00010000:2.0:1790945966.312039:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27dd70 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.312056:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27dd70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.312067:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27dd70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.312100:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27dd70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.312124:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27dd70 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.312132:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27dd70 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945966.312134:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616540416 00010000:00010000:2.0:1790945966.312139:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945966.312145:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27dd70 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945966.312148:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616540416 00010000:00010000:2.0:1790945966.312157:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27dd70 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.312205:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d40bc937700) 00010000:00010000:2.0:1790945966.312209:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790945966.312216:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27dd70 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.312223:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27dd70 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945966.312230:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:3.0:1790945966.312243:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83faad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+62:2401:x1877942616540416:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790945966.312257:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945966.312274:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27dd62 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d74 expref: 62 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945966.312288:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d40bc937700) 00010000:00010000:3.0:1790945966.312293:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945966.312310:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83fa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+61:12307:x1877942616540288:12345-192.168.204.20@tcp:54:lfs.0 Request processed in 340us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945966.312321:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 180 00000100:00100000:3.0:1790945966.312324:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83faad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+61:2401:x1877942616540416:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 80us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945966.312334:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:1.0:1790945966.314020:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945966.314066:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616540672 00000100:00100000:2.0:1790945966.314076:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616540672 00000100:00100000:2.0:1790945966.314129:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 47 00000100:00100000:2.0:1790945966.314137:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+60:12307:x1877942616540672:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:2.0:1790945966.314367:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+61:12307:x1877942616540672:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 230us (351us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1790945966.314382:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 47 00000100:00100000:1.0:1790945966.427645:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945966.428052:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616540928 00000100:00100000:2.0:1790945966.428120:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616540928 00000100:00100000:2.0:1790945966.428220:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 181 00000100:00100000:2.0:1790945966.428493:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+61:12325:x1877942616540928:12345-192.168.204.20@tcp:101:cat.0 00010000:00010000:2.0:1790945966.428542:0:8457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945966.428565:0:8457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27dd77 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330d7b expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.428674:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27dd7e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.428690:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27dd7e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.428701:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27dd7e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945966.428711:0:8457:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1790945966.428815:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27dd77 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d7b expref: 64 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.428833:0:8457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27dd7e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d7b expref: 63 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.428842:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d40bc937700) 00010000:00010000:2.0:1790945966.428845:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1790945966.428848:0:8457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c64800, rc 0) 00000100:00100000:2.0:1790945966.428929:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+63:12325:x1877942616540928:12345-192.168.204.20@tcp:101:cat.0 Request processed in 700us (1295us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1790945966.428937:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 181 00000100:00100000:0.0:1790945966.454356:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945966.454464:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616541056 00000100:00100000:2.0:1790945966.454474:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616541056 00000100:00100000:2.0:1790945966.454560:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 182 00000100:00100000:2.0:1790945966.454570:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83fa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+63:12326:x1877942616541056:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1790945966.454596:0:13005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945966.454618:0:13005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27dd8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330d82 expref: -99 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.454767:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64a00/0xd9f4181e0d27dd93 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.454782:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64a00/0xd9f4181e0d27dd93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.454792:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64a00/0xd9f4181e0d27dd93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945966.454835:0:13005:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1790945966.454839:0:13005:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790945966.454856:0:13005:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64a00/0xd9f4181e0d27dd93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.454883:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27dd8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d82 expref: 65 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.455340:0:13005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64a00/0xd9f4181e0d27dd93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d82 expref: 64 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.455370:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d3f824ef900) 00010000:00010000:2.0:1790945966.455374:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790945966.455377:0:13005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c64a00, rc 0) 00000100:00100000:2.0:1790945966.455445:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83fa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+64:12326:x1877942616541056:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 876us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945966.455453:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 182 00000100:00100000:1.0:1790945966.459159:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945966.459220:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616541440 00000100:00100000:2.0:1790945966.459243:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616541440 00000100:00100000:2.0:1790945966.459313:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 48 00000100:00100000:2.0:1790945966.459324:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+64:12326:x1877942616541440:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:2.0:1790945966.459745:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+65:12326:x1877942616541440:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 422us (595us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1790945966.459754:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 48 00000100:00100000:1.0:1790945966.462448:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945966.462704:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616541568 00000100:00100000:0.0:1790945966.462715:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616541568 00000100:00100000:0.0:1790945966.462787:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 14 00000100:00100000:0.0:1790945966.462802:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ff1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+65:12326:x1877942616541568:12345-192.168.204.20@tcp:103:lfs.0 00010000:00010000:0.0:1790945966.462819:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1790945966.462840:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65200/0xd9f4181e0d27dd23 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d66 expref: 65 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945966.462882:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27dd7e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d7b expref: 64 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945966.462894:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27dc20 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d20 expref: 63 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945966.462904:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d40bc937700) 00010000:00010000:0.0:1790945966.462908:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945966.462968:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ff1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+62:12326:x1877942616541568:12345-192.168.204.20@tcp:103:lfs.0 Request processed in 167us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945966.462978:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 14 00000100:00100000:1.0:1790945966.468290:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945966.468758:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616541696 00000100:00100000:2.0:1790945966.468769:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616541696 00000100:00100000:2.0:1790945966.468834:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 183 00000100:00100000:2.0:1790945966.468845:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+62:12326:x1877942616541696:12345-192.168.204.20@tcp:58:lfs.0 00010000:00010000:2.0:1790945966.469032:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27dd9a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.469051:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27dd9a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.469062:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27dd9a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790945966.469201:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1790945966.469292:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+62:12326:x1877942616541696:12345-192.168.204.20@tcp:58:lfs.0 Request processed in 447us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945966.469300:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 183 00000100:00100000:1.0:1790945966.490638:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945966.490814:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616541824 00000100:00100000:2.0:1790945966.490825:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616541824 00000100:00100000:2.0:1790945966.490890:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 184 00000100:00100000:2.0:1790945966.490901:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+62:12328:x1877942616541824:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1790945966.490920:0:8457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945966.490940:0:8457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64400/0xd9f4181e0d27dda1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330d89 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.491004:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27dda8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.491020:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27dda8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.491040:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27dda8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.491055:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27ddaf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.491063:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27ddaf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.491070:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27ddaf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.491579:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64600/0xd9f4181e0d27ddb6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.491593:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64600/0xd9f4181e0d27ddb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.491605:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64600/0xd9f4181e0d27ddb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945966.491945:0:8457:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1790945966.491950:0:8457:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790945966.491971:0:8457:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64600/0xd9f4181e0d27ddb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.491984:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64600/0xd9f4181e0d27ddb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.491993:0:8457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27dda8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.492000:0:8457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27dda8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.492008:0:8457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27dda8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.492014:0:8457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65e00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945966.492018:0:8457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27dda8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.492027:0:8457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27dda8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.492048:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d3f824ef900) 00010000:00010000:2.0:1790945966.492051:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945966.492056:0:8457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27dda8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.492063:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27dda8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.492078:0:8457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27ddaf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.492086:0:8457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27ddaf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.492092:0:8457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27ddaf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.492098:0:8457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65a00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945966.492100:0:8457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27ddaf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.492107:0:8457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27ddaf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.492114:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d3f824ef800) 00010000:00010000:2.0:1790945966.492117:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945966.492120:0:8457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27ddaf lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.492126:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27ddaf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.492738:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64400/0xd9f4181e0d27dda1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d89 expref: 64 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.492760:0:8457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64600/0xd9f4181e0d27ddb6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d89 expref: 63 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945966.492768:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d40bc937700) 00010000:00010000:2.0:1790945966.492770:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790945966.492773:0:8457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c64600, rc 0) 00000100:00100000:2.0:1790945966.492846:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+63:12328:x1877942616541824:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 1947us (2281us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945966.492855:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 184 00010000:00010000:0.0:1790945966.559295:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790945967.093700:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790945967.093720:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790945967.093746:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1790945967.093753:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790945967.094213:0:13803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84473b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13803:1877942638621824:192.168.204.20@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790945967.094307:0:13803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40c2162480 going to sleep for 11 seconds 00000100:00100000:2.0:1790945967.101417:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945967.101452:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616541952 00000100:00100000:2.0:1790945967.101461:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616541952 00000100:00100000:2.0:1790945967.101531:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 185 00000100:00100000:2.0:1790945967.101543:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84473480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+64:12339:x1877942616541952:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790945967.101578:0:13005:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790945967.101719:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84473480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+64:12339:x1877942616541952:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 Request processed in 179us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945967.101744:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 185 00000100:00100000:3.0:1790945967.102031:0:13803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84473b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13803:1877942638621824:192.168.204.20@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790945967.122727:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945967.123190:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616542080 00000100:00100000:3.0:1790945967.123201:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616542080 00000100:00100000:3.0:1790945967.123261:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 186 00000100:00100000:3.0:1790945967.123271:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+63:12339:x1877942616542080:12345-192.168.204.20@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1790945967.123359:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27ddbd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.123376:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27ddbd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.123387:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27ddbd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.123444:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27ddc4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.123473:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27ddc4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.123481:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27ddc4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.123523:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27ddcb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.123534:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27ddcb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.123541:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27ddcb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945967.123588:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1790945967.123592:0:6523:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790945967.123606:0:6523:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27ddcb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.123619:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27ddbd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.123626:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27ddbd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.123633:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27ddbd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.123640:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080030a00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945967.123645:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27ddbd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.123660:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27ddbd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.123673:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3f824ec400) 00010000:00010000:3.0:1790945967.123675:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945967.123680:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27ddbd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.123686:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27ddbd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.123697:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27ddc4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.123703:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27ddc4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.123709:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27ddc4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.123715:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080031800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945967.123718:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27ddc4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.123725:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27ddc4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.123732:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9d3f8259f600) 00010000:00010000:3.0:1790945967.123735:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945967.123738:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27ddc4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.123753:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27ddc4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.123769:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27ddcb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.123776:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27ddcb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.123782:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27ddcb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.123787:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40813ff800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945967.123790:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27ddcb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.123796:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27ddcb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.123805:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d40bc937700) 00010000:00010000:3.0:1790945967.123807:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945967.123810:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27ddcb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.123816:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27ddcb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945967.123887:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+63:12339:x1877942616542080:12345-192.168.204.20@tcp:34:lhsmtool_posix.0 Request processed in 617us (1172us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945967.134775:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 186 00000100:00100000:0.0:1790945967.140711:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945967.142748:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616542336 00000100:00100000:3.0:1790945967.142766:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616542336 00000100:00100000:3.0:1790945967.142852:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 187 00000100:00100000:3.0:1790945967.142863:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83fab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+63:12339:x1877942616542336:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790945967.142887:0:8457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945967.142909:0:8457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27ddd2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330d90 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.143032:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6a00/0xd9f4181e0d27ddd9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.143052:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6a00/0xd9f4181e0d27ddd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.143066:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6a00/0xd9f4181e0d27ddd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945967.143078:0:8457:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1790945967.143864:0:8457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6a00/0xd9f4181e0d27ddd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.143879:0:8457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6a00/0xd9f4181e0d27ddd9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.143887:0:8457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6a00/0xd9f4181e0d27ddd9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.143894:0:8457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d6a00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945967.143900:0:8457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6a00/0xd9f4181e0d27ddd9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.143909:0:8457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6a00/0xd9f4181e0d27ddd9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.143949:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d40bc937700) 00010000:00010000:3.0:1790945967.143952:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790945967.143958:0:8457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6a00/0xd9f4181e0d27ddd9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.143965:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6a00/0xd9f4181e0d27ddd9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.144019:0:8457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27ddd2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d90 expref: 65 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.144030:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3f824ec400) 00010000:00010000:3.0:1790945967.144033:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790945967.144037:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27ddd2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d90 expref: 65 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.144048:0:8457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40813fea00, rc 0) 00000100:00100000:3.0:1790945967.144140:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83fab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+64:12339:x1877942616542336:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 1278us (3443us total) trans 4294967459 rc 301/301 00000100:00100000:3.0:1790945967.150088:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 187 00000100:00100000:1.0:1790945967.165146:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945967.170001:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616542464 00000100:00100000:2.0:1790945967.170015:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616542464 00000100:00100000:2.0:1790945967.170075:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 188 00000100:00100000:2.0:1790945967.170084:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+64:12339:x1877942616542464:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790945967.170121:0:6522:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790945967.170425:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+64:12339:x1877942616542464:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 Request processed in 341us (5287us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945967.170433:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 188 00000100:00100000:1.0:1790945967.179043:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945967.179777:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616542720 00000100:00100000:3.0:1790945967.179788:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616542720 00000100:00100000:3.0:1790945967.179848:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 189 00000100:00100000:3.0:1790945967.179859:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+64:12339:x1877942616542720:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790945967.179881:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945967.179884:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790945967.179910:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64a00/0xd9f4181e0d27dd93 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d82 expref: 64 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.179938:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d3f824ef900) 00010000:00010000:3.0:1790945967.179943:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790945967.179957:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6a00/0xd9f4181e0d27dde7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330d97 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790945967.180370:0:6523:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:3.0:1790945967.180780:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27ddee lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.180795:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27ddee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.180806:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27ddee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.180861:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6a00/0xd9f4181e0d27dde7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d97 expref: 66 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.180877:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27ddee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d97 expref: 65 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.180885:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d3f8259f600) 00010000:00010000:3.0:1790945967.180888:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790945967.180891:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40c21d6800, rc 0) 00000100:00100000:3.0:1790945967.183953:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+65:12339:x1877942616542720:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 4083us (4912us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1790945967.183965:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 189 00000100:00100000:2.0:1790945967.191733:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945967.191805:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616542976 00000100:00100000:3.0:1790945967.191816:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616542976 00000100:00100000:3.0:1790945967.191877:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 190 00000100:00100000:3.0:1790945967.191887:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84471f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+65:12339:x1877942616542976:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790945967.191954:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945967.191985:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27ddee lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d97 expref: 65 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.192003:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d3f8259f600) 00010000:00010000:3.0:1790945967.192013:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790945967.192042:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27ddfc lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.192058:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27ddfc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.192068:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27ddfc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.192138:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27de03 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x3dace23d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.192607:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27de03 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x3dace23d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.192617:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27de03 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x3dace23d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.192668:0:8457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27ddfc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.192692:0:8457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27ddfc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.192698:0:8457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27ddfc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.192703:0:8457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40813fea00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945967.192709:0:8457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27ddfc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.192716:0:8457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27ddfc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.192726:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d3f824ef900) 00010000:00010000:3.0:1790945967.192729:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945967.192733:0:8457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27ddfc lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.192739:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27ddfc lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.192750:0:8457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27de03 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x3dace23d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.192756:0:8457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27de03 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x3dace23d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.192761:0:8457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27de03 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x3dace23d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.192766:0:8457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40813ff800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945967.192775:0:8457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27de03 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x3dace23d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.192781:0:8457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27de03 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x3dace23d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.192789:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x3dace23d (ffff9d3f8259f200) 00010000:00010000:3.0:1790945967.192791:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945967.192793:0:8457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27de03 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x3dace23d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.192798:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27de03 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x3dace23d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945967.192888:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84471f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+64:12339:x1877942616542976:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 1001us (1164us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790945967.192897:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 190 00000100:00100000:3.0:1790945967.209735:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945967.211371:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616543104 00000100:00100000:1.0:1790945967.211382:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616543104 00000100:00100000:0.0:1790945967.211666:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 191 00000100:00100000:0.0:1790945967.211677:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83eb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+64:12339:x1877942616543104:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790945967.211702:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945967.211727:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27de0a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330d9e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.211765:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27de11 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.211779:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27de11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.211789:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27de11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.211903:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27de0a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d9e expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.211919:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27de11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d9e expref: 65 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.211928:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d40bc937d00) 00010000:00010000:0.0:1790945967.211931:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790945967.211934:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe1a00, rc 0) 00000100:00100000:0.0:1790945967.212061:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83eb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+65:12339:x1877942616543104:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 384us (2337us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945967.212069:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 191 00000100:00100000:0.0:1790945967.219226:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945967.220979:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616543360 00000100:00100000:1.0:1790945967.220991:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616543360 00000100:00100000:1.0:1790945967.221052:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 192 00000100:00100000:1.0:1790945967.221062:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83faa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+65:12339:x1877942616543360:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790945967.221141:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27de18 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.221158:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27de18 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.221185:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27de18 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790945967.221343:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1790945967.221353:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 418037184759ns, next at 419037182229ns, rc = 0 00000004:00010000:1.0:1790945967.221401:0:6523:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a0ce4233 reply state 0000000038410b0d transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27de18 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.221414:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27de18 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.221422:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d40bc937d00) 00010000:00010000:1.0:1790945967.221425:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1790945967.221428:0:6523:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790945967.221542:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83faa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+67:12339:x1877942616543360:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 481us (2325us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1790945967.221549:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 192 00000100:00100000:0.0:1790945967.224891:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945967.227736:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616543488 00000100:00100000:3.0:1790945967.227749:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616543488 00000100:00100000:3.0:1790945967.227868:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 193 00000100:00100000:3.0:1790945967.227880:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83faa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+67:12339:x1877942616543488:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790945967.227909:0:8457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945967.227929:0:8457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27de1f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330da5 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.227981:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27de1f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330da5 expref: 68 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.227995:0:8457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27de1f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330da5 expref: 68 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.228024:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d40bc937d00) 00010000:00010000:3.0:1790945967.228027:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790945967.228030:0:8457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40813ff800, rc 0) 00000100:00100000:3.0:1790945967.228098:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83faa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+68:12339:x1877942616543488:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 221us (3218us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945967.228105:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 193 00000100:00100000:1.0:1790945967.238597:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945967.238885:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616543616 00000100:00100000:3.0:1790945967.238895:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616543616 00000100:00100000:3.0:1790945967.238979:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 58 00000100:00100000:3.0:1790945967.238990:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ff3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+6:2403:x1877942616543616:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1790945967.239264:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ff3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:2403:x1877942616543616:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 Request processed in 276us (676us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1790945967.239272:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 58 00000100:00080000:2.0:1790945967.239700:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790945967.242657:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945967.242725:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616543872 00000100:00100000:3.0:1790945967.242736:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616543872 00000100:00100000:3.0:1790945967.242815:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 49 00000100:00100000:3.0:1790945967.242825:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84471c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+68:12339:x1877942616543872:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790945967.243059:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84471c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+69:12339:x1877942616543872:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 Request processed in 235us (412us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1790945967.243066:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 49 00000100:00100000:1.0:1790945967.249979:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945967.250059:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616544128 00000100:00100000:3.0:1790945967.250069:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616544128 00000100:00100000:3.0:1790945967.250143:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 194 00000100:00100000:3.0:1790945967.250717:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+69:12339:x1877942616544128:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790945967.250849:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+69:12339:x1877942616544128:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 138us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945967.255080:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 194 00000100:00100000:1.0:1790945967.255325:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945967.255399:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616544256 00000100:00100000:2.0:1790945967.255408:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616544256 00000100:00100000:2.0:1790945967.255452:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 195 00000100:00100000:2.0:1790945967.255461:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+69:12339:x1877942616544256:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790945967.255494:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945967.255525:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64400/0xd9f4181e0d27de26 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330dac expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.255596:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27de2d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.255612:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27de2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.255623:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27de2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945967.255679:0:6522:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790945967.255700:0:6522:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27de2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.255726:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64400/0xd9f4181e0d27de26 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330dac expref: 71 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.255743:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27de2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330dac expref: 70 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.255752:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d40bc937d00) 00010000:00010000:2.0:1790945967.255754:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790945967.255758:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c64800, rc 0) 00000100:00100000:2.0:1790945967.255817:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+70:12339:x1877942616544256:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 357us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945967.255825:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 195 00000100:00100000:3.0:1790945967.259056:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945967.259104:0:8436:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616544384 00000100:00100000:3.0:1790945967.259114:0:8436:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616544384 00000100:00100000:3.0:1790945967.259196:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 59 00000100:00100000:3.0:1790945967.259207:0:8436:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83eb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:2404:x1877942616544384:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790945967.259227:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945967.259247:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a7d99fb/0xd9f4181e0d27de34 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330db3 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790945967.259274:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abfaaaf, blocks: 0x0 00010000:00010000:3.0:1790945967.259294:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=418s v=(0 0) 00010000:00010000:3.0:1790945967.259299:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945967.259310:0:8436:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a7d99fb/0xd9f4181e0d27de34 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330db3 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.259329:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004a7d99fb/0xd9f4181e0d27de34 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330db3 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.259750:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40813fea00, rc 0) 00000100:00100000:3.0:1790945967.259852:0:8436:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83eb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+8:2404:x1877942616544384:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 646us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945967.259861:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 59 00000100:00100000:1.0:1790945967.274902:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945967.274985:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616544640 00000100:00100000:3.0:1790945967.274994:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616544640 00000100:00100000:3.0:1790945967.275054:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 196 00000100:00100000:3.0:1790945967.275065:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ff0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+70:12339:x1877942616544640:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790945967.275806:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ff0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+70:12339:x1877942616544640:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 740us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945967.275817:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 196 00000100:00100000:0.0:1790945967.279627:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945967.279711:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616544768 00000100:00100000:3.0:1790945967.279722:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616544768 00000100:00100000:3.0:1790945967.279810:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 60 00000100:00100000:3.0:1790945967.279820:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83fa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+8:12339:x1877942616544768:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790945967.279838:0:8916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945967.279857:0:8916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029c6f988/0xd9f4181e0d27de3b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330dba expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.279889:0:8916:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004a7d99fb/0xd9f4181e0d27de34 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330db3 expref: 9 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.279898:0:8916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945967.279902:0:8916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945967.279908:0:8916:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029c6f988/0xd9f4181e0d27de3b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330dba expref: 9 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.279946:0:8916:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004a7d99fb/0xd9f4181e0d27de34 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330db3 expref: 9 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.279960:0:8916:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004a7d99fb/0xd9f4181e0d27de34 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330db3 expref: 9 pid: 8436 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945967.279994:0:8916:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83eb3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8916:1877942638621952:192.168.204.20@tcp:104: 00000100:00100000:3.0:1790945967.280121:0:8916:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f81b86b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790945967.284830:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945967.284904:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616544896 00000100:00100000:1.0:1790945967.284915:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616544896 00010000:00010000:1.0:1790945967.284955:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004a7d99fb/0xd9f4181e0d27de34 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330db3 expref: 10 pid: 8436 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945967.285004:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 88 00000100:00100000:1.0:1790945967.285014:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84471880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+10:2403:x1877942616544896:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790945967.285028:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945967.285050:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004a7d99fb/0xd9f4181e0d27de34 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330db3 expref: 10 pid: 8436 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.285063:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004a7d99fb/0xd9f4181e0d27de34 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330db3 expref: 10 pid: 8436 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.285088:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945967.285092:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945967.285100:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000029c6f988/0xd9f4181e0d27de3b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330dba expref: 10 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.285111:0:6507:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029c6f988/0xd9f4181e0d27de3b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330dba expref: 10 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.285161:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000029c6f988/0xd9f4181e0d27de3b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330dba expref: 10 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945967.285215:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83ff3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6507:1877942638622080:192.168.204.20@tcp:105: 00000100:00100000:1.0:1790945967.285306:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408704f240 going to sleep for 11 seconds 00010000:00010000:3.0:1790945967.285564:0:8916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a7d99fb/0xd9f4181e0d27de34 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330db3 expref: 10 pid: 8436 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945967.285582:0:8916:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83eb3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8916:1877942638621952:192.168.204.20@tcp:104: 00010000:00010000:3.0:1790945967.285609:0:8916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000029c6f988/0xd9f4181e0d27de3b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330dba expref: 9 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.285619:0:8916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40c21d6800, rc 0) 00000100:00100000:3.0:1790945967.285654:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83fa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+9:12339:x1877942616544768:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 5836us (6037us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945967.285661:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 60 00000100:00100000:1.0:1790945967.289826:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83ff3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6507:1877942638622080:192.168.204.20@tcp:105: 00010000:00010000:1.0:1790945967.289853:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945967.289915:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84471880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+8:2403:x1877942616544896:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 4901us (5093us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945967.289928:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 88 00000100:00100000:1.0:1790945967.298624:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945967.299900:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616545024 00000100:00100000:0.0:1790945967.299914:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616545024 00002000:00100000:1.0:1790945967.300053:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9d3f83ff3800 x1877942616545024/t0(0) o4->0cadc7a5-c0ba-4320-984f-d871ffb3a3ef@192.168.204.20@tcp:663/0 lens 504/0 e 0 to 0 dl 1790945978 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790945967.300065:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3f83ff3800 with x1877942616545024 ext(0->8) 00002000:00010000:1.0:1790945967.300072:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d3f83ff3800 00000100:00100000:1.0:1790945967.300139:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4 00000100:00100000:1.0:1790945967.300161:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ff3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+8:2403:x1877942616545024:12345-192.168.204.20@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1790945967.302033:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ff3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+10:2403:x1877942616545024:12345-192.168.204.20@tcp:4:lhsmtool_posix.0 Request processed in 1863us (3408us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1790945967.302047:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4 00002000:00100000:1.0:1790945967.302058:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9d3f83ff3800 x1877942616545024/t4294967315(0) o4->0cadc7a5-c0ba-4320-984f-d871ffb3a3ef@192.168.204.20@tcp:663/0 lens 504/448 e 0 to 0 dl 1790945978 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790945967.302068:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3f83ff3800 with x1877942616545024 ext(0->8) 00002000:00010000:1.0:1790945967.302074:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d3f83ff3800 00000100:00100000:0.0:1790945967.306089:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945967.306219:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616545152 00000100:00100000:3.0:1790945967.306230:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616545152 00000100:00100000:3.0:1790945967.306284:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 197 00000100:00100000:3.0:1790945967.306293:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83fab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+70:12339:x1877942616545152:12345-192.168.204.20@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1790945967.308844:0:6500:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:0.0:1790945967.308863:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00010000:00010000:1.0:1790945967.308956:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27db63 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.308980:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27db63 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.308988:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27db63 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.308995:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f8363ca00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:1.0:1790945967.309000:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27db63 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.309009:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27db63 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.309024:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9d3f824efd00) 00010000:00010000:1.0:1790945967.309027:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945967.309032:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27db63 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.309038:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363ca00/0xd9f4181e0d27db63 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.309060:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27db6a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.309065:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27db6a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.309071:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27db6a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.309076:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f8363d400 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:1.0:1790945967.309085:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27db6a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.309091:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27db6a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.309099:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d3f824ef900) 00010000:00010000:1.0:1790945967.309102:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945967.309105:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27db6a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.309110:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d400/0xd9f4181e0d27db6a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.309124:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27dba9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.309130:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27dba9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.309136:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27dba9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.309140:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f8363c200 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:1.0:1790945967.309154:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27dba9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.309160:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27dba9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.309200:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d3f824ef800) 00010000:00010000:1.0:1790945967.309203:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945967.309213:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27dba9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.309219:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c200/0xd9f4181e0d27dba9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.309235:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27dcac lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.309241:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27dcac lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.309246:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27dcac lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.309251:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe1e00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:1.0:1790945967.309254:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27dcac lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.309259:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27dcac lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.309267:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d40bc937700) 00010000:00010000:1.0:1790945967.309269:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945967.309272:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27dcac lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.309277:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1e00/0xd9f4181e0d27dcac lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.309285:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27dccf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.309290:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27dccf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.309302:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27dccf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.309307:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080031400 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:1.0:1790945967.309310:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27dccf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.309316:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27dccf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.309323:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d40bc937700) 00010000:00010000:1.0:1790945967.309325:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945967.309328:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27dccf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.309351:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27dccf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.309365:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27dd15 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.309371:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27dd15 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.309376:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27dd15 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.309380:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0c00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:1.0:1790945967.309383:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27dd15 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.309398:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27dd15 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.309406:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d40bc937700) 00010000:00010000:1.0:1790945967.309408:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945967.309411:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27dd15 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.309415:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27dd15 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.309427:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27de18 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.309433:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27de18 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.309439:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27de18 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.309444:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afca00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:1.0:1790945967.309447:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27de18 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.309453:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27de18 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.309460:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d40bc937d00) 00010000:00010000:1.0:1790945967.309462:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790945967.309465:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27de18 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.309493:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27de18 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945967.309967:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83eb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638622208:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1790945967.310038:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945967.310125:0:10099:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638622208 00000100:00100000:2.0:1790945967.310133:0:10099:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638622208 00000100:00100000:2.0:1790945967.310221:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790945967.310231:0:10099:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638622208:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1790945967.310384:0:10099:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1790945967.310387:0:10099:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1790945967 00002000:00010000:2.0:1790945967.310390:0:10099:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1790945967.310392:0:10099:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1790945967 -> 1790945967 00002000:00010000:2.0:1790945967.310395:0:10099:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000004:00080000:0.0:1790945967.310816:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1790945967.310833:0:6500:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d408704f600 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1790945967.310837:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d40bca9e400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d408704f3c0 00000020:00080000:0.0:1790945967.310850:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d40bca9ec00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d408aadc400 00000100:00100000:3.0:1790945967.311060:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83fab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+19:12339:x1877942616545152:12345-192.168.204.20@tcp:44:lhsmtool_posix.0 Request processed in 4765us (4978us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945967.311070:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 197 00000100:00080000:3.0:1790945967.312801:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790945967.312988:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83fa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638622336:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1790945967.313043:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945967.313192:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638622336 00000100:00100000:0.0:1790945967.313200:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638622336 00000100:00100000:0.0:1790945967.313254:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790945967.313263:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83eb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1877942638622336:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1790945967.313289:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:0.0:1790945967.313319:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6abfaaac, atime: 0x6abfaaac, ctime: 0x6abfaaac, blocks: 0x8 00010000:00010000:0.0:1790945967.313326:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000309fc8f8/0xd9f4181e0d27de42 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.313582:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=418s v=(0 0) 00010000:00010000:0.0:1790945967.313587:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790945967.313594:0:8435:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000309fc8f8/0xd9f4181e0d27de42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.313611:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000309fc8f8/0xd9f4181e0d27de42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.313620:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000309fc8f8/0xd9f4181e0d27de42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.313629:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000309fc8f8/0xd9f4181e0d27de42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.313645:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790945967.313791:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83eb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3649:x1877942638622336:12345-0@lo:6:osp-syn-1-0.0 Request processed in 528us (746us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1790945967.313806:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00010000:3.0:1790945967.314132:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790945967.314139:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000309fc8f8/0xd9f4181e0d27de42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.314162:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0400 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:3.0:1790945967.314194:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000309fc8f8/0xd9f4181e0d27de42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.314205:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000309fc8f8/0xd9f4181e0d27de42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.314221:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000309fc8f8/0xd9f4181e0d27de42 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.314242:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000309fc8f8/0xd9f4181e0d27de42 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.314262:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945967.314264:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945967.314265:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790945967.314273:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1790945967.314308:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d3f83fa8e00/2, rc 0, transno 4294967308 00000100:00100000:3.0:1790945967.314313:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83fa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638622336:0@lo:6:osp-syn-1-0.0 00000020:00080000:3.0:1790945967.316067:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1790945967.316139:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1790945967.316839:0:10099:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3648:x1877942638622208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 6606us (6796us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1790945967.316866:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790945967.317203:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945967.317284:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616545280 00000100:00100000:2.0:1790945967.317293:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616545280 00000100:00100000:2.0:1790945967.317354:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 63 00000100:00100000:2.0:1790945967.317363:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83fa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+10:2403:x1877942616545280:12345-192.168.204.20@tcp:16:lhsmtool_posix.0 00000004:00080000:1.0:1790945967.319320:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d3f83eb3100/2, rc 0, transno 4294967316 00000100:00100000:1.0:1790945967.319455:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83eb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638622208:0@lo:2:osp-syn-0-0.0 00000001:00080000:1.0:1790945967.326804:0:8429:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:1.0:1790945967.326819:0:8429:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:2.0:1790945967.326983:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83fa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:2403:x1877942616545280:12345-192.168.204.20@tcp:16:lhsmtool_posix.0 Request processed in 9614us (9775us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945967.326995:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 63 00000100:00100000:1.0:1790945967.338595:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945967.338675:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616545536 00000100:00100000:2.0:1790945967.338686:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616545536 00000100:00100000:2.0:1790945967.338748:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 198 00000100:00100000:2.0:1790945967.338757:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+19:12339:x1877942616545536:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790945967.338812:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945967.338841:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27de2d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330dac expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.338858:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d40bc937d00) 00010000:00010000:2.0:1790945967.338862:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790945967.338893:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27de49 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.338908:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27de49 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.338918:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27de49 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790945967.339047:0:6521:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007085cc3b reply state 00000000553ebb0a transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27de49 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.339071:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27de49 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.339078:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d40bc937d00) 00010000:00010000:2.0:1790945967.339080:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790945967.339083:0:6521:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790945967.339204:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+20:12339:x1877942616545536:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 447us (617us total) trans 4294967463 rc 0/0 00000100:00100000:2.0:1790945967.339211:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 198 00000100:00100000:3.0:1790945967.359998:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945967.360043:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616545664 00000100:00100000:3.0:1790945967.360053:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616545664 00000100:00100000:3.0:1790945967.360113:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 64 00000100:00100000:3.0:1790945967.360123:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83eb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:2404:x1877942616545664:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1790945967.360709:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1790945967.360714:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1790945967 -> 1790945966 00002000:00010000:3.0:1790945967.360717:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1790945964 00002000:00010000:3.0:1790945967.360719:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1790945967 -> 1790945966 00002000:00010000:3.0:1790945967.360721:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1790945967.360786:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83eb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+8:2404:x1877942616545664:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 Request processed in 663us (1317us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1790945967.360795:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 64 00000100:00100000:3.0:1790945967.362917:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945967.362963:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616545920 00000100:00100000:3.0:1790945967.362974:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616545920 00000100:00100000:3.0:1790945967.363027:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 199 00000100:00100000:3.0:1790945967.363037:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83eb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+20:12339:x1877942616545920:12345-192.168.204.20@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1790945967.363105:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27de50 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.363124:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27de11 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d9e expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.363134:0:8457:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27de50 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.366331:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27de11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d9e expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.366355:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27de11 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d9e expref: 20 pid: 6521 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945967.366379:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83eb3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8457:1877942638622464:192.168.204.20@tcp:104: 00000100:00100000:3.0:1790945967.366805:0:8457:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40811ca3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945967.371603:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83eb3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8457:1877942638622464:192.168.204.20@tcp:104: 00010000:00010000:3.0:1790945967.371633:0:8457:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27de50 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945967.373157:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945967.373276:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616546048 00000100:00100000:0.0:1790945967.373286:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616546048 00010000:00010000:0.0:1790945967.373333:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27de11 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d9e expref: 21 pid: 6521 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945967.373376:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 89 00000100:00100000:0.0:1790945967.373387:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4096cbb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+21:2404:x1877942616546048:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790945967.373405:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945967.373412:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27de11 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d9e expref: 21 pid: 6521 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.373425:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27de11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d9e expref: 21 pid: 6521 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.373448:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27de11 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d9e expref: 21 pid: 6521 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.373466:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d40bc937d00) 00010000:00010000:0.0:1790945967.373471:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27de50 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.373492:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27de50 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.373500:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27de50 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.373559:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945967.373620:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4096cbb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+20:2404:x1877942616546048:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 235us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945967.373628:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 89 00010000:00010000:1.0:1790945967.373795:0:8457:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27de50 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.373804:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27de50 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.373847:0:8457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27de50 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.373856:0:8457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27de50 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.373863:0:8457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27de50 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.373868:0:8457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40813fea00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:1.0:1790945967.373873:0:8457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27de50 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.373892:0:8457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27de50 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.373903:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d40bc937d00) 00010000:00010000:1.0:1790945967.373906:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1790945967.373910:0:8457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27de50 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.373916:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27de50 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945967.373962:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83eb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+19:12339:x1877942616545920:12345-192.168.204.20@tcp:55:lhsmtool_posix.0 Request processed in 10927us (11055us total) trans 0 rc -22/-22 00000100:00100000:1.0:1790945967.373970:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 199 00000100:00100000:2.0:1790945967.380652:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945967.385944:0:10099:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616546176 00000100:00100000:3.0:1790945967.385960:0:10099:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616546176 00000100:00100000:3.0:1790945967.386034:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 65 00000100:00100000:3.0:1790945967.386045:0:10099:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84472a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+8:2401:x1877942616546176:12345-192.168.204.20@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1790945967.386087:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007aabb7ae/0xd9f4181e0d27de57 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.386108:0:10099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000029c6f988/0xd9f4181e0d27de3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330dba expref: 8 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.386117:0:10099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945967.386121:0:10099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790945967.386126:0:10099:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007aabb7ae/0xd9f4181e0d27de57 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.386193:0:10099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000029c6f988/0xd9f4181e0d27de3b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330dba expref: 8 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.386222:0:10099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000029c6f988/0xd9f4181e0d27de3b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330dba expref: 8 pid: 8916 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945967.386358:0:10099:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83eb3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10099:1877942638622592:192.168.204.20@tcp:104: 00000100:00100000:3.0:1790945967.386445:0:10099:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40811ca3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945967.390000:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945967.390040:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616546304 00000100:00100000:3.0:1790945967.390049:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616546304 00010000:00010000:3.0:1790945967.390093:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000029c6f988/0xd9f4181e0d27de3b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330dba expref: 9 pid: 8916 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945967.390132:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 90 00000100:00100000:3.0:1790945967.390141:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+9:2403:x1877942616546304:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790945967.390291:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945967.390314:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000029c6f988/0xd9f4181e0d27de3b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330dba expref: 9 pid: 8916 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.390328:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000029c6f988/0xd9f4181e0d27de3b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330dba expref: 9 pid: 8916 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.390353:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790945967.390358:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790945967.390364:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007aabb7ae/0xd9f4181e0d27de57 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.390395:0:6508:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007aabb7ae/0xd9f4181e0d27de57 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.390418:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945967.390488:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+9:2403:x1877942616546304:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 335us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945967.390495:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 90 00010000:00010000:1.0:1790945967.390637:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029c6f988/0xd9f4181e0d27de3b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330dba expref: 8 pid: 8916 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945967.390652:0:10099:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83eb3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10099:1877942638622592:192.168.204.20@tcp:104: 00010000:00010000:1.0:1790945967.390674:0:10099:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007aabb7ae/0xd9f4181e0d27de57 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.390685:0:10099:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007aabb7ae/0xd9f4181e0d27de57 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.390693:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007aabb7ae/0xd9f4181e0d27de57 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.390726:0:10099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007aabb7ae/0xd9f4181e0d27de57 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.390735:0:10099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007aabb7ae/0xd9f4181e0d27de57 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.390743:0:10099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007aabb7ae/0xd9f4181e0d27de57 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.390750:0:10099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080031400 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:1.0:1790945967.390754:0:10099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007aabb7ae/0xd9f4181e0d27de57 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.390764:0:10099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007aabb7ae/0xd9f4181e0d27de57 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.390777:0:10099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007aabb7ae/0xd9f4181e0d27de57 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.390785:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007aabb7ae/0xd9f4181e0d27de57 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945967.390833:0:10099:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84472a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:2401:x1877942616546176:12345-192.168.204.20@tcp:1:lhsmtool_posix.0 Request processed in 4790us (10188us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945967.390841:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 65 00000100:00100000:3.0:1790945967.394036:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945967.398833:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616546560 00000100:00100000:1.0:1790945967.398886:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616546560 00000100:00100000:1.0:1790945967.398945:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 200 00000100:00100000:1.0:1790945967.398954:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ec3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+19:12339:x1877942616546560:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1790945967.399027:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27de5e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.399043:0:13005:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27dca5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d43 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.399053:0:13005:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27de5e lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.399083:0:13005:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27dca5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d43 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.399096:0:13005:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27dca5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d43 expref: 19 pid: 6521 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945967.399110:0:13005:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83ff0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13005:1877942638622720:192.168.204.20@tcp:104: 00000100:00100000:1.0:1790945967.399978:0:13005:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408704f240 going to sleep for 11 seconds 00000100:00100000:2.0:1790945967.404154:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945967.404347:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616546688 00000100:00100000:0.0:1790945967.404358:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616546688 00010000:00010000:0.0:1790945967.404399:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27dca5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d43 expref: 20 pid: 6521 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945967.404441:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 91 00000100:00100000:0.0:1790945967.404451:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84470a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+20:2404:x1877942616546688:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790945967.404464:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945967.404471:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27dca5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d43 expref: 20 pid: 6521 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.404595:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27dca5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d43 expref: 20 pid: 6521 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.404621:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d40bc937700) 00010000:00010000:0.0:1790945967.404626:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27de5e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.404637:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27de5e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.404645:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27de5e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.404682:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945967.404749:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84470a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+20:2404:x1877942616546688:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 299us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945967.404756:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 91 00010000:00010000:1.0:1790945967.407608:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27dca5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d43 expref: 19 pid: 6521 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945967.407634:0:13005:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83ff0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13005:1877942638622720:192.168.204.20@tcp:104: 00010000:00010000:1.0:1790945967.407661:0:13005:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27de5e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.407683:0:13005:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27de5e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.407690:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27de5e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.407867:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd800/0xd9f4181e0d27de65 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.407880:0:13005:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27de1f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330da5 expref: 19 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.407889:0:13005:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd800/0xd9f4181e0d27de65 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.407925:0:13005:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27de1f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330da5 expref: 19 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.407939:0:13005:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27de1f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330da5 expref: 19 pid: 8457 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945967.407954:0:13005:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83ff0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13005:1877942638622848:192.168.204.20@tcp:104: 00000100:00100000:1.0:1790945967.408722:0:13005:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408704f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790945967.418537:0:13005:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83ff0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13005:1877942638622848:192.168.204.20@tcp:104: 00010000:00010000:1.0:1790945967.418568:0:13005:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd800/0xd9f4181e0d27de65 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945967.429018:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945967.429092:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616546816 00000100:00100000:2.0:1790945967.429104:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616546816 00010000:00010000:2.0:1790945967.429156:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27de1f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330da5 expref: 20 pid: 8457 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945967.429242:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 92 00000100:00100000:2.0:1790945967.429252:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+20:2402:x1877942616546816:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790945967.429268:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945967.429275:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27de1f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330da5 expref: 20 pid: 8457 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.429288:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27de1f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330da5 expref: 20 pid: 8457 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.429329:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27de1f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330da5 expref: 20 pid: 8457 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.429354:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d40bc937d00) 00010000:00010000:2.0:1790945967.429359:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd800/0xd9f4181e0d27de65 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.429369:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd800/0xd9f4181e0d27de65 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.429376:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd800/0xd9f4181e0d27de65 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.429397:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945967.429444:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+19:2402:x1877942616546816:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 193us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945967.429451:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 92 00010000:00010000:1.0:1790945967.429693:0:13005:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd800/0xd9f4181e0d27de65 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.429711:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd800/0xd9f4181e0d27de65 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790945967.429825:0:13005:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:1.0:1790945967.429976:0:13005:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:1.0:1790945967.430147:0:13005:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:1.0:1790945967.430256:0:13005:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83ff0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13005:1877942638622976:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1790945967.430307:0:13005:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945967.430338:0:13005:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096d1ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1790945967.430570:0:12418:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638622976 00000100:00100000:2.0:1790945967.430577:0:12418:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638622976 00000100:00100000:2.0:1790945967.430628:0:12418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1790945967.430637:0:12418:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:13005:x1877942638622976:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1790945967.430713:0:12418:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:13005:x1877942638622976:12345-0@lo:1000:mdt00_004.0 Request processed in 78us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945967.430720:0:12418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1790945967.430729:0:13005:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:1.0:1790945967.430734:0:13005:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d3f83eb3100, transno 4294967316 00000100:00100000:1.0:1790945967.430748:0:13005:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83ff0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13005:1877942638622976:0@lo:1000:mdt00_004.0 00000001:00080000:1.0:1790945967.430907:0:13005:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:1.0:1790945967.430948:0:13005:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83ff0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13005:1877942638623104:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1790945967.430975:0:13005:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945967.431097:0:13005:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408704f240 going to sleep for 11 seconds 00000100:00100000:2.0:1790945967.431570:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638623104 00000100:00100000:2.0:1790945967.431575:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638623104 00000100:00100000:2.0:1790945967.431611:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1790945967.431618:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:13005:x1877942638623104:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1790945967.431727:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:13005:x1877942638623104:12345-0@lo:1000:mdt00_004.0 Request processed in 109us (751us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1790945967.431734:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1790945967.431850:0:13005:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83ff0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13005:1877942638623104:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1790945967.431889:0:13005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd800/0xd9f4181e0d27de65 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.431900:0:13005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd800/0xd9f4181e0d27de65 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.431908:0:13005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd800/0xd9f4181e0d27de65 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.431914:0:13005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afd800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945967.431918:0:13005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd800/0xd9f4181e0d27de65 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.431925:0:13005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd800/0xd9f4181e0d27de65 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.431940:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d40bc937d00) 00010000:00010000:3.0:1790945967.431943:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790945967.431955:0:13005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd800/0xd9f4181e0d27de65 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.431962:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd800/0xd9f4181e0d27de65 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.431987:0:13005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27dd9a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.431994:0:13005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27dd9a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.432000:0:13005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27dd9a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.432005:0:13005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945967.432008:0:13005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27dd9a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.432014:0:13005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27dd9a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.432021:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d40bc937700) 00010000:00010000:3.0:1790945967.432023:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790945967.432026:0:13005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27dd9a lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.432032:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27dd9a lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.432053:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27de6c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.432068:0:13005:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64600/0xd9f4181e0d27ddb6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d89 expref: 22 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.432083:0:13005:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27de6c lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.432108:0:13005:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64600/0xd9f4181e0d27ddb6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d89 expref: 22 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.432122:0:13005:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64600/0xd9f4181e0d27ddb6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d89 expref: 22 pid: 8457 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945967.432133:0:13005:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff81500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13005:1877942638623232:192.168.204.20@tcp:104: 00000100:00100000:3.0:1790945967.433612:0:13005:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40811caa80 going to sleep for 11 seconds 00000100:00100000:2.0:1790945967.436805:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945967.436871:0:7471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616546944 00000100:00100000:0.0:1790945967.436880:0:7471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616546944 00010000:00010000:0.0:1790945967.436919:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64600/0xd9f4181e0d27ddb6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d89 expref: 23 pid: 8457 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945967.436961:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 93 00000100:00100000:0.0:1790945967.436969:0:7471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84471500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+23:2404:x1877942616546944:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790945967.436982:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945967.436989:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64600/0xd9f4181e0d27ddb6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d89 expref: 23 pid: 8457 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.437002:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64600/0xd9f4181e0d27ddb6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d89 expref: 23 pid: 8457 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.437024:0:7471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d40bc937700) 00010000:00010000:0.0:1790945967.437030:0:7471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27de6c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.437039:0:7471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27de6c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.437047:0:7471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27de6c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.437076:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945967.437126:0:7471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84471500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+23:2404:x1877942616546944:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 157us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945967.437133:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 93 00010000:00010000:3.0:1790945967.442567:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64600/0xd9f4181e0d27ddb6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330d89 expref: 22 pid: 8457 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945967.442591:0:13005:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff81500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13005:1877942638623232:192.168.204.20@tcp:104: 00010000:00010000:3.0:1790945967.442617:0:13005:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27de6c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.442627:0:13005:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27de6c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.442633:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27de6c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.442647:0:13005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27de6c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.442654:0:13005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27de6c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.442671:0:13005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27de6c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.442676:0:13005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080031800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945967.442681:0:13005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27de6c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.442689:0:13005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27de6c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.442704:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d40bc937700) 00010000:00010000:3.0:1790945967.442707:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945967.442711:0:13005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27de6c lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.442717:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27de6c lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.442729:0:13005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27de5e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.442735:0:13005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27de5e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.442740:0:13005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27de5e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.442745:0:13005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afca00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945967.442747:0:13005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27de5e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.442763:0:13005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27de5e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.442771:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d40bc937700) 00010000:00010000:3.0:1790945967.442774:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790945967.442777:0:13005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27de5e lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.442783:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27de5e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945967.442949:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ec3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+21:12339:x1877942616546560:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 43994us (48922us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1790945967.442959:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 200 00000020:00080000:3.0:1790945967.442964:0:13005:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1790945967.443066:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790945967.443071:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790945967.443652:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1790945967.443662:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790945967.451636:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945967.453148:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616547200 00000100:00100000:0.0:1790945967.453617:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616547200 00000100:00100000:0.0:1790945967.453718:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 50 00000100:00100000:0.0:1790945967.453730:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4096dd9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+21:12339:x1877942616547200:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1790945967.453988:0:6524:0:(mdd_object.c:4180:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1790945967.454034:0:6524:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:0.0:1790945967.454065:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27de73 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.454082:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27de73 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.454093:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27de73 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.454101:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27de73 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.454108:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27de73 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.454114:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27de73 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.454140:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790945967.454186:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790945967.454193:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27de73 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.454200:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe1600 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790945967.454204:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27de73 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.454210:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27de73 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.454221:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d40bc937d00) 00010000:00010000:2.0:1790945967.454224:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790945967.454229:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27de73 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.454234:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27de73 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.454244:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945967.454246:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945967.454248:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945967.454257:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4096dd9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+23:12339:x1877942616547200:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 Request processed in 530us (2630us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1790945967.454266:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 50 00000020:00080000:0.0:1790945967.454271:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1790945967.455338:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83faad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638623360:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790945967.455396:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945967.457983:0:12418:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638623360 00000100:00100000:1.0:1790945967.457998:0:12418:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638623360 00000100:00100000:1.0:1790945967.458051:0:12418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1790945967.458060:0:12418:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638623360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790945967.458096:0:12418:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1790945967.458616:0:12418:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638623360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 556us (3219us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945967.458625:0:12418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1790945967.458707:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83faad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638623360:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1790945967.489102:0:14659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790945967.489112:0:14659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790945967.489138:0:14659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1790945967.489146:0:14659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1790945967.583340:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945967.609455:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945967.609560:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616547456 00000100:00100000:1.0:1790945967.609570:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616547456 00000100:00100000:1.0:1790945967.609634:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 201 00000100:00100000:1.0:1790945967.609665:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84472d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+23:12349:x1877942616547456:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:1.0:1790945967.609698:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945967.609724:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afdc00/0xd9f4181e0d27de7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330dc1 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.609858:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc400/0xd9f4181e0d27de81 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.609873:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc400/0xd9f4181e0d27de81 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.609884:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc400/0xd9f4181e0d27de81 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790945967.609896:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1790945967.610007:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afdc00/0xd9f4181e0d27de7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330dc1 expref: 26 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.610027:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc400/0xd9f4181e0d27de81 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330dc1 expref: 25 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.610036:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d3f824ef900) 00010000:00010000:1.0:1790945967.610039:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790945967.610043:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4092afc400, rc 0) 00000100:00100000:1.0:1790945967.610132:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84472d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+25:12349:x1877942616547456:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 485us (684us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1790945967.610381:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 201 00000100:00100000:0.0:1790945967.619635:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945967.619741:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616547584 00000100:00100000:2.0:1790945967.619756:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616547584 00000100:00100000:2.0:1790945967.619862:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 202 00000100:00100000:2.0:1790945967.619875:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83fa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+25:12349:x1877942616547584:12345-192.168.204.20@tcp:34:lfs.0 00010000:00010000:2.0:1790945967.619980:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27de8f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.620000:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27de8f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.620014:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27de8f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.620032:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27de96 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.620040:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27de96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.620048:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27de96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.620131:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64200/0xd9f4181e0d27de9d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.620138:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64200/0xd9f4181e0d27de9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.620145:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64200/0xd9f4181e0d27de9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790945967.620205:0:8457:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64200/0xd9f4181e0d27de9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.620218:0:8457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27de8f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.620231:0:8457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27de8f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.620238:0:8457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27de8f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.620244:0:8457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65c00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945967.620249:0:8457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27de8f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.620256:0:8457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27de8f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.620270:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d3f824ef900) 00010000:00010000:2.0:1790945967.620273:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945967.620278:0:8457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27de8f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.620284:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27de8f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.620297:0:8457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27de96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.620308:0:8457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27de96 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.620314:0:8457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27de96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.620319:0:8457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c64000 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945967.620326:0:8457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27de96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.620332:0:8457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27de96 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.620340:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d3f824efb00) 00010000:00010000:2.0:1790945967.620343:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945967.620346:0:8457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27de96 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.620351:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27de96 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.620365:0:8457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64200/0xd9f4181e0d27de9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.620370:0:8457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64200/0xd9f4181e0d27de9d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.620376:0:8457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64200/0xd9f4181e0d27de9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.620381:0:8457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c64200 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945967.620384:0:8457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64200/0xd9f4181e0d27de9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.620391:0:8457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64200/0xd9f4181e0d27de9d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.620399:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d3f824ef500) 00010000:00010000:2.0:1790945967.620401:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945967.620413:0:8457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64200/0xd9f4181e0d27de9d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.620420:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64200/0xd9f4181e0d27de9d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945967.620549:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83fa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+25:12349:x1877942616547584:12345-192.168.204.20@tcp:34:lfs.0 Request processed in 675us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945967.620559:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 202 00000100:00100000:2.0:1790945967.651210:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945967.652317:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616547840 00000100:00100000:3.0:1790945967.652330:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616547840 00000100:00100000:2.0:1790945967.652535:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 203 00000100:00100000:2.0:1790945967.652549:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84470000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+25:12352:x1877942616547840:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1790945967.652569:0:13005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945967.652588:0:13005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64200/0xd9f4181e0d27dea4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330dc8 expref: -99 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.656661:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27deab lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.656678:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27deab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.656689:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27deab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.656706:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27deb2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.656713:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27deb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.656738:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27deb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.656852:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64600/0xd9f4181e0d27deb9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.656861:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64600/0xd9f4181e0d27deb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.656869:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64600/0xd9f4181e0d27deb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945967.656879:0:13005:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1790945967.656964:0:13005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27deab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.656972:0:13005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27deab lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.656978:0:13005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27deab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.656985:0:13005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c64000 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945967.656989:0:13005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27deab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.656996:0:13005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27deab lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.657009:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d3f824ef900) 00010000:00010000:2.0:1790945967.657012:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945967.657025:0:13005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27deab lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.657032:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27deab lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.657048:0:13005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27deb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.657055:0:13005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27deb2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.657061:0:13005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27deb2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.657066:0:13005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65c00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945967.657070:0:13005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27deb2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.657076:0:13005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27deb2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.657084:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d3f824ef500) 00010000:00010000:2.0:1790945967.657086:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945967.657089:0:13005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27deb2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.657094:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27deb2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.657139:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64200/0xd9f4181e0d27dea4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330dc8 expref: 28 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.657772:0:13005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64600/0xd9f4181e0d27deb9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330dc8 expref: 27 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.657786:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:2.0:1790945967.657789:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790945967.657792:0:13005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c64600, rc 0) 00000100:00100000:2.0:1790945967.657873:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84470000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+27:12352:x1877942616547840:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 5326us (6673us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1790945967.657882:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 203 00000100:00100000:0.0:1790945967.666123:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945967.666351:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616547968 00000100:00100000:3.0:1790945967.666363:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616547968 00000100:00100000:3.0:1790945967.666430:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 204 00000100:00100000:3.0:1790945967.666453:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83fabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+27:12352:x1877942616547968:12345-192.168.204.20@tcp:54:lfs.0 00010000:00010000:3.0:1790945967.666534:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27dec7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.666552:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27dec7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.666564:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27dec7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.666598:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27dec7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.666605:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27dec7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.666613:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27dec7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.666619:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080031800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945967.666624:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27dec7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.666631:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27dec7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.666642:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:3.0:1790945967.666645:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790945967.666650:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27dec7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.666657:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27dec7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945967.666742:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83fabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+27:12352:x1877942616547968:12345-192.168.204.20@tcp:54:lfs.0 Request processed in 290us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945967.666749:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 204 00000100:00100000:0.0:1790945967.674121:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945967.674324:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616548224 00000100:00100000:1.0:1790945967.674336:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616548224 00000100:00100000:1.0:1790945967.674392:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 51 00000100:00100000:1.0:1790945967.674402:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+27:12352:x1877942616548224:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:1.0:1790945967.674638:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+28:12352:x1877942616548224:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 237us (525us total) trans 4294967473 rc 0/0 00000100:00100000:1.0:1790945967.674646:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 51 00000100:00100000:2.0:1790945967.681859:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945967.681901:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945967.681936:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945967.681963:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616548608 00000100:00100000:2.0:1790945967.681971:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945967.681975:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616548608 00000100:00100000:2.0:1790945967.682004:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945967.682033:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616548864 00000100:00100000:2.0:1790945967.682038:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616548864 00000100:00100000:3.0:1790945967.682046:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 126 00000100:00100000:3.0:1790945967.682058:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84473100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:2404:x1877942616548608:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790945967.682075:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616548480 00000100:00100000:2.0:1790945967.682080:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616548480 00000100:00100000:2.0:1790945967.682097:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616548736 00000100:00100000:2.0:1790945967.682100:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616548736 00000100:00100000:2.0:1790945967.682117:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 310 00000100:00100000:2.0:1790945967.682124:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84471c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2404:x1877942616548864:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790945967.682162:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84471c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2404:x1877942616548864:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 37us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945967.682164:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84473100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:2404:x1877942616548608:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 107us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945967.682199:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 310 00000100:00100000:3.0:1790945967.682205:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 126 00000100:00080000:3.0:1790945967.682227:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790945967.682232:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790945967.682235:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 311 00000100:00080000:3.0:1790945967.682237:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790945967.682259:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84471880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2404:x1877942616548480:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790945967.682299:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84471880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2404:x1877942616548480:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 42us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945967.682305:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 311 00000100:00100000:2.0:1790945967.682317:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 312 00000100:00100000:2.0:1790945967.682323:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84473b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2404:x1877942616548736:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790945967.682348:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84473b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2404:x1877942616548736:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 26us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945967.682354:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 312 00000100:00100000:1.0:1790945967.683397:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616548352 00000100:00100000:1.0:1790945967.683408:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616548352 00000100:00100000:1.0:1790945967.683465:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 387 00000100:00100000:1.0:1790945967.683473:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087036450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:2404:x1877942616548352:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945967.683547:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087036450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:2404:x1877942616548352:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 74us (1697us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945967.683554:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 387 00000100:00100000:2.0:1790945967.714762:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945967.714862:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616549120 00000100:00100000:3.0:1790945967.714873:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616549120 00000100:00100000:3.0:1790945967.714941:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 205 00000100:00100000:3.0:1790945967.714951:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84470380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+28:11884:x1877942616549120:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:3.0:1790945967.714976:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945967.714996:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27dece lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330dcf expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.715113:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27ded5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.715128:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64600/0xd9f4181e0d27deb9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330dc8 expref: 29 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.715739:0:6522:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27ded5 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.720416:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64600/0xd9f4181e0d27deb9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330dc8 expref: 29 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.720441:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64600/0xd9f4181e0d27deb9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330dc8 expref: 29 pid: 13005 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945967.720458:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84471180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1877942638623488:192.168.204.20@tcp:104: 00000100:00100000:2.0:1790945967.720707:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40854e5240 going to sleep for 11 seconds 00000100:00100000:0.0:1790945967.725725:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945967.725939:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84471180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1877942638623488:192.168.204.20@tcp:104: 00010000:00010000:2.0:1790945967.725966:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27ded5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945967.726211:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616549248 00000100:00100000:3.0:1790945967.726219:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616549248 00010000:00010000:3.0:1790945967.726263:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64600/0xd9f4181e0d27deb9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330dc8 expref: 30 pid: 13005 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945967.726305:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 94 00000100:00100000:3.0:1790945967.726314:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+30:2404:x1877942616549248:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790945967.726328:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945967.726335:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64600/0xd9f4181e0d27deb9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330dc8 expref: 30 pid: 13005 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.726346:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64600/0xd9f4181e0d27deb9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330dc8 expref: 30 pid: 13005 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.726367:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64600/0xd9f4181e0d27deb9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330dc8 expref: 30 pid: 13005 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.726383:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:3.0:1790945967.726388:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27ded5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.726397:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27ded5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.726424:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27ded5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945967.726453:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945967.726525:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+29:2404:x1877942616549248:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 211us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945967.726532:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 94 00010000:00010000:2.0:1790945967.726738:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27ded5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.726749:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27ded5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945967.726775:0:6522:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1790945967.726910:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27dece lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330dcf expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.726929:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27ded5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330dcf expref: 29 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.726936:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:2.0:1790945967.726939:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790945967.726942:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4080031800, rc 0) 00000100:00100000:2.0:1790945967.726970:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84470380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+29:11884:x1877942616549120:12345-192.168.204.20@tcp:101:bash.0 Request processed in 12022us (12217us total) trans 4294967474 rc 0/0 00000100:00100000:2.0:1790945967.726977:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 205 00000100:00100000:3.0:1790945967.733462:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945967.733576:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616549376 00000100:00100000:2.0:1790945967.733586:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616549376 00000100:00100000:2.0:1790945967.733651:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 206 00000100:00100000:2.0:1790945967.733662:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+29:11884:x1877942616549376:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:2.0:1790945967.733687:0:13005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945967.733712:0:13005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27dee3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330dd6 expref: -99 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.733756:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27deea lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.733770:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27deea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.733801:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27deea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.733938:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27dee3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330dd6 expref: 31 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.733956:0:13005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27deea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330dd6 expref: 30 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.733964:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:2.0:1790945967.733966:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790945967.733969:0:13005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c64000, rc 0) 00000100:00100000:2.0:1790945967.734050:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+30:11884:x1877942616549376:12345-192.168.204.20@tcp:101:bash.0 Request processed in 389us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945967.734058:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 206 00000100:00100000:0.0:1790945967.737094:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945967.737214:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616549632 00000100:00100000:2.0:1790945967.737223:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616549632 00000100:00100000:2.0:1790945967.737301:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 207 00000100:00100000:2.0:1790945967.737312:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83faad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+30:11884:x1877942616549632:12345-192.168.204.20@tcp:36:bash.0 00010000:00010000:2.0:1790945967.737783:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27def1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.737803:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27def1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.739001:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27def1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790945967.739113:0:6521:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:2.0:1790945967.739163:0:6521:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000621bb2e6 reply state 00000000c2f1ba41 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27def1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.739203:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27def1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.739212:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:2.0:1790945967.739215:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790945967.739219:0:6521:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1790945967.741056:0:6521:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:2.0:1790945967.742005:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83faad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+34:11884:x1877942616549632:12345-192.168.204.20@tcp:36:bash.0 Request processed in 4688us (4916us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1790945967.742018:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 207 00000020:00080000:2.0:1790945967.742024:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1790945967.749047:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945967.749135:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616549760 00000100:00100000:2.0:1790945967.749146:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616549760 00000100:00100000:2.0:1790945967.752321:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 208 00000100:00100000:2.0:1790945967.752344:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+34:11884:x1877942616549760:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:2.0:1790945967.752369:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945967.752392:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27def8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330ddd expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.752450:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27def8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ddd expref: 35 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.752465:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27def8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ddd expref: 35 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.752518:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:2.0:1790945967.752522:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790945967.752525:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c65c00, rc 0) 00000100:00100000:2.0:1790945967.752600:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+35:11884:x1877942616549760:12345-192.168.204.20@tcp:101:bash.0 Request processed in 267us (3563us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945967.752608:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 208 00000100:00100000:3.0:1790945967.760531:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945967.760701:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616549888 00000100:00100000:0.0:1790945967.760712:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616549888 00000100:00100000:0.0:1790945967.760776:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 66 00000100:00100000:0.0:1790945967.760786:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:11884:x1877942616549888:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:0.0:1790945967.760805:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945967.760827:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fdabf0f/0xd9f4181e0d27deff lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330de4 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790945967.760853:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6abfaaae, atime: 0x6abfaaac, ctime: 0x6abfaaae, blocks: 0x8 00010000:00010000:0.0:1790945967.760874:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=418s v=(0 0) 00010000:00010000:0.0:1790945967.760879:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790945967.760887:0:8437:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fdabf0f/0xd9f4181e0d27deff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330de4 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.760903:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009fdabf0f/0xd9f4181e0d27deff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330de4 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.760949:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe0000, rc 0) 00000100:00100000:0.0:1790945967.761009:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+8:11884:x1877942616549888:12345-192.168.204.20@tcp:101:bash.0 Request processed in 224us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945967.761017:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 66 00000100:00100000:1.0:1790945967.763491:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945967.763569:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616550016 00000100:00100000:3.0:1790945967.763579:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616550016 00002000:00010000:3.0:1790945967.763622:0:8442:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:3.0:1790945967.763627:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3f83eb3100 with x1877942616550016 ext(0->18446744073709551615) 00002000:00010000:3.0:1790945967.763639:0:8442:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d3f83eb3100. 00000100:00100000:3.0:1790945967.763675:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00100000:3.0:1790945967.763684:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83eb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+8:2404:x1877942616550016:12345-192.168.204.20@tcp:10:bash.0 00002000:00010000:3.0:1790945967.763955:0:8442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1790945967.763958:0:8442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1790945966 -> 1790945967 00002000:00010000:3.0:1790945967.763961:0:8442:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1790945964 -> 1790945964 00002000:00010000:3.0:1790945967.763963:0:8442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1790945966 -> 1790945967 00002000:00010000:3.0:1790945967.763965:0:8442:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1790945967.764030:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83eb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+9:2404:x1877942616550016:12345-192.168.204.20@tcp:10:bash.0 Request processed in 347us (548us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1790945967.764038:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5 00002000:00010000:3.0:1790945967.764042:0:8442:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:3.0:1790945967.764045:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3f83eb3100 with x1877942616550016 ext(0->18446744073709551615) 00002000:00010000:3.0:1790945967.764059:0:8442:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d3f83eb3100. 00000100:00100000:1.0:1790945967.869255:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945967.869337:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616550144 00000100:00100000:0.0:1790945967.869348:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616550144 00000100:00100000:0.0:1790945967.869413:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 209 00000100:00100000:0.0:1790945967.869424:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83eb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+35:12366:x1877942616550144:12345-192.168.204.20@tcp:34:lfs.0 00010000:00010000:0.0:1790945967.869517:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27df06 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.869534:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27df06 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.869545:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27df06 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.869560:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27df0d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.869568:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27df0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.869573:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27df0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.869644:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27df14 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.869671:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27df14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.869678:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27df14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790945967.869723:0:8457:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27df14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.869735:0:8457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27df06 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.869742:0:8457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27df06 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.869748:0:8457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27df06 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.869755:0:8457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe1200 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945967.869759:0:8457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27df06 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.869767:0:8457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27df06 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.869778:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d3f824ef900) 00010000:00010000:0.0:1790945967.869781:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945967.869786:0:8457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27df06 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.869792:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27df06 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.869813:0:8457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27df0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.869829:0:8457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27df0d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.869836:0:8457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27df0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.869840:0:8457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe1600 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945967.869843:0:8457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27df0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.869849:0:8457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27df0d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.869857:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d40bc9adf00) 00010000:00010000:0.0:1790945967.869859:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945967.869862:0:8457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27df0d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.869868:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27df0d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.869884:0:8457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27df14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.869890:0:8457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27df14 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.869895:0:8457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27df14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.869905:0:8457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe1a00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945967.869908:0:8457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27df14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.869913:0:8457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27df14 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.869921:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:0.0:1790945967.869924:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945967.869926:0:8457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27df14 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.869932:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27df14 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945967.870008:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83eb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+35:12366:x1877942616550144:12345-192.168.204.20@tcp:34:lfs.0 Request processed in 585us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945967.870015:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 209 00000100:00100000:1.0:1790945967.935267:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945967.935448:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616550400 00000100:00100000:2.0:1790945967.935459:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616550400 00000100:00100000:2.0:1790945967.935539:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 210 00000100:00100000:2.0:1790945967.935549:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+35:12369:x1877942616550400:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1790945967.935569:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945967.935589:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64c00/0xd9f4181e0d27df1b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330deb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.935661:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65600/0xd9f4181e0d27df22 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.935678:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65600/0xd9f4181e0d27df22 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.935690:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65600/0xd9f4181e0d27df22 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.935704:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27df29 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.935712:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27df29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.935731:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27df29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.935834:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27df30 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.935844:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27df30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.935851:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27df30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945967.935860:0:6521:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1790945967.935935:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65600/0xd9f4181e0d27df22 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.935944:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65600/0xd9f4181e0d27df22 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.935951:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65600/0xd9f4181e0d27df22 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.935958:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65600 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945967.935963:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65600/0xd9f4181e0d27df22 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.935971:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65600/0xd9f4181e0d27df22 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.935983:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d3f824ef900) 00010000:00010000:2.0:1790945967.935987:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945967.935997:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65600/0xd9f4181e0d27df22 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.936004:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65600/0xd9f4181e0d27df22 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.936018:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27df29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.936025:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27df29 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.936031:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27df29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.936036:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c64800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945967.936039:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27df29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.936046:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27df29 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.936053:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d3f824ef500) 00010000:00010000:2.0:1790945967.936056:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945967.936058:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27df29 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.936064:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27df29 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.936101:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64c00/0xd9f4181e0d27df1b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330deb expref: 38 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.936127:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27df30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330deb expref: 37 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945967.936148:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:2.0:1790945967.936150:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790945967.936153:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c65400, rc 0) 00000100:00100000:2.0:1790945967.936267:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+37:12369:x1877942616550400:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 719us (1009us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1790945967.936276:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 210 00000100:00100000:1.0:1790945967.939965:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945967.940065:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616550528 00000100:00100000:0.0:1790945967.940074:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616550528 00000100:00100000:0.0:1790945967.940145:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 211 00000100:00100000:0.0:1790945967.940157:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+37:12369:x1877942616550528:12345-192.168.204.20@tcp:54:lfs.0 00010000:00010000:0.0:1790945967.940274:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27df3e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.940293:0:13005:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27ded5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330dcf expref: 37 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.940302:0:13005:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27df3e lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.940351:0:13005:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27ded5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330dcf expref: 37 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.940364:0:13005:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27ded5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330dcf expref: 37 pid: 6522 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945967.940376:0:13005:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83fa9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13005:1877942638623616:192.168.204.20@tcp:104: 00000100:00100000:0.0:1790945967.940548:0:13005:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4087172f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790945967.944342:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945967.944433:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616550784 00000100:00100000:2.0:1790945967.944445:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616550784 00000100:00100000:2.0:1790945967.944526:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 52 00000100:00100000:2.0:1790945967.944536:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+38:6171:x1877942616550784:12345-192.168.204.20@tcp:35:ldlm_bl.0 00000001:00080000:2.0:1790945967.944747:0:6524:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967479 00000100:00100000:2.0:1790945967.944856:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+40:6171:x1877942616550784:12345-192.168.204.20@tcp:35:ldlm_bl.0 Request processed in 320us (523us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1790945967.944864:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 52 00000020:00080000:2.0:1790945967.944869:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790945967.945474:0:13005:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83fa9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13005:1877942638623616:192.168.204.20@tcp:104: 00010000:00010000:0.0:1790945967.945514:0:13005:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27df3e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945967.947372:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945967.947481:0:7471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616550912 00000100:00100000:0.0:1790945967.947510:0:7471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616550912 00010000:00010000:0.0:1790945967.947554:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27ded5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330dcf expref: 40 pid: 6522 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945967.947605:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 95 00000100:00100000:0.0:1790945967.947614:0:7471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+40:2403:x1877942616550912:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790945967.947636:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945967.947643:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27ded5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330dcf expref: 40 pid: 6522 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.947662:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27ded5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330dcf expref: 40 pid: 6522 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.947699:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27ded5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330dcf expref: 40 pid: 6522 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.947715:0:7471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:0.0:1790945967.947720:0:7471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27df3e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.947730:0:7471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27df3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.947737:0:7471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27df3e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945967.947769:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945967.947834:0:7471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+39:2403:x1877942616550912:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 219us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945967.947842:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 95 00010000:00010000:1.0:1790945967.947918:0:13005:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27df3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.947926:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27df3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.947981:0:13005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27df3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.947997:0:13005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27df3e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.948004:0:13005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27df3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.948010:0:13005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe1a00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:1.0:1790945967.948020:0:13005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27df3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.948028:0:13005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27df3e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.948038:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:1.0:1790945967.948041:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790945967.948045:0:13005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27df3e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945967.948057:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27df3e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945967.948103:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+38:12369:x1877942616550528:12345-192.168.204.20@tcp:54:lfs.0 Request processed in 7948us (8146us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945967.948111:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 211 00000100:00100000:1.0:1790945967.949924:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945967.950007:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616551168 00000100:00100000:2.0:1790945967.950018:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616551168 00000100:00100000:2.0:1790945967.950068:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 53 00000100:00100000:2.0:1790945967.950077:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+38:12369:x1877942616551168:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:2.0:1790945967.950327:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+39:12369:x1877942616551168:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 251us (410us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1790945967.950339:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 53 00000100:00100000:2.0:1790945967.967782:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790945967.967807:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638623744:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790945967.967888:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945967.967975:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638623744 00000100:00100000:0.0:1790945967.967984:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638623744 00000100:00100000:0.0:1790945967.968042:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1790945967.968053:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84471180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638623744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790945967.968087:0:6526:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790945967.968142:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84471180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638623744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945967.968150:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1790945967.968383:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638623744:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790945968.053966:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945968.054080:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616551424 00000100:00100000:0.0:1790945968.054091:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616551424 00000100:00100000:0.0:1790945968.054308:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 212 00000100:00100000:0.0:1790945968.054318:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+39:12380:x1877942616551424:12345-192.168.204.20@tcp:101:cat.0 00010000:00010000:0.0:1790945968.054344:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945968.054369:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27df45 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330df2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.054448:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27df4c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.054474:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27df4c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.054486:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27df4c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.054509:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27df53 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.054517:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27df53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.054524:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27df53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.054620:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27df5a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.054630:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27df5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.054637:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27df5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945968.054658:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:0.0:1790945968.054727:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27df4c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.054735:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27df4c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.054742:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27df4c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.054749:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe1200 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945968.054753:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27df4c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.054761:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27df4c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.054772:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d3f824ef900) 00010000:00010000:0.0:1790945968.054775:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945968.054779:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27df4c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.054785:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27df4c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.054797:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27df53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.054803:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27df53 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.054819:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27df53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.054824:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945968.054827:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27df53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.054834:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27df53 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.054842:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d40bc9adf00) 00010000:00010000:0.0:1790945968.054845:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945968.054848:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27df53 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.054854:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27df53 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.054895:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1600/0xd9f4181e0d27df45 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330df2 expref: 42 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.054907:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27df5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330df2 expref: 41 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.054915:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:0.0:1790945968.054917:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790945968.054919:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe0c00, rc 0) 00000100:00100000:0.0:1790945968.054982:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+41:12380:x1877942616551424:12345-192.168.204.20@tcp:101:cat.0 Request processed in 665us (1027us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1790945968.054998:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 212 00000100:00080000:3.0:1790945968.056669:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790945968.059423:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945968.059611:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616551680 00000100:00100000:2.0:1790945968.059621:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616551680 00000100:00100000:2.0:1790945968.059677:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 54 00000100:00100000:2.0:1790945968.059686:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+41:12380:x1877942616551680:12345-192.168.204.20@tcp:35:cat.0 00000100:00100000:2.0:1790945968.059949:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+42:12380:x1877942616551680:12345-192.168.204.20@tcp:35:cat.0 Request processed in 264us (535us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1790945968.059957:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 54 00000100:00100000:1.0:1790945968.092402:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945968.092594:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616551936 00000100:00100000:3.0:1790945968.092610:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616551936 00000100:00100000:3.0:1790945968.092675:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 213 00000100:00100000:3.0:1790945968.092685:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+42:12381:x1877942616551936:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:3.0:1790945968.092743:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1790945968.092771:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27def8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ddd expref: 42 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.092796:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0c00/0xd9f4181e0d27df5a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330df2 expref: 41 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.092808:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27df30 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330deb expref: 40 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.092834:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27deea lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330dd6 expref: 39 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.092844:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:3.0:1790945968.092849:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790945968.092870:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27df68 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.092884:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27df68 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.092915:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27df68 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.092931:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27df6f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.092938:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27df6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.092945:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27df6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.093029:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27df76 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.093038:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27df76 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.093074:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27df76 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790945968.093350:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00010000:00010000:3.0:1790945968.093395:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27df7d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.093404:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27df7d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.093412:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27df7d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.093419:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27df7d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.093431:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27df7d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.093437:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27df7d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.093453:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790945968.093880:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790945968.093888:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27df7d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.093896:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d6800 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:0.0:1790945968.093899:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27df7d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.093907:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27df7d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.093917:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:0.0:1790945968.093920:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790945968.093923:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27df7d lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.093928:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27df7d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.093940:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945968.093942:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945968.093943:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945968.094396:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27df76 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.094405:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27df76 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.094411:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27df76 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.094416:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080031800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945968.094420:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27df76 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.094426:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27df76 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.094435:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:3.0:1790945968.094437:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1790945968.094440:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27df76 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.094446:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27df76 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.094602:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27df68 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.094621:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27df68 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.094628:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27df68 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.094633:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080030a00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945968.094636:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27df68 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.094642:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27df68 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.094650:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d3f824ef900) 00010000:00010000:3.0:1790945968.094652:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945968.094655:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27df68 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.094660:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27df68 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790945968.094671:0:6522:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009b0ec5ce reply state 00000000bfbfd48d transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27df6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.094681:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27df6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.094687:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d40bae9c200) 00010000:00010000:3.0:1790945968.094689:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790945968.094691:0:6522:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790945968.094821:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+40:12381:x1877942616551936:12345-192.168.204.20@tcp:36:rm.0 Request processed in 2127us (2421us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1790945968.094837:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 213 00000100:00100000:3.0:1790945968.157515:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945968.157678:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616552192 00000100:00100000:1.0:1790945968.157702:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616552192 00000100:00100000:1.0:1790945968.157824:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 214 00000100:00100000:1.0:1790945968.157836:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+40:12387:x1877942616552192:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:1.0:1790945968.157863:0:13005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945968.157885:0:13005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc200/0xd9f4181e0d27df84 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330df9 expref: -99 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.157993:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afda00/0xd9f4181e0d27df8b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.158008:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afda00/0xd9f4181e0d27df8b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.158019:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afda00/0xd9f4181e0d27df8b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.158029:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afce00/0xd9f4181e0d27df92 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.158037:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afce00/0xd9f4181e0d27df92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.158043:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afce00/0xd9f4181e0d27df92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790945968.158507:0:13005:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:1.0:1790945968.158651:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27df99 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.158662:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27df99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.158680:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27df99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.158712:0:13005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afda00/0xd9f4181e0d27df8b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.158720:0:13005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afda00/0xd9f4181e0d27df8b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.158726:0:13005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afda00/0xd9f4181e0d27df8b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.158733:0:13005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afda00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:1.0:1790945968.158737:0:13005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afda00/0xd9f4181e0d27df8b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.158745:0:13005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afda00/0xd9f4181e0d27df8b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.158756:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d3f824ef900) 00010000:00010000:1.0:1790945968.158759:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945968.158764:0:13005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afda00/0xd9f4181e0d27df8b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.158769:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afda00/0xd9f4181e0d27df8b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790945968.158781:0:13005:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006aa91696 reply state 0000000012db1793 transno 4294967485 ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afce00/0xd9f4181e0d27df92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.158791:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afce00/0xd9f4181e0d27df92 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.158804:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d40bae9c200) 00010000:00010000:1.0:1790945968.158806:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790945968.158809:0:13005:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790945968.158843:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc200/0xd9f4181e0d27df84 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330df9 expref: 43 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.158858:0:13005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27df99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330df9 expref: 42 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.158866:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d40928bd100) 00010000:00010000:1.0:1790945968.158869:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790945968.158871:0:13005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4092afd600, rc 0) 00000100:00100000:1.0:1790945968.158949:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+43:12387:x1877942616552192:12345-192.168.204.20@tcp:101:bash.0 Request processed in 1116us (1445us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1790945968.158956:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 214 00000100:00100000:3.0:1790945968.163426:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945968.163887:0:10099:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616552320 00000100:00100000:2.0:1790945968.163899:0:10099:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616552320 00000100:00100000:2.0:1790945968.163962:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 67 00000100:00100000:2.0:1790945968.163971:0:10099:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84417480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:2402:x1877942616552320:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:2.0:1790945968.163989:0:10099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945968.164011:0:10099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d24e564d/0xd9f4181e0d27dfa7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330e00 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790945968.164037:0:10099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790945968.164057:0:10099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=418s v=(0 0) 00010000:00010000:2.0:1790945968.164062:0:10099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790945968.164071:0:10099:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d24e564d/0xd9f4181e0d27dfa7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e00 expref: 8 pid: 10099 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945968.164088:0:10099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d24e564d/0xd9f4181e0d27dfa7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e00 expref: 8 pid: 10099 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945968.164117:0:10099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c64c00, rc 0) 00000100:00100000:2.0:1790945968.164945:0:10099:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84417480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+8:2402:x1877942616552320:12345-192.168.204.20@tcp:101:bash.0 Request processed in 971us (1527us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945968.164955:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 67 00000100:00100000:3.0:1790945968.169556:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945968.169646:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616552448 00000100:00100000:0.0:1790945968.169657:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616552448 00000100:00100000:0.0:1790945968.169720:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 68 00000100:00100000:0.0:1790945968.169729:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+8:12387:x1877942616552448:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:0.0:1790945968.169747:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945968.169767:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057c5e76c/0xd9f4181e0d27dfae lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330e07 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.169830:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d24e564d/0xd9f4181e0d27dfa7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e00 expref: 9 pid: 10099 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.169839:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790945968.169844:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790945968.169849:0:8435:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057c5e76c/0xd9f4181e0d27dfae lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e07 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.169884:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d24e564d/0xd9f4181e0d27dfa7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e00 expref: 9 pid: 10099 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.169899:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d24e564d/0xd9f4181e0d27dfa7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e00 expref: 9 pid: 10099 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945968.169914:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83fa9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1877942638623872:192.168.204.20@tcp:104: 00000100:00100000:0.0:1790945968.170012:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4087172540 going to sleep for 11 seconds 00000100:00100000:3.0:1790945968.173915:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945968.174101:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616552576 00000100:00100000:2.0:1790945968.174117:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616552576 00010000:00010000:2.0:1790945968.174225:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d24e564d/0xd9f4181e0d27dfa7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e00 expref: 10 pid: 10099 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945968.174281:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 96 00000100:00100000:2.0:1790945968.174293:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4096cb8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+10:2403:x1877942616552576:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790945968.174313:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945968.174340:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d24e564d/0xd9f4181e0d27dfa7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e00 expref: 10 pid: 10099 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945968.174355:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d24e564d/0xd9f4181e0d27dfa7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e00 expref: 10 pid: 10099 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945968.174387:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790945968.174392:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790945968.174400:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000057c5e76c/0xd9f4181e0d27dfae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e07 expref: 10 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945968.174410:0:6507:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057c5e76c/0xd9f4181e0d27dfae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e07 expref: 10 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945968.174474:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000057c5e76c/0xd9f4181e0d27dfae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e07 expref: 10 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945968.174500:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8450e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6507:1877942638624000:192.168.204.20@tcp:105: 00000100:00100000:2.0:1790945968.174588:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40854e56c0 going to sleep for 11 seconds 00010000:00010000:0.0:1790945968.177575:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d24e564d/0xd9f4181e0d27dfa7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e00 expref: 10 pid: 10099 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945968.177599:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83fa9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1877942638623872:192.168.204.20@tcp:104: 00010000:00010000:0.0:1790945968.177632:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000057c5e76c/0xd9f4181e0d27dfae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e07 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.177648:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe1600, rc 0) 00000100:00100000:0.0:1790945968.177741:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+9:12387:x1877942616552448:12345-192.168.204.20@tcp:101:bash.0 Request processed in 8012us (8197us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945968.177750:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 68 00000100:00100000:0.0:1790945968.179043:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8450e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6507:1877942638624000:192.168.204.20@tcp:105: 00010000:00010000:0.0:1790945968.179068:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945968.179108:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4096cb8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+8:2403:x1877942616552576:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 4817us (5206us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945968.179118:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 96 00000100:00100000:2.0:1790945968.185402:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945968.185582:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616552832 00000100:00100000:0.0:1790945968.185594:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616552832 00000100:00100000:0.0:1790945968.185692:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 55 00000100:00100000:0.0:1790945968.185702:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+43:12387:x1877942616552832:12345-192.168.204.20@tcp:35:bash.0 00000100:00100000:0.0:1790945968.186027:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+44:12387:x1877942616552832:12345-192.168.204.20@tcp:35:bash.0 Request processed in 325us (634us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1790945968.186036:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 55 00000100:00100000:2.0:1790945968.433115:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945968.433250:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616552960 00000100:00100000:0.0:1790945968.433261:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616552960 00000100:00100000:0.0:1790945968.433325:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 215 00000100:00100000:0.0:1790945968.433335:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+44:12403:x1877942616552960:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1790945968.433359:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945968.433379:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27dfb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330e0e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.433448:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27dfbc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.433463:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27dfbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.433503:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27dfbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945968.433551:0:6521:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1790945968.433556:0:6521:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790945968.433576:0:6521:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27dfbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.433599:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0800/0xd9f4181e0d27dfb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e0e expref: 46 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.433616:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27dfbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e0e expref: 45 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.433625:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d3f824ef900) 00010000:00010000:0.0:1790945968.433627:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790945968.433631:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe1200, rc 0) 00000100:00100000:0.0:1790945968.433698:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+45:12403:x1877942616552960:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 364us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945968.433705:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 215 00000100:00100000:3.0:1790945968.442299:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945968.442999:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616553216 00000100:00100000:2.0:1790945968.443011:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616553216 00000100:00100000:2.0:1790945968.443136:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 216 00000100:00100000:2.0:1790945968.443146:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+45:12403:x1877942616553216:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1790945968.443206:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945968.443609:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65600/0xd9f4181e0d27dfc3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330e15 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945968.443726:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64400/0xd9f4181e0d27dfca lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945968.443741:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64400/0xd9f4181e0d27dfca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945968.443752:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64400/0xd9f4181e0d27dfca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945968.443763:0:6522:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1790945968.443881:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65600/0xd9f4181e0d27dfc3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e15 expref: 48 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945968.443921:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64400/0xd9f4181e0d27dfca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e15 expref: 47 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945968.443930:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d40928bd100) 00010000:00010000:2.0:1790945968.443933:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790945968.443936:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c64400, rc 0) 00000100:00100000:2.0:1790945968.444120:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+47:12403:x1877942616553216:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 974us (1829us total) trans 4294967487 rc 0/0 00000100:00100000:2.0:1790945968.444135:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 216 00000100:00100000:3.0:1790945968.448351:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945968.448384:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945968.448822:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616553472 00000100:00100000:1.0:1790945968.448834:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616553472 00000100:00100000:1.0:1790945968.448905:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 217 00000100:00100000:1.0:1790945968.448916:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84415880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+47:12403:x1877942616553472:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:1.0:1790945968.448955:0:13005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945968.448976:0:13005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc200/0xd9f4181e0d27dfd8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330e1c expref: -99 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.449079:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afda00/0xd9f4181e0d27dfdf lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.449094:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afda00/0xd9f4181e0d27dfdf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.449136:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afda00/0xd9f4181e0d27dfdf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790945968.449151:0:13005:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1790945968.449285:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc200/0xd9f4181e0d27dfd8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e1c expref: 50 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.449308:0:13005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afda00/0xd9f4181e0d27dfdf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e1c expref: 49 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.449316:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d40928bd100) 00010000:00010000:1.0:1790945968.449319:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1790945968.449322:0:13005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4092afda00, rc 0) 00000100:00100000:1.0:1790945968.449379:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84415880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+49:12403:x1877942616553472:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 465us (1038us total) trans 4294967488 rc 0/0 00000100:00100000:1.0:1790945968.449387:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 217 00000100:00100000:0.0:1790945968.454298:0:7471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616553600 00000100:00100000:0.0:1790945968.454315:0:7471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616553600 00000100:00100000:0.0:1790945968.454394:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15 00000100:00100000:0.0:1790945968.454404:0:7471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84416a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+49:2401:x1877942616553600:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790945968.454420:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945968.454443:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64400/0xd9f4181e0d27dfca lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e15 expref: 49 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.454503:0:7471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d40928bd100) 00010000:00010000:0.0:1790945968.454509:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945968.454576:0:7471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84416a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+48:2401:x1877942616553600:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 174us (6191us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945968.454584:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15 00000100:00100000:1.0:1790945968.456417:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945968.456964:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616553728 00000100:00100000:3.0:1790945968.456974:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616553728 00000100:00100000:3.0:1790945968.457037:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 69 00000100:00100000:3.0:1790945968.457046:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+8:2403:x1877942616553728:12345-192.168.204.20@tcp:1:lfs.0 00010000:00010000:3.0:1790945968.457088:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be4eb9a9/0xd9f4181e0d27dfed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.457109:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000057c5e76c/0xd9f4181e0d27dfae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e07 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.457117:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1790945968.457132:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790945968.457137:0:8437:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be4eb9a9/0xd9f4181e0d27dfed lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.457210:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000057c5e76c/0xd9f4181e0d27dfae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e07 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.457257:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000057c5e76c/0xd9f4181e0d27dfae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e07 expref: 8 pid: 8435 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945968.457272:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84414a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1877942638624128:192.168.204.20@tcp:104: 00000100:00100000:3.0:1790945968.457358:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40811caa80 going to sleep for 11 seconds 00000100:00100000:3.0:1790945968.461627:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84414a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1877942638624128:192.168.204.20@tcp:104: 00010000:00010000:3.0:1790945968.461657:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000be4eb9a9/0xd9f4181e0d27dfed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945968.462794:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945968.464344:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616553856 00000100:00100000:2.0:1790945968.464362:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616553856 00002000:00100000:2.0:1790945968.464431:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9d3f8441ca80 x1877942616553856/t0(0) o4->0cadc7a5-c0ba-4320-984f-d871ffb3a3ef@192.168.204.20@tcp:664/0 lens 504/0 e 0 to 0 dl 1790945979 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790945968.464594:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3f8441ca80 with x1877942616553856 ext(0->8) 00010000:00010000:2.0:1790945968.464607:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000057c5e76c/0xd9f4181e0d27dfae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e07 expref: 9 pid: 8435 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945968.464626:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000057c5e76c/0xd9f4181e0d27dfae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e07 expref: 9 pid: 8435 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790945968.464635:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9d3f8441ca80 00000100:00100000:2.0:1790945968.464676:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 3 00000100:00100000:2.0:1790945968.464687:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+9:2403:x1877942616553856:12345-192.168.204.20@tcp:4:lfs.0 00000100:00100000:3.0:1790945968.468794:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+11:2403:x1877942616553856:12345-192.168.204.20@tcp:4:lfs.0 Request processed in 4097us (5993us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1790945968.468914:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 3 00002000:00100000:3.0:1790945968.468929:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9d3f8441ca80 x1877942616553856/t4294967309(0) o4->0cadc7a5-c0ba-4320-984f-d871ffb3a3ef@192.168.204.20@tcp:664/0 lens 504/448 e 0 to 0 dl 1790945979 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790945968.468941:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3f8441ca80 with x1877942616553856 ext(0->8) 00010000:00010000:3.0:1790945968.468951:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000057c5e76c/0xd9f4181e0d27dfae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e07 expref: 11 pid: 8435 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.468972:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000057c5e76c/0xd9f4181e0d27dfae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e07 expref: 11 pid: 8435 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790945968.468979:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9d3f8441ca80 00000100:00100000:1.0:1790945968.471497:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945968.471584:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616553984 00000100:00100000:3.0:1790945968.471608:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616553984 00010000:00010000:3.0:1790945968.471653:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000057c5e76c/0xd9f4181e0d27dfae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e07 expref: 11 pid: 8435 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945968.471699:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 97 00000100:00100000:3.0:1790945968.471709:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+11:2401:x1877942616553984:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790945968.471726:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1790945968.471745:0:6508:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1790945968.471748:0:6508:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1790945968 00002000:00010000:3.0:1790945968.471751:0:6508:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1790945968 00002000:00010000:3.0:1790945968.471753:0:6508:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1790945968 00002000:00010000:3.0:1790945968.471755:0:6508:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1790945968.471761:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000057c5e76c/0xd9f4181e0d27dfae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e07 expref: 11 pid: 8435 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.471774:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000057c5e76c/0xd9f4181e0d27dfae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e07 expref: 11 pid: 8435 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.471799:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057c5e76c/0xd9f4181e0d27dfae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e07 expref: 11 pid: 8435 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.471868:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790945968.471873:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790945968.471880:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000be4eb9a9/0xd9f4181e0d27dfed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.471892:0:6508:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be4eb9a9/0xd9f4181e0d27dfed lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.471984:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945968.472054:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+10:2401:x1877942616553984:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 345us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945968.472061:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 97 00010000:00010000:1.0:1790945968.476453:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000be4eb9a9/0xd9f4181e0d27dfed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.476475:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be4eb9a9/0xd9f4181e0d27dfed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.476520:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be4eb9a9/0xd9f4181e0d27dfed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.476551:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be4eb9a9/0xd9f4181e0d27dfed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.476561:0:8437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be4eb9a9/0xd9f4181e0d27dfed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.476568:0:8437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d6a00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:1.0:1790945968.476572:0:8437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be4eb9a9/0xd9f4181e0d27dfed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.476581:0:8437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be4eb9a9/0xd9f4181e0d27dfed lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.476600:0:8437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be4eb9a9/0xd9f4181e0d27dfed lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.476608:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be4eb9a9/0xd9f4181e0d27dfed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945968.476724:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+9:2403:x1877942616553728:12345-192.168.204.20@tcp:1:lfs.0 Request processed in 19674us (20313us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945968.476734:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 69 00000100:00100000:1.0:1790945968.481494:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945968.481629:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616554240 00000100:00100000:3.0:1790945968.481639:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616554240 00000100:00100000:3.0:1790945968.481702:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 56 00000100:00100000:3.0:1790945968.481712:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4096ddac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+48:12403:x1877942616554240:12345-192.168.204.20@tcp:35:lfs.0 00000004:00010000:3.0:1790945968.481771:0:6525:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afda00/0xd9f4181e0d27dfdf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e1c expref: 48 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790945968.481975:0:6525:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1790945968.482025:0:6525:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:3.0:1790945968.482351:0:6525:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967491 00010000:00010000:3.0:1790945968.482387:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27dff4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.482404:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27df99 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330df9 expref: 52 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.482413:0:6525:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27dff4 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.482446:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27df99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330df9 expref: 52 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.482471:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27df99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330df9 expref: 52 pid: 13005 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945968.482509:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84414a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6525:1877942638624256:192.168.204.20@tcp:104: 00000100:00100000:3.0:1790945968.482590:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40811caa80 going to sleep for 11 seconds 00000100:00100000:1.0:1790945968.501662:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945968.501791:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84414a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6525:1877942638624256:192.168.204.20@tcp:104: 00010000:00010000:3.0:1790945968.501832:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27dff4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945968.501993:0:7471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616554368 00000100:00100000:0.0:1790945968.502001:0:7471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616554368 00010000:00010000:0.0:1790945968.502043:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27df99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330df9 expref: 53 pid: 13005 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945968.502086:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 98 00000100:00100000:0.0:1790945968.502098:0:7471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+53:2404:x1877942616554368:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790945968.502115:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945968.502132:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27df99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330df9 expref: 53 pid: 13005 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.502145:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27df99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330df9 expref: 53 pid: 13005 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.502199:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd600/0xd9f4181e0d27df99 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330df9 expref: 53 pid: 13005 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.502217:0:7471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d40928bd100) 00010000:00010000:0.0:1790945968.502221:0:7471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27dff4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.502248:0:7471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27dff4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.502256:0:7471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27dff4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.502282:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945968.502374:0:7471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+52:2404:x1877942616554368:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 277us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945968.502385:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 98 00010000:00010000:1.0:1790945968.503048:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27dff4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.503067:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27dff4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790945968.503233:0:6525:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967492 00000001:00080000:1.0:1790945968.503362:0:6525:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:1.0:1790945968.503460:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1877942638624384:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790945968.503525:0:6525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945968.503560:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096d1ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1790945968.503674:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638624384 00000100:00100000:2.0:1790945968.503689:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638624384 00000100:00100000:2.0:1790945968.503735:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1790945968.503744:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6525:x1877942638624384:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790945968.503840:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6525:x1877942638624384:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 97us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945968.503847:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1790945968.504607:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1877942638624384:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1790945968.504727:0:6525:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967494 00000100:00100000:1.0:1790945968.504778:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1877942638624512:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790945968.504814:0:6525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945968.504957:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408704fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1790945968.505412:0:12418:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638624512 00000100:00100000:3.0:1790945968.505420:0:12418:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638624512 00000100:00100000:3.0:1790945968.505474:0:12418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1790945968.505492:0:12418:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6525:x1877942638624512:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790945968.505699:0:12418:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6525:x1877942638624512:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 217us (883us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1790945968.505706:0:12418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1790945968.515495:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1877942638624512:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1790945968.515593:0:6525:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:1.0:1790945968.515653:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27dff4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.515665:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27dff4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.515672:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27dff4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.515678:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d6800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:1.0:1790945968.515682:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27dff4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.515711:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27dff4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.515728:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d40928bd100) 00010000:00010000:1.0:1790945968.515731:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1790945968.515737:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27dff4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.515744:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27dff4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790945968.515871:0:6525:0:(mdd_object.c:4180:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1790945968.515932:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1790945968.515944:0:6525:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 419331775068ns, next at 420331772931ns, rc = 0 00000001:00080000:1.0:1790945968.515950:0:6525:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967496 00010000:00010000:1.0:1790945968.515972:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d40928bd100) 00010000:00010000:1.0:1790945968.515975:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1790945968.515982:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afda00/0xd9f4181e0d27dfdf lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e1c expref: 56 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945968.516246:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4096ddac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+55:12403:x1877942616554240:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 34534us (34769us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1790945968.516257:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 56 00000020:00080000:1.0:1790945968.516262:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1790945968.541843:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945968.542220:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616554496 00000100:00100000:2.0:1790945968.542232:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616554496 00000100:00100000:2.0:1790945968.542297:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 218 00000100:00100000:2.0:1790945968.542308:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+55:12403:x1877942616554496:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1790945968.542333:0:8457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945968.542357:0:8457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64a00/0xd9f4181e0d27dffb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330e23 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945968.542414:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64a00/0xd9f4181e0d27dffb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e23 expref: 56 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945968.542429:0:8457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64a00/0xd9f4181e0d27dffb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e23 expref: 56 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945968.542448:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3f824ef300) 00010000:00010000:2.0:1790945968.542451:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790945968.542454:0:8457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c64a00, rc 0) 00000100:00100000:2.0:1790945968.542528:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+56:12403:x1877942616554496:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 222us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945968.542534:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 218 00000100:00100000:2.0:1790945968.545922:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945968.546578:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616554752 00000100:00100000:0.0:1790945968.546589:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616554752 00000100:00100000:2.0:1790945968.546764:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 57 00000100:00100000:2.0:1790945968.546775:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+56:12403:x1877942616554752:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:2.0:1790945968.547264:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+57:12403:x1877942616554752:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 488us (1349us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1790945968.547273:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 57 00010000:00010000:2.0:1790945968.607371:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945968.649454:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945968.649558:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616554880 00000100:00100000:0.0:1790945968.649569:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616554880 00000100:00100000:0.0:1790945968.649633:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 219 00000100:00100000:0.0:1790945968.649642:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+57:12413:x1877942616554880:12345-192.168.204.20@tcp:34:lfs.0 00010000:00010000:0.0:1790945968.649733:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27e002 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.649752:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27e002 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.649764:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27e002 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.649776:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27e009 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.649783:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27e009 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.649805:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27e009 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.649890:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27e010 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.649899:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27e010 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.649906:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27e010 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790945968.649954:0:13005:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27e010 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.649967:0:13005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27e002 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.649992:0:13005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27e002 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.649999:0:13005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27e002 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.650005:0:13005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0400 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945968.650009:0:13005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27e002 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.650017:0:13005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27e002 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.650028:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d3f824ef900) 00010000:00010000:0.0:1790945968.650038:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945968.650043:0:13005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27e002 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.650049:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27e002 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.650063:0:13005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27e009 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.650068:0:13005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27e009 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.650073:0:13005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27e009 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.650077:0:13005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0600 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945968.650079:0:13005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27e009 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.650086:0:13005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27e009 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.650093:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d40bae9c200) 00010000:00010000:0.0:1790945968.650096:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945968.650099:0:13005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27e009 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.650104:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27e009 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.650112:0:13005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27e010 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.650124:0:13005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27e010 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.650130:0:13005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27e010 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.650135:0:13005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0a00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945968.650138:0:13005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27e010 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.650144:0:13005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27e010 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.650152:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3f824ef300) 00010000:00010000:0.0:1790945968.650154:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945968.650157:0:13005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27e010 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.650163:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27e010 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945968.650587:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+57:12413:x1877942616554880:12345-192.168.204.20@tcp:34:lfs.0 Request processed in 943us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945968.650597:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 219 00000100:00100000:0.0:1790945968.737773:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945968.738043:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616555136 00000100:00100000:2.0:1790945968.738053:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616555136 00000100:00100000:2.0:1790945968.738137:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 220 00000100:00100000:2.0:1790945968.738148:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+57:12416:x1877942616555136:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1790945968.738199:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945968.738223:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64e00/0xd9f4181e0d27e017 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330e2a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945968.738468:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27e01e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945968.738494:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27e01e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945968.738506:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27e01e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945968.738519:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27e025 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945968.738527:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27e025 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945968.738533:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27e025 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945968.738657:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65200/0xd9f4181e0d27e02c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945968.738666:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65200/0xd9f4181e0d27e02c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945968.738673:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65200/0xd9f4181e0d27e02c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945968.738683:0:6522:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1790945968.739087:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27e01e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945968.739098:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27e01e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945968.739105:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27e01e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945968.739111:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65e00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945968.739203:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27e01e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945968.739213:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27e01e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945968.739225:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d3f824ef900) 00010000:00010000:2.0:1790945968.739228:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945968.739233:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27e01e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945968.739251:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27e01e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945968.739267:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27e025 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945968.739412:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27e025 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945968.739420:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27e025 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945968.739425:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65a00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945968.739428:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27e025 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945968.739435:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27e025 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945968.739443:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d40bae9c200) 00010000:00010000:2.0:1790945968.739446:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945968.739448:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27e025 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945968.739455:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27e025 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945968.739507:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64e00/0xd9f4181e0d27e017 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e2a expref: 60 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945968.739522:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65200/0xd9f4181e0d27e02c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e2a expref: 59 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945968.739536:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3f824ef300) 00010000:00010000:2.0:1790945968.739538:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790945968.739540:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c65200, rc 0) 00000100:00100000:2.0:1790945968.739691:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+59:12416:x1877942616555136:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 1544us (1941us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1790945968.739700:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 220 00000100:00100000:0.0:1790945968.758598:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945968.758685:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616555264 00000100:00100000:3.0:1790945968.758697:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616555264 00000100:00100000:3.0:1790945968.758778:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 221 00000100:00100000:3.0:1790945968.758788:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+59:12416:x1877942616555264:12345-192.168.204.20@tcp:54:lfs.0 00010000:00010000:3.0:1790945968.758883:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27e03a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.758906:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27e03a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.758921:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27e03a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.758979:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27e03a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.758987:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27e03a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.758993:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27e03a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.759000:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d6800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945968.759004:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27e03a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.759011:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27e03a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.759022:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3f824ef300) 00010000:00010000:3.0:1790945968.759025:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790945968.759030:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27e03a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.759036:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27e03a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945968.759123:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+59:12416:x1877942616555264:12345-192.168.204.20@tcp:54:lfs.0 Request processed in 335us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945968.759132:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 221 00000100:00100000:1.0:1790945968.766464:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945968.766570:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616555520 00000100:00100000:3.0:1790945968.766581:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616555520 00000100:00100000:3.0:1790945968.766641:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 58 00000100:00100000:3.0:1790945968.766666:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+59:12416:x1877942616555520:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:3.0:1790945968.766936:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+60:12416:x1877942616555520:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 271us (482us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1790945968.766944:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 58 00000100:00100000:1.0:1790945968.898515:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945968.898753:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616555776 00000100:00100000:0.0:1790945968.898764:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616555776 00000100:00100000:0.0:1790945968.898892:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 222 00000100:00100000:0.0:1790945968.898903:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+60:12426:x1877942616555776:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:0.0:1790945968.898941:0:13005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945968.898945:0:13005:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790945968.898981:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27dfbc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e0e expref: 60 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.899001:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d3f824ef900) 00010000:00010000:0.0:1790945968.899005:0:13005:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790945968.899018:0:13005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27e041 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330e31 expref: -99 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.900412:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27e048 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.900434:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27e048 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.900445:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27e048 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945968.900457:0:13005:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1790945968.900607:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27e041 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e31 expref: 62 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.900627:0:13005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27e048 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e31 expref: 61 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945968.900636:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3f824ef300) 00010000:00010000:0.0:1790945968.900639:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790945968.900643:0:13005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe0400, rc 0) 00000100:00100000:0.0:1790945968.900738:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+61:12426:x1877942616555776:12345-192.168.204.20@tcp:101:bash.0 Request processed in 1836us (2232us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1790945968.900747:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 222 00000100:00100000:0.0:1790945968.911578:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945968.911623:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945968.911759:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616556032 00000100:00100000:1.0:1790945968.911785:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616556032 00000100:00100000:1.0:1790945968.911871:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:1.0:1790945968.911881:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+61:2401:x1877942616556032:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790945968.911897:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945968.911922:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27e048 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e31 expref: 61 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.911944:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3f824ef300) 00010000:00010000:1.0:1790945968.911949:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945968.912000:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+60:2401:x1877942616556032:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 121us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945968.912008:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:3.0:1790945968.912755:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616555904 00000100:00100000:3.0:1790945968.912762:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616555904 00000100:00100000:3.0:1790945968.912815:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 223 00000100:00100000:3.0:1790945968.912825:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83f61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+60:12426:x1877942616555904:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:3.0:1790945968.912848:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945968.912865:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27e056 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330e38 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.912899:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6a00/0xd9f4181e0d27e05d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.912912:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6a00/0xd9f4181e0d27e05d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.912923:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6a00/0xd9f4181e0d27e05d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.913054:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27e056 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e38 expref: 62 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.913070:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6a00/0xd9f4181e0d27e05d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e38 expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.913078:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3f824ef300) 00010000:00010000:3.0:1790945968.913086:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790945968.913090:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40c21d6a00, rc 0) 00000100:00100000:3.0:1790945968.913141:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83f61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+61:12426:x1877942616555904:12345-192.168.204.20@tcp:101:bash.0 Request processed in 318us (1574us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945968.913148:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 223 00000100:00100000:0.0:1790945968.916867:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945968.917004:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616556288 00000100:00100000:3.0:1790945968.917014:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616556288 00000100:00100000:3.0:1790945968.917067:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 224 00000100:00100000:3.0:1790945968.917076:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84470a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+61:12426:x1877942616556288:12345-192.168.204.20@tcp:36:bash.0 00010000:00010000:3.0:1790945968.917143:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945968.917192:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65200/0xd9f4181e0d27e02c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e2a expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.917213:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3f824ef300) 00010000:00010000:3.0:1790945968.917218:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790945968.917394:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e064 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.917408:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e064 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.917418:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e064 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790945968.917457:0:6521:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967502 00000004:00010000:3.0:1790945968.917517:0:6521:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005936d0bc reply state 00000000e473b207 transno 4294967503 ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e064 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.917530:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e064 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945968.917543:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3f824ef300) 00010000:00010000:3.0:1790945968.917546:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790945968.917549:0:6521:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790945968.917808:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84470a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+63:12426:x1877942616556288:12345-192.168.204.20@tcp:36:bash.0 Request processed in 573us (792us total) trans 4294967503 rc 0/0 00000100:00100000:3.0:1790945968.917818:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 224 00000020:00080000:3.0:1790945968.917824:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790945968.921061:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945968.921140:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616556416 00000100:00100000:1.0:1790945968.921150:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616556416 00000100:00100000:1.0:1790945968.921240:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 225 00000100:00100000:1.0:1790945968.921250:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84471500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+63:12426:x1877942616556416:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:1.0:1790945968.921276:0:13005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945968.921297:0:13005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27e06b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330e3f expref: -99 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.921414:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd800/0xd9f4181e0d27e072 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.921430:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd800/0xd9f4181e0d27e072 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.921442:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd800/0xd9f4181e0d27e072 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790945968.921502:0:13005:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1790945968.921507:0:13005:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790945968.921528:0:13005:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd800/0xd9f4181e0d27e072 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.921554:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27e06b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e3f expref: 65 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.921570:0:13005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd800/0xd9f4181e0d27e072 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e3f expref: 64 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945968.921578:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3f824ef300) 00010000:00010000:1.0:1790945968.921581:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790945968.921584:0:13005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4092afd800, rc 0) 00000100:00100000:1.0:1790945968.921647:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84471500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+64:12426:x1877942616556416:12345-192.168.204.20@tcp:101:bash.0 Request processed in 399us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945968.921665:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 225 00000100:00100000:1.0:1790945968.925497:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945968.925680:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616556672 00000100:00100000:3.0:1790945968.925691:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616556672 00000100:00100000:3.0:1790945968.925764:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 59 00000100:00100000:3.0:1790945968.925777:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+64:12426:x1877942616556672:12345-192.168.204.20@tcp:35:bash.0 00000100:00100000:3.0:1790945968.926042:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+65:12426:x1877942616556672:12345-192.168.204.20@tcp:35:bash.0 Request processed in 267us (564us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1790945968.926051:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 59 00000100:00100000:3.0:1790945968.991565:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790945968.991591:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638624640:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790945968.991681:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945968.991713:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8450ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638624768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790945968.991741:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945968.991858:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638624896:0@lo:400:kworker.0 00000100:00100000:0.0:1790945968.991918:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638625152:0@lo:400:kworker.0 00000100:00100000:1.0:1790945968.991923:0:11925:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638624640 00000100:00100000:1.0:1790945968.991942:0:11925:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638624640 00000100:00100000:1.0:1790945968.992001:0:11925:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638624768 00000100:00100000:1.0:1790945968.992005:0:11925:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638624768 00000100:00100000:1.0:1790945968.992024:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1790945968.992033:0:11925:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84414a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638624640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790945968.992060:0:11925:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42409664 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790945968.992193:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84417100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638625280:0@lo:400:kworker.0 00000100:00100000:3.0:1790945968.994816:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945968.994874:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638625408:0@lo:400:kworker.0 00000100:00100000:3.0:1790945968.994929:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945968.994956:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84414e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638625920:0@lo:400:kworker.0 00000100:00100000:3.0:1790945968.994976:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790945968.995100:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790945968.995116:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638624896 00000100:00100000:3.0:1790945968.995129:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638624896 00000100:00100000:3.0:1790945968.995260:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1790945968.995270:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087037450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3650:x1877942638624896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945968.995322:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087037450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3650:x1877942638624896:12345-0@lo:400:kworker.0 Request processed in 55us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945968.995330:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1790945968.995367:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84416d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638625024:0@lo:400:kworker.0 00000100:00100000:3.0:1790945968.995391:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945968.995408:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84416680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1877942638625536:0@lo:400:kworker.0 00000100:00100000:3.0:1790945968.995424:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945968.995436:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84415180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1877942638626048:0@lo:400:kworker.0 00000100:00100000:3.0:1790945968.995450:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945968.995490:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638625024 00000100:00100000:3.0:1790945968.995494:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638625024 00000100:00100000:3.0:1790945968.995518:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638625536 00000100:00100000:3.0:1790945968.995520:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638625536 00000100:00100000:3.0:1790945968.995543:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638626048 00000100:00100000:3.0:1790945968.995545:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638626048 00000100:00100000:3.0:1790945968.995556:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1790945968.995561:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f845ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638625024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945968.995602:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f845ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638625024:12345-0@lo:400:kworker.0 Request processed in 41us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945968.995608:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1790945968.995617:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1790945968.995622:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f845ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1877942638625536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945968.995647:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f845ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1877942638625536:12345-0@lo:400:kworker.0 Request processed in 24us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945968.995658:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1790945968.995668:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1790945968.995673:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f845ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1877942638626048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945968.995694:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f845ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1877942638626048:12345-0@lo:400:kworker.0 Request processed in 22us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945968.995698:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00080000:3.0:1790945968.995709:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790945968.995735:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84416d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638625024:0@lo:400:kworker.0 00000100:00100000:3.0:1790945968.995746:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84416680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1877942638625536:0@lo:400:kworker.0 00000100:00100000:3.0:1790945968.995754:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84415180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1877942638626048:0@lo:400:kworker.0 00000100:00100000:3.0:1790945968.995787:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638624896:0@lo:400:kworker.0 00000100:00100000:0.0:1790945968.997751:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638625408 00000100:00100000:0.0:1790945968.997766:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638625408 00000100:00100000:0.0:1790945968.997981:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1790945968.997993:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f845ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638625408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945968.998097:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f845ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638625408:12345-0@lo:400:kworker.0 Request processed in 107us (3166us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945968.998104:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1790945968.998339:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945968.998382:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638625792:0@lo:400:kworker.0 00000100:00100000:2.0:1790945968.998424:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945968.998648:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1790945968.998659:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3649:x1877942638624768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790945968.998679:0:8438:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42409664 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790945968.998718:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3649:x1877942638624768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (6975us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945968.998724:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1790945968.998752:0:10099:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638625920 00000100:00100000:2.0:1790945968.998758:0:10099:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638625920 00000100:00100000:2.0:1790945968.998785:0:10099:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638625792 00000100:00100000:2.0:1790945968.998787:0:10099:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638625792 00000100:00100000:2.0:1790945968.998812:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1790945968.998817:0:10099:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f845ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3650:x1877942638625920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945968.998866:0:10099:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f845ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3650:x1877942638625920:12345-0@lo:400:kworker.0 Request processed in 49us (3888us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945968.998872:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1790945968.998883:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1790945968.998887:0:10099:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638625792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945968.998912:0:10099:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638625792:12345-0@lo:400:kworker.0 Request processed in 24us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945968.998918:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1790945968.998974:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638625792:0@lo:400:kworker.0 00000100:00100000:2.0:1790945968.998991:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8450ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638624768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790945968.999043:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638625280 00000100:00100000:2.0:1790945968.999046:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638625280 00000100:00100000:2.0:1790945968.999070:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1790945968.999076:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638625280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945968.999117:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638625280:12345-0@lo:400:kworker.0 Request processed in 40us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945968.999123:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1790945968.999161:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84417100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638625280:0@lo:400:kworker.0 00000100:00080000:3.0:1790945968.999432:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790945968.999541:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638625408:0@lo:400:kworker.0 00000100:00100000:3.0:1790945968.999554:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84414e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638625920:0@lo:400:kworker.0 00000100:00100000:0.0:1790945968.999883:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945968.999923:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1877942638625664:0@lo:400:kworker.0 00000100:00100000:0.0:1790945968.999957:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945968.999987:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1877942638626176:0@lo:400:kworker.0 00000100:00100000:0.0:1790945969.000008:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945969.000046:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638625664 00000100:00100000:0.0:1790945969.000051:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638625664 00000100:00100000:0.0:1790945969.000083:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638626176 00000100:00100000:0.0:1790945969.000086:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638626176 00000100:00100000:0.0:1790945969.000103:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1790945969.000109:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8456a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1877942638625664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945969.000944:0:12418:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638625152 00000100:00100000:3.0:1790945969.000953:0:12418:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638625152 00000100:00100000:3.0:1790945969.001003:0:12418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1790945969.001011:0:12418:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83fbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638625152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945969.001086:0:12418:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83fbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638625152:12345-0@lo:400:kworker.0 Request processed in 76us (1203us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945969.001093:0:12418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1790945969.001350:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1790945969.001361:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8456ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1877942638626176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945969.001401:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8456ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1877942638626176:12345-0@lo:400:kworker.0 Request processed in 44us (1392us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945969.001407:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00080000:2.0:1790945969.001544:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790945969.002648:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8456a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1877942638625664:12345-0@lo:400:kworker.0 Request processed in 2536us (2687us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945969.003375:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1790945969.004103:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638625152:0@lo:400:kworker.0 00010000:00080000:0.0:1790945969.004222:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f84414380 x1877942638625664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945984 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945969.004365:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1877942638625664:0@lo:400:kworker.0 00010000:00080000:0.0:1790945969.004381:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f84414700 x1877942638626176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945984 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945969.004388:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1877942638626176:0@lo:400:kworker.0 00000100:00100000:1.0:1790945969.006036:0:11925:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84414a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638624640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 13994us (14346us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945969.006073:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1790945969.007255:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638624640:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790945969.010027:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945969.010222:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616556800 00000100:00100000:3.0:1790945969.010246:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616556800 00000100:00100000:3.0:1790945969.010683:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 226 00000100:00100000:3.0:1790945969.010700:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+65:12432:x1877942616556800:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1790945969.010732:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945969.010755:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27e079 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330e46 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.010845:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27e080 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.010861:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27e080 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.010871:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27e080 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945969.010918:0:6521:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1790945969.010922:0:6521:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790945969.011156:0:6521:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27e080 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.011223:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27e079 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e46 expref: 67 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.011255:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27e080 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e46 expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.011264:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d3f824ef900) 00010000:00010000:3.0:1790945969.011267:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790945969.011270:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40c21d6800, rc 0) 00000100:00100000:3.0:1790945969.011408:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+66:12432:x1877942616556800:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 711us (1390us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945969.011417:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 226 00000100:00100000:0.0:1790945969.016729:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945969.017504:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616556928 00000100:00100000:2.0:1790945969.017515:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616556928 00000100:00100000:2.0:1790945969.017574:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 227 00000100:00100000:2.0:1790945969.017583:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8456b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+66:12432:x1877942616556928:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1790945969.017603:0:13005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945969.017622:0:13005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27e087 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330e4d expref: -99 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.017703:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27e08e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.017718:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27e08e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.017730:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27e08e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.017742:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65600/0xd9f4181e0d27e095 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.017757:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65600/0xd9f4181e0d27e095 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.017764:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65600/0xd9f4181e0d27e095 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.017839:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64400/0xd9f4181e0d27e09c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.017848:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64400/0xd9f4181e0d27e09c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.017872:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64400/0xd9f4181e0d27e09c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945969.017917:0:13005:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1790945969.017921:0:13005:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790945969.017948:0:13005:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64400/0xd9f4181e0d27e09c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.017961:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64400/0xd9f4181e0d27e09c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.017969:0:13005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27e08e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.017975:0:13005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27e08e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.017982:0:13005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27e08e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.017988:0:13005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65e00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945969.017992:0:13005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27e08e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.018000:0:13005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27e08e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.018012:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d3f824ef900) 00010000:00010000:2.0:1790945969.018015:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945969.018019:0:13005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27e08e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.018036:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27e08e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.018051:0:13005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65600/0xd9f4181e0d27e095 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.018057:0:13005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65600/0xd9f4181e0d27e095 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.018063:0:13005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65600/0xd9f4181e0d27e095 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.018068:0:13005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65600 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945969.018071:0:13005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65600/0xd9f4181e0d27e095 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.018720:0:13005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65600/0xd9f4181e0d27e095 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.018735:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d40bae9c200) 00010000:00010000:2.0:1790945969.018738:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945969.018742:0:13005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65600/0xd9f4181e0d27e095 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.018748:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65600/0xd9f4181e0d27e095 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.018786:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27e087 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e4d expref: 68 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.018814:0:13005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64400/0xd9f4181e0d27e09c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e4d expref: 67 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.018821:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3f824ef300) 00010000:00010000:2.0:1790945969.018823:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790945969.018826:0:13005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c64400, rc 0) 00000100:00100000:2.0:1790945969.018905:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8456b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+67:12432:x1877942616556928:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 1322us (2185us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945969.018913:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 227 00000100:00100000:1.0:1790945969.022257:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945969.022351:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945969.023278:0:7471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616557056 00000100:00100000:0.0:1790945969.023290:0:7471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616557056 00000100:00100000:0.0:1790945969.023360:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:0.0:1790945969.023371:0:7471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+67:2402:x1877942616557056:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790945969.023387:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945969.023412:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64400/0xd9f4181e0d27e09c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e4d expref: 67 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.023432:0:7471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3f824ef300) 00010000:00010000:0.0:1790945969.023437:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945969.023513:0:7471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+66:2402:x1877942616557056:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 144us (1266us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945969.023522:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:2.0:1790945969.024272:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616557312 00000100:00100000:2.0:1790945969.024280:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616557312 00000100:00100000:2.0:1790945969.024330:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 228 00000100:00100000:2.0:1790945969.024339:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+66:12432:x1877942616557312:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1790945969.024359:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945969.024378:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64c00/0xd9f4181e0d27e0a3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330e54 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.024536:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27e0aa lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.024551:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd800/0xd9f4181e0d27e072 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e3f expref: 67 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.024561:0:6523:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27e0aa lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.024596:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd800/0xd9f4181e0d27e072 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e3f expref: 67 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.024620:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd800/0xd9f4181e0d27e072 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e3f expref: 67 pid: 13005 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945969.024635:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8450f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1877942638626304:192.168.204.20@tcp:104: 00000100:00100000:2.0:1790945969.024709:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40854e5240 going to sleep for 11 seconds 00000100:00100000:2.0:1790945969.027581:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8450f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1877942638626304:192.168.204.20@tcp:104: 00010000:00010000:2.0:1790945969.027613:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27e0aa lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945969.030620:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945969.030730:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616557440 00000100:00100000:3.0:1790945969.030745:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616557440 00010000:00010000:3.0:1790945969.030810:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd800/0xd9f4181e0d27e072 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e3f expref: 68 pid: 13005 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945969.030861:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 99 00000100:00100000:3.0:1790945969.030874:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+68:2404:x1877942616557440:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790945969.030893:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945969.030901:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd800/0xd9f4181e0d27e072 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e3f expref: 68 pid: 13005 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.030915:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd800/0xd9f4181e0d27e072 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e3f expref: 68 pid: 13005 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.030958:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd800/0xd9f4181e0d27e072 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e3f expref: 68 pid: 13005 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.030977:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3f824ef300) 00010000:00010000:3.0:1790945969.030983:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27e0aa lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.030994:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27e0aa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.031002:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27e0aa lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.031058:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790945969.031116:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27e0aa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.031125:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27e0aa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945969.031150:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000100:00100000:3.0:1790945969.031303:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+68:2404:x1877942616557440:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 431us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945969.031311:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 99 00010000:00010000:2.0:1790945969.031336:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64c00/0xd9f4181e0d27e0a3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e54 expref: 68 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.031352:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27e0aa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e54 expref: 67 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.031360:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3f824ef300) 00010000:00010000:2.0:1790945969.031362:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790945969.031364:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c64800, rc 0) 00000100:00100000:2.0:1790945969.031388:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+67:12432:x1877942616557312:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 7051us (9038us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1790945969.031404:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 228 00000100:00100000:1.0:1790945969.034503:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945969.034583:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616557696 00000100:00100000:3.0:1790945969.034594:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616557696 00000100:00100000:3.0:1790945969.034658:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 18 00000100:00100000:3.0:1790945969.034668:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4096cb8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+67:12432:x1877942616557696:12345-192.168.204.20@tcp:103:lfs.0 00010000:00010000:3.0:1790945969.034685:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945969.034709:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64a00/0xd9f4181e0d27dffb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e23 expref: 67 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.034726:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3f824ef300) 00010000:00010000:3.0:1790945969.034731:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945969.034796:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4096cb8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+66:12432:x1877942616557696:12345-192.168.204.20@tcp:103:lfs.0 Request processed in 130us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945969.034804:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 18 00000100:00100000:0.0:1790945969.037376:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945969.037734:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616557824 00000100:00100000:3.0:1790945969.037744:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616557824 00000100:00100000:3.0:1790945969.037818:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 229 00000100:00100000:3.0:1790945969.037827:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+66:12432:x1877942616557824:12345-192.168.204.20@tcp:58:lfs.0 00010000:00010000:3.0:1790945969.038668:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27e0b8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.038690:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27e0b8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.038714:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27e0b8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790945969.038819:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1790945969.038916:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+66:12432:x1877942616557824:12345-192.168.204.20@tcp:58:lfs.0 Request processed in 1088us (1548us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945969.039011:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 229 00000100:00100000:1.0:1790945969.043948:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945969.044433:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616557952 00000100:00100000:2.0:1790945969.044570:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616557952 00000100:00100000:2.0:1790945969.044665:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 230 00000100:00100000:2.0:1790945969.044676:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+66:12432:x1877942616557952:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1790945969.044697:0:13005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945969.044718:0:13005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64c00/0xd9f4181e0d27e0bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330e5b expref: -99 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.044805:0:13005:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27e0b8 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.044816:0:13005:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64c00/0xd9f4181e0d27e0bf lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e5b expref: 67 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.044836:0:13005:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27e0b8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.044849:0:13005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64c00/0xd9f4181e0d27e0bf lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e5b expref: 67 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.044863:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3f824ef300) 00010000:00010000:2.0:1790945969.044867:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790945969.044870:0:13005:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64c00/0xd9f4181e0d27e0bf lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e5b expref: 67 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.044878:0:13005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c64c00, rc 0) 00000100:00100000:2.0:1790945969.044970:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+67:12432:x1877942616557952:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 296us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945969.044978:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 230 00000040:00080000:3.0:1790945969.504244:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790945969.504254:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790945969.504282:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1790945969.504291:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790945969.504437:0:13803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f845ed180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13803:1877942638626432:192.168.204.20@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790945969.504624:0:13803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40811caa80 going to sleep for 11 seconds 00000100:00100000:1.0:1790945969.515385:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945969.515509:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616558080 00000100:00100000:2.0:1790945969.515520:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616558080 00000100:00100000:2.0:1790945969.515592:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 231 00000100:00100000:2.0:1790945969.515603:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+68:12433:x1877942616558080:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790945969.516558:0:6523:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790945969.516758:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+68:12433:x1877942616558080:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 Request processed in 1154us (1594us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945969.516768:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 231 00000100:00100000:3.0:1790945969.517513:0:13803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f845ed180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13803:1877942638626432:192.168.204.20@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790945969.539622:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945969.540270:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616558208 00000100:00100000:3.0:1790945969.540281:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616558208 00000100:00100000:3.0:1790945969.540344:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 232 00000100:00100000:3.0:1790945969.540356:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+67:12433:x1877942616558208:12345-192.168.204.20@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1790945969.540438:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0800/0xd9f4181e0d27e0c6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.540458:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0800/0xd9f4181e0d27e0c6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.540484:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0800/0xd9f4181e0d27e0c6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.540515:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1000/0xd9f4181e0d27e0cd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.540524:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1000/0xd9f4181e0d27e0cd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.540531:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1000/0xd9f4181e0d27e0cd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.540569:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1c00/0xd9f4181e0d27e0d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.540579:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1c00/0xd9f4181e0d27e0d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.540586:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1c00/0xd9f4181e0d27e0d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945969.540638:0:6521:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1790945969.540643:0:6521:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790945969.540656:0:6521:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1c00/0xd9f4181e0d27e0d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.540668:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0800/0xd9f4181e0d27e0c6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.540675:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0800/0xd9f4181e0d27e0c6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.540683:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0800/0xd9f4181e0d27e0c6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.540699:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef0800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945969.540703:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0800/0xd9f4181e0d27e0c6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.540711:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0800/0xd9f4181e0d27e0c6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.540721:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3f824ec400) 00010000:00010000:3.0:1790945969.540724:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945969.540729:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0800/0xd9f4181e0d27e0c6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.540736:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0800/0xd9f4181e0d27e0c6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.540750:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1000/0xd9f4181e0d27e0cd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.540756:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1000/0xd9f4181e0d27e0cd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.540761:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1000/0xd9f4181e0d27e0cd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.540765:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef1000 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945969.540768:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1000/0xd9f4181e0d27e0cd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.540773:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1000/0xd9f4181e0d27e0cd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.540791:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9d40bae9c500) 00010000:00010000:3.0:1790945969.540794:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945969.540797:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1000/0xd9f4181e0d27e0cd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.540802:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1000/0xd9f4181e0d27e0cd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.540820:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1c00/0xd9f4181e0d27e0d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.540825:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1c00/0xd9f4181e0d27e0d4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.540830:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1c00/0xd9f4181e0d27e0d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.540835:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef1c00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945969.540838:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1c00/0xd9f4181e0d27e0d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.540843:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1c00/0xd9f4181e0d27e0d4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.540864:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3f824ef300) 00010000:00010000:3.0:1790945969.540866:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945969.540869:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1c00/0xd9f4181e0d27e0d4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.540874:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1c00/0xd9f4181e0d27e0d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945969.540969:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+67:12433:x1877942616558208:12345-192.168.204.20@tcp:34:lhsmtool_posix.0 Request processed in 616us (1357us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945969.540979:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 232 00000100:00100000:0.0:1790945969.553678:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945969.553841:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616558464 00000100:00100000:2.0:1790945969.553852:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616558464 00000100:00100000:2.0:1790945969.553916:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 233 00000100:00100000:2.0:1790945969.553934:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4096d06050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+67:12433:x1877942616558464:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790945969.553954:0:13005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945969.553974:0:13005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27e0db lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330e62 expref: -99 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.554080:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65600/0xd9f4181e0d27e0e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.554095:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65600/0xd9f4181e0d27e0e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.554120:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65600/0xd9f4181e0d27e0e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945969.554142:0:13005:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1790945969.554643:0:13005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65600/0xd9f4181e0d27e0e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.554652:0:13005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65600/0xd9f4181e0d27e0e2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.554658:0:13005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65600/0xd9f4181e0d27e0e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.554664:0:13005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65600 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945969.554668:0:13005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65600/0xd9f4181e0d27e0e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.554676:0:13005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65600/0xd9f4181e0d27e0e2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.554687:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3f824ef300) 00010000:00010000:2.0:1790945969.554690:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790945969.554694:0:13005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65600/0xd9f4181e0d27e0e2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.554700:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65600/0xd9f4181e0d27e0e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.554739:0:13005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27e0db lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e62 expref: 69 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.554748:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3f824ec400) 00010000:00010000:2.0:1790945969.554750:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790945969.554761:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27e0db lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e62 expref: 69 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.554770:0:13005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c65a00, rc 0) 00000100:00100000:2.0:1790945969.554832:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4096d06050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+68:12433:x1877942616558464:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 906us (1164us total) trans 4294967506 rc 301/301 00000100:00100000:2.0:1790945969.554839:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 233 00000100:00100000:1.0:1790945969.560253:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945969.560305:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616558592 00000100:00100000:2.0:1790945969.560316:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616558592 00000100:00100000:2.0:1790945969.560388:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 234 00000100:00100000:2.0:1790945969.560399:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+68:12433:x1877942616558592:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790945969.560438:0:6523:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790945969.560847:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+68:12433:x1877942616558592:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 Request processed in 169us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945969.560855:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 234 00000100:00100000:1.0:1790945969.566279:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945969.566579:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616558848 00000100:00100000:2.0:1790945969.566589:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616558848 00000100:00100000:2.0:1790945969.566641:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 235 00000100:00100000:2.0:1790945969.566650:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+68:12433:x1877942616558848:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790945969.566671:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945969.566674:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790945969.566698:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27e080 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e46 expref: 68 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.566717:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d3f824ef900) 00010000:00010000:2.0:1790945969.566724:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790945969.566736:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27e0f0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330e69 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790945969.571194:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:2.0:1790945969.571424:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65600/0xd9f4181e0d27e0f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.571442:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65600/0xd9f4181e0d27e0f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.571454:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65600/0xd9f4181e0d27e0f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.571532:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27e0f0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e69 expref: 70 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.571552:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65600/0xd9f4181e0d27e0f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e69 expref: 69 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.571562:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d3f824ef200) 00010000:00010000:2.0:1790945969.571565:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790945969.571568:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c65600, rc 0) 00000100:00100000:2.0:1790945969.571649:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+69:12433:x1877942616558848:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 4999us (5380us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1790945969.571659:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 235 00000100:00100000:0.0:1790945969.581494:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945969.583206:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616559104 00000100:00100000:2.0:1790945969.583225:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616559104 00000100:00100000:2.0:1790945969.583309:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 236 00000100:00100000:2.0:1790945969.583319:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+69:12433:x1877942616559104:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790945969.583389:0:13005:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945969.583434:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65600/0xd9f4181e0d27e0f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e69 expref: 69 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.583454:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d3f824ef200) 00010000:00010000:2.0:1790945969.583477:0:13005:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790945969.583499:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27e105 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.583628:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27e105 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.583642:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27e105 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.583659:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27e10c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x7d3c880c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.583670:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27e10c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x7d3c880c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.583677:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27e10c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x7d3c880c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.583726:0:13005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27e105 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.583738:0:13005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27e105 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.583752:0:13005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27e105 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.583759:0:13005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65a00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945969.583769:0:13005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27e105 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.583780:0:13005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27e105 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.583858:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d3f824ef900) 00010000:00010000:2.0:1790945969.583862:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945969.583871:0:13005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27e105 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.583877:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27e105 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.583888:0:13005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27e10c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x7d3c880c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.584131:0:13005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27e10c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x7d3c880c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.584140:0:13005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27e10c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x7d3c880c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.584146:0:13005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65e00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945969.584150:0:13005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27e10c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x7d3c880c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.584156:0:13005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27e10c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x7d3c880c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.584165:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x7d3c880c (ffff9d3f824ef100) 00010000:00010000:2.0:1790945969.584215:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945969.584358:0:13005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27e10c lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x7d3c880c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.584366:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27e10c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x7d3c880c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945969.586302:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+68:12433:x1877942616559104:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 2973us (4808us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790945969.586314:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 236 00000100:00100000:1.0:1790945969.595595:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945969.595675:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616559232 00000100:00100000:2.0:1790945969.595687:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616559232 00000100:00100000:2.0:1790945969.595749:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 237 00000100:00100000:2.0:1790945969.595759:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+68:12433:x1877942616559232:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790945969.595781:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945969.595806:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27e113 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330e70 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.595940:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27e11a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.595956:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27e11a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.595968:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27e11a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.596078:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27e113 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e70 expref: 70 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.596098:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27e11a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e70 expref: 69 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.596213:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d3f824efa00) 00010000:00010000:2.0:1790945969.596216:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790945969.596219:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c65400, rc 0) 00000100:00100000:2.0:1790945969.596269:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+69:12433:x1877942616559232:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 511us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945969.596277:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 237 00000100:00100000:1.0:1790945969.609760:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945969.616641:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616559488 00000100:00100000:2.0:1790945969.616660:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616559488 00000100:00100000:0.0:1790945969.625663:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 238 00000100:00100000:0.0:1790945969.625679:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+69:12433:x1877942616559488:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790945969.625779:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27e121 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.625804:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27e121 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.625817:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27e121 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790945969.625984:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:0.0:1790945969.625994:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 420441825455ns, next at 421441822901ns, rc = 0 00000004:00010000:0.0:1790945969.626040:0:6522:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008b4f819c reply state 00000000aba7e4fd transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27e121 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.626053:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27e121 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.626060:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d3f824efa00) 00010000:00010000:0.0:1790945969.626075:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1790945969.626080:0:6522:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790945969.626222:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+71:12433:x1877942616559488:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 546us (16483us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1790945969.626230:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 238 00010000:00010000:0.0:1790945969.635490:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945969.646064:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945969.646564:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616559616 00000100:00100000:3.0:1790945969.646574:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616559616 00000100:00100000:3.0:1790945969.646639:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 239 00000100:00100000:3.0:1790945969.646650:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+71:12433:x1877942616559616:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790945969.646674:0:13005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945969.646694:0:13005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1c00/0xd9f4181e0d27e128 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330e77 expref: -99 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.646765:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1c00/0xd9f4181e0d27e128 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e77 expref: 72 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.646781:0:13005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1c00/0xd9f4181e0d27e128 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e77 expref: 72 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.646978:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d3f824efa00) 00010000:00010000:3.0:1790945969.646982:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790945969.646986:0:13005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40baef1c00, rc 0) 00000100:00100000:3.0:1790945969.647051:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+72:12433:x1877942616559616:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 403us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945969.647059:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 239 00000100:00100000:1.0:1790945969.653632:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945969.654565:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616559744 00000100:00100000:3.0:1790945969.654577:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616559744 00000100:00100000:3.0:1790945969.654661:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 70 00000100:00100000:3.0:1790945969.654684:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+9:2404:x1877942616559744:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1790945969.655101:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+10:2404:x1877942616559744:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 Request processed in 419us (1478us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1790945969.655110:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 70 00000100:00080000:0.0:1790945969.655899:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790945969.666623:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945969.666715:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616560000 00000100:00100000:3.0:1790945969.666726:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616560000 00000100:00100000:3.0:1790945969.666783:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 60 00000100:00100000:3.0:1790945969.666793:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+72:12433:x1877942616560000:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790945969.667018:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+73:12433:x1877942616560000:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 Request processed in 226us (405us total) trans 4294967509 rc 0/0 00000100:00100000:3.0:1790945969.667026:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 60 00000100:00100000:1.0:1790945969.678879:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945969.678994:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616560256 00000100:00100000:2.0:1790945969.679006:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616560256 00000100:00100000:2.0:1790945969.679070:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 240 00000100:00100000:2.0:1790945969.679081:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+73:12433:x1877942616560256:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790945969.679245:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+73:12433:x1877942616560256:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 166us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945969.679253:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 240 00000100:00100000:1.0:1790945969.683452:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945969.684222:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616560384 00000100:00100000:0.0:1790945969.684234:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616560384 00000100:00100000:0.0:1790945969.684317:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 241 00000100:00100000:0.0:1790945969.684327:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+73:12433:x1877942616560384:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790945969.684347:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945969.684365:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27e12f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330e7e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.684433:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27e136 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.684448:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27e136 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.684470:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27e136 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945969.684518:0:6522:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790945969.684539:0:6522:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27e136 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.684566:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27e12f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e7e expref: 75 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.684585:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27e136 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e7e expref: 74 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.684594:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d3f824efa00) 00010000:00010000:0.0:1790945969.684597:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790945969.684600:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe1a00, rc 0) 00000100:00100000:0.0:1790945969.684679:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+74:12433:x1877942616560384:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 354us (1250us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945969.684700:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 241 00000100:00100000:1.0:1790945969.691206:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945969.695405:0:8436:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616560512 00000100:00100000:2.0:1790945969.695421:0:8436:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616560512 00000100:00100000:2.0:1790945969.695508:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 71 00000100:00100000:2.0:1790945969.695518:0:8436:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+10:2404:x1877942616560512:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790945969.695540:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945969.695560:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aaf3bb43/0xd9f4181e0d27e13d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330e85 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790945969.695586:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abfaab1, blocks: 0x0 00010000:00010000:2.0:1790945969.695607:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=420s v=(0 0) 00010000:00010000:2.0:1790945969.695625:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790945969.695635:0:8436:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf3bb43/0xd9f4181e0d27e13d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e85 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.695652:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000aaf3bb43/0xd9f4181e0d27e13d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e85 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.695665:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c65e00, rc 0) 00000100:00100000:2.0:1790945969.695737:0:8436:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+11:2404:x1877942616560512:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 219us (4541us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945969.695744:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 71 00000100:00100000:1.0:1790945969.720062:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945969.720162:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616560768 00000100:00100000:3.0:1790945969.720213:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616560768 00000100:00100000:3.0:1790945969.720294:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 242 00000100:00100000:3.0:1790945969.720304:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+74:12433:x1877942616560768:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790945969.720420:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+74:12433:x1877942616560768:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 117us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945969.720427:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 242 00000100:00100000:1.0:1790945969.722762:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945969.723298:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616560896 00000100:00100000:2.0:1790945969.723311:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616560896 00000100:00100000:2.0:1790945969.723382:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 72 00000100:00100000:2.0:1790945969.723392:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+11:12433:x1877942616560896:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790945969.723420:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945969.723520:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed15cc62/0xd9f4181e0d27e144 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330e8c expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.723555:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aaf3bb43/0xd9f4181e0d27e13d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e85 expref: 12 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.723564:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790945969.723568:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790945969.723574:0:8435:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed15cc62/0xd9f4181e0d27e144 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e8c expref: 12 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.723630:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aaf3bb43/0xd9f4181e0d27e13d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e85 expref: 12 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.723645:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aaf3bb43/0xd9f4181e0d27e13d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e85 expref: 12 pid: 8436 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945969.723658:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8450c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1877942638626560:192.168.204.20@tcp:104: 00000100:00100000:2.0:1790945969.723772:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408aad8600 going to sleep for 11 seconds 00000100:00100000:2.0:1790945969.730665:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945969.731213:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616561024 00000100:00100000:1.0:1790945969.731226:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616561024 00010000:00010000:1.0:1790945969.731281:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf3bb43/0xd9f4181e0d27e13d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e85 expref: 13 pid: 8436 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945969.731322:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 100 00000100:00100000:1.0:1790945969.731332:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+13:2403:x1877942616561024:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790945969.731367:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945969.731391:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aaf3bb43/0xd9f4181e0d27e13d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e85 expref: 13 pid: 8436 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945969.731406:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aaf3bb43/0xd9f4181e0d27e13d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e85 expref: 13 pid: 8436 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945969.731435:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945969.731440:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945969.731448:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ed15cc62/0xd9f4181e0d27e144 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e8c expref: 13 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945969.731468:0:6507:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed15cc62/0xd9f4181e0d27e144 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e8c expref: 13 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945969.731505:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ed15cc62/0xd9f4181e0d27e144 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e8c expref: 13 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945969.731519:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff94000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6507:1877942638626688:192.168.204.20@tcp:105: 00000100:00100000:1.0:1790945969.731609:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4090140b40 going to sleep for 11 seconds 00010000:00010000:0.0:1790945969.731788:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aaf3bb43/0xd9f4181e0d27e13d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e85 expref: 13 pid: 8436 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945969.731805:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8450c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1877942638626560:192.168.204.20@tcp:104: 00010000:00010000:0.0:1790945969.731936:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ed15cc62/0xd9f4181e0d27e144 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e8c expref: 12 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.732065:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c65600, rc 0) 00000100:00100000:0.0:1790945969.732101:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+12:12433:x1877942616560896:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 8711us (9360us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945969.732110:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 72 00000100:00100000:1.0:1790945969.743720:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945969.743875:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff94000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6507:1877942638626688:192.168.204.20@tcp:105: 00010000:00010000:2.0:1790945969.743899:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945969.743967:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+11:2403:x1877942616561024:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 12636us (13312us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945969.743979:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 100 00000100:00100000:3.0:1790945969.745114:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616561152 00000100:00100000:3.0:1790945969.745126:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616561152 00002000:00100000:3.0:1790945969.745201:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9d40bff97100 x1877942616561152/t0(0) o4->0cadc7a5-c0ba-4320-984f-d871ffb3a3ef@192.168.204.20@tcp:665/0 lens 504/0 e 0 to 0 dl 1790945980 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790945969.745211:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d40bff97100 with x1877942616561152 ext(0->12) 00002000:00010000:3.0:1790945969.745216:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d40bff97100 00000100:00100000:3.0:1790945969.745251:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00100000:3.0:1790945969.745276:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+11:2404:x1877942616561152:12345-192.168.204.20@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1790945969.746579:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+13:2404:x1877942616561152:12345-192.168.204.20@tcp:4:lhsmtool_posix.0 Request processed in 1297us (2862us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1790945969.746591:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 6 00002000:00100000:3.0:1790945969.746601:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9d40bff97100 x1877942616561152/t4294967321(0) o4->0cadc7a5-c0ba-4320-984f-d871ffb3a3ef@192.168.204.20@tcp:665/0 lens 504/448 e 0 to 0 dl 1790945980 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790945969.746610:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d40bff97100 with x1877942616561152 ext(0->12) 00002000:00010000:3.0:1790945969.746615:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d40bff97100 00000100:00100000:2.0:1790945969.750310:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945969.750436:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616561280 00000100:00100000:3.0:1790945969.750450:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616561280 00000100:00100000:3.0:1790945969.750535:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 243 00000100:00100000:3.0:1790945969.750546:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+74:12433:x1877942616561280:12345-192.168.204.20@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1790945969.752921:0:6500:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967509 is committed 00000004:00080000:2.0:1790945969.752939:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000004:00080000:2.0:1790945969.752985:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1790945969.753001:0:6500:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d4090dca300 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1790945969.753006:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d3f835f6d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d4090dcaa80 00000020:00080000:2.0:1790945969.753009:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d3f835f6200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d408a4b6000 00000020:00080000:2.0:1790945969.753062:0:6500:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d4096d1ac00 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1790945969.753065:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d40bca9e200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d4096d1ad80 00000020:00080000:2.0:1790945969.753078:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d40bca9e100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d4087072c00 00000020:00080000:2.0:1790945969.753092:0:6500:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:1.0:1790945969.753332:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638626944:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1790945969.753402:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945969.753443:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790945969.753449:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638626816:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1790945969.753493:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945969.753525:0:8436:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638626944 00000100:00100000:1.0:1790945969.753533:0:8436:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638626944 00000100:00100000:1.0:1790945969.753581:0:8436:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638626816 00000100:00100000:1.0:1790945969.753585:0:8436:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638626816 00000100:00100000:1.0:1790945969.753605:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790945969.753611:0:8436:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3650:x1877942638626944:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1790945969.753734:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1790945969.753738:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1790945969 00002000:00010000:1.0:1790945969.753829:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1790945969.753832:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1790945969 -> 1790945969 00002000:00010000:1.0:1790945969.753835:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1790945969.753878:0:8436:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3650:x1877942638626944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 265us (476us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1790945969.753886:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790945969.753903:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790945969.753910:0:8436:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3650:x1877942638626816:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1790945969.753922:0:8436:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:1.0:1790945969.753940:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2e0ef2c/0xd9f4181e0d27e14b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945969.754161:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009fdabf0f/0xd9f4181e0d27deff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330de4 expref: 12 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945969.754194:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1790945969.754198:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790945969.754204:0:8436:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2e0ef2c/0xd9f4181e0d27e14b lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945969.754240:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009fdabf0f/0xd9f4181e0d27deff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330de4 expref: 12 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945969.754254:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009fdabf0f/0xd9f4181e0d27deff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330de4 expref: 12 pid: 8437 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945969.754267:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff94a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1877942638627072:192.168.204.20@tcp:104: 00000100:00100000:1.0:1790945969.754327:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4090140b40 going to sleep for 11 seconds 00000004:00080000:1.0:1790945969.754367:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d40bff96680/2, rc 0, transno 4294967322 00000100:00100000:1.0:1790945969.754373:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638626944:0@lo:2:osp-syn-0-0.0 00000020:00080000:3.0:1790945969.754707:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1790945969.754766:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1790945969.755029:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+27:12433:x1877942616561280:12345-192.168.204.20@tcp:44:lhsmtool_posix.0 Request processed in 4483us (4729us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945969.755039:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 243 00010000:00010000:0.0:1790945969.755793:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27de49 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.755806:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27de49 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.755813:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27de49 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.755818:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65000 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945969.755823:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27de49 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.755831:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27de49 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.755864:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d40bc937d00) 00010000:00010000:0.0:1790945969.755867:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945969.755872:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27de49 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.755878:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27de49 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.755910:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27def1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.755916:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27def1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.755921:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27def1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.755926:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945969.755929:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27def1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.755935:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27def1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.755942:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d3f824efb00) 00010000:00010000:0.0:1790945969.755944:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945969.755960:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27def1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.755967:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27def1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.756008:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27df6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.756016:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27df6f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.756022:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27df6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.756027:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080031400 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945969.756030:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27df6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.756036:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27df6f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.756044:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d40bae9c200) 00010000:00010000:0.0:1790945969.756046:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945969.756048:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27df6f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.756053:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031400/0xd9f4181e0d27df6f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.756066:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afce00/0xd9f4181e0d27df92 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.756073:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afce00/0xd9f4181e0d27df92 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.756079:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afce00/0xd9f4181e0d27df92 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.756090:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afce00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945969.756093:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afce00/0xd9f4181e0d27df92 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.756111:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afce00/0xd9f4181e0d27df92 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.756119:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d40bae9c200) 00010000:00010000:0.0:1790945969.756122:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945969.756124:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afce00/0xd9f4181e0d27df92 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.756130:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afce00/0xd9f4181e0d27df92 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.756146:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e064 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.756153:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e064 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.756158:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e064 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.756163:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080030a00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945969.756193:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e064 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.756200:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e064 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.756218:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3f824ef300) 00010000:00010000:0.0:1790945969.756221:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945969.756223:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e064 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.756229:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e064 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.756250:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27e121 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.756256:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27e121 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.756262:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27e121 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.756267:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0e00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945969.756270:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27e121 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.756275:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27e121 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.756283:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d3f824efa00) 00010000:00010000:0.0:1790945969.756285:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790945969.756288:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27e121 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.756294:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0e00/0xd9f4181e0d27e121 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1790945969.756393:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790945969.756402:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790945969.756427:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8456bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638627200:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1790945969.756494:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945969.756534:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638627200 00000100:00100000:0.0:1790945969.756542:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638627200 00000100:00100000:0.0:1790945969.756587:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790945969.756596:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8456b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3648:x1877942638627200:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1790945969.756620:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:0.0:1790945969.756650:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6abfaab0, atime: 0x6abfaab0, ctime: 0x6abfaab0, blocks: 0x8 00010000:00010000:0.0:1790945969.756657:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e4ceb59/0xd9f4181e0d27e152 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.756677:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=420s v=(0 0) 00010000:00010000:0.0:1790945969.756683:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790945969.756689:0:8435:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e4ceb59/0xd9f4181e0d27e152 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.756703:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e4ceb59/0xd9f4181e0d27e152 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.756711:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e4ceb59/0xd9f4181e0d27e152 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.756718:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e4ceb59/0xd9f4181e0d27e152 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.756746:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790945969.756899:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8456b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3648:x1877942638627200:12345-0@lo:6:osp-syn-1-0.0 Request processed in 305us (405us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1790945969.756906:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:0.0:1790945969.756929:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790945969.756934:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e4ceb59/0xd9f4181e0d27e152 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.756942:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0200 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:0.0:1790945969.756945:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e4ceb59/0xd9f4181e0d27e152 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.756952:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e4ceb59/0xd9f4181e0d27e152 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.756964:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e4ceb59/0xd9f4181e0d27e152 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.756971:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e4ceb59/0xd9f4181e0d27e152 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.756986:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945969.756988:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945969.756989:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790945969.756999:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1790945969.757027:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d3f8456bb80/2, rc 0, transno 4294967311 00000100:00100000:0.0:1790945969.757039:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8456bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638627200:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1790945969.761079:0:9515:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:0.0:1790945969.761104:0:9515:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:1.0:1790945969.761440:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945969.761520:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616561408 00000100:00100000:0.0:1790945969.761529:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616561408 00010000:00010000:0.0:1790945969.761566:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009fdabf0f/0xd9f4181e0d27deff lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330de4 expref: 13 pid: 8437 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945969.761609:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 101 00000100:00100000:0.0:1790945969.761618:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+13:2403:x1877942616561408:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790945969.761634:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945969.761640:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009fdabf0f/0xd9f4181e0d27deff lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330de4 expref: 13 pid: 8437 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.761654:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009fdabf0f/0xd9f4181e0d27deff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330de4 expref: 13 pid: 8437 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.761680:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790945969.761684:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790945969.761690:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f2e0ef2c/0xd9f4181e0d27e14b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.761701:0:6506:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2e0ef2c/0xd9f4181e0d27e14b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.761722:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945969.761805:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+13:2403:x1877942616561408:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 187us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945969.761813:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 101 00010000:00010000:3.0:1790945969.762000:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fdabf0f/0xd9f4181e0d27deff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330de4 expref: 12 pid: 8437 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945969.762015:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff94a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1877942638627072:192.168.204.20@tcp:104: 00010000:00010000:3.0:1790945969.762035:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f2e0ef2c/0xd9f4181e0d27e14b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.762045:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f2e0ef2c/0xd9f4181e0d27e14b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.762065:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2e0ef2c/0xd9f4181e0d27e14b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.762075:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2e0ef2c/0xd9f4181e0d27e14b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.762084:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2e0ef2c/0xd9f4181e0d27e14b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.762113:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790945969.762320:0:8436:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3650:x1877942638626816:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8410us (8825us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1790945969.762327:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000004:00080000:3.0:1790945969.762365:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d40bff96300/2, rc 0, transno 4294967323 00000100:00100000:3.0:1790945969.762370:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638626816:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1790945969.762896:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790945969.762904:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2e0ef2c/0xd9f4181e0d27e14b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.762913:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afc200 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:0.0:1790945969.762918:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2e0ef2c/0xd9f4181e0d27e14b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.762927:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2e0ef2c/0xd9f4181e0d27e14b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.762943:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2e0ef2c/0xd9f4181e0d27e14b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.762951:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2e0ef2c/0xd9f4181e0d27e14b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.762984:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945969.762986:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945969.762988:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945969.768287:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945969.768423:0:10099:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616561536 00000100:00100000:2.0:1790945969.768443:0:10099:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616561536 00000100:00100000:2.0:1790945969.768514:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 76 00000100:00100000:2.0:1790945969.768524:0:10099:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+12:2404:x1877942616561536:12345-192.168.204.20@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1790945969.772413:0:8429:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:1.0:1790945969.772505:0:8429:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:2.0:1790945969.772839:0:10099:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:2404:x1877942616561536:12345-192.168.204.20@tcp:16:lhsmtool_posix.0 Request processed in 4309us (4557us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945969.772851:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 76 00000100:00100000:2.0:1790945969.775511:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945969.775599:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616561792 00000100:00100000:1.0:1790945969.775609:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616561792 00000100:00100000:1.0:1790945969.775664:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 244 00000100:00100000:1.0:1790945969.775674:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+21:12433:x1877942616561792:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790945969.775727:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945969.775766:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1a00/0xd9f4181e0d27e136 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e7e expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945969.775785:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d3f824efa00) 00010000:00010000:1.0:1790945969.775790:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790945969.775837:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afda00/0xd9f4181e0d27e159 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945969.775851:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afda00/0xd9f4181e0d27e159 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945969.775860:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afda00/0xd9f4181e0d27e159 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790945969.775988:0:8457:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000fea50f0e reply state 000000002d8ce9c5 transno 4294967510 ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afda00/0xd9f4181e0d27e159 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945969.776000:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afda00/0xd9f4181e0d27e159 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945969.776006:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d3f824efa00) 00010000:00010000:1.0:1790945969.776008:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790945969.776011:0:8457:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790945969.776130:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+22:12433:x1877942616561792:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 456us (627us total) trans 4294967510 rc 0/0 00000100:00100000:1.0:1790945969.776137:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 244 00000100:00100000:0.0:1790945969.780372:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945969.780586:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616561920 00000100:00100000:2.0:1790945969.780597:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616561920 00000100:00100000:2.0:1790945969.780665:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 77 00000100:00100000:2.0:1790945969.780675:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84569880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:2404:x1877942616561920:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1790945969.781037:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1790945969.781041:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1790945969 -> 1790945969 00002000:00010000:2.0:1790945969.781043:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1790945968 00002000:00010000:2.0:1790945969.781045:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1790945969 -> 1790945969 00002000:00010000:2.0:1790945969.781047:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1790945969.781261:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84569880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+8:2404:x1877942616561920:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 Request processed in 586us (900us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1790945969.781271:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 77 00000100:00100000:1.0:1790945969.784077:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945969.784280:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616562176 00000100:00100000:3.0:1790945969.784289:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616562176 00000100:00100000:3.0:1790945969.784385:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 245 00000100:00100000:3.0:1790945969.784395:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+22:12433:x1877942616562176:12345-192.168.204.20@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1790945969.784531:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1000/0xd9f4181e0d27e160 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.784550:0:13005:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27e11a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e70 expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.784577:0:13005:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1000/0xd9f4181e0d27e160 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.784611:0:13005:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27e11a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e70 expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.784626:0:13005:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27e11a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e70 expref: 22 pid: 6523 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945969.784640:0:13005:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f845ed180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13005:1877942638627328:192.168.204.20@tcp:104: 00000100:00100000:3.0:1790945969.784764:0:13005:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408a9346c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790945969.788705:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945969.789322:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616562304 00000100:00100000:1.0:1790945969.789332:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616562304 00010000:00010000:1.0:1790945969.789373:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27e11a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e70 expref: 23 pid: 6523 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945969.789414:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 102 00000100:00100000:1.0:1790945969.789424:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84569c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+23:2403:x1877942616562304:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790945969.789448:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945969.789483:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27e11a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e70 expref: 23 pid: 6523 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945969.789498:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27e11a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e70 expref: 23 pid: 6523 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945969.789523:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d3f824efa00) 00010000:00010000:1.0:1790945969.789529:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1000/0xd9f4181e0d27e160 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945969.789540:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1000/0xd9f4181e0d27e160 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945969.789547:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1000/0xd9f4181e0d27e160 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945969.789565:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945969.789626:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84569c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+23:2403:x1877942616562304:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 204us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945969.789634:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 102 00010000:00010000:3.0:1790945969.791083:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27e11a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e70 expref: 22 pid: 6523 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945969.791600:0:13005:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f845ed180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13005:1877942638627328:192.168.204.20@tcp:104: 00010000:00010000:3.0:1790945969.791628:0:13005:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1000/0xd9f4181e0d27e160 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.791705:0:13005:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1000/0xd9f4181e0d27e160 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.791714:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1000/0xd9f4181e0d27e160 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.791765:0:13005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1000/0xd9f4181e0d27e160 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.791774:0:13005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1000/0xd9f4181e0d27e160 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.791782:0:13005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1000/0xd9f4181e0d27e160 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.791788:0:13005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef1000 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790945969.791792:0:13005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1000/0xd9f4181e0d27e160 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.791800:0:13005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1000/0xd9f4181e0d27e160 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.791814:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d3f824efa00) 00010000:00010000:2.0:1790945969.791817:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1790945969.791822:0:13005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1000/0xd9f4181e0d27e160 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.791828:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1000/0xd9f4181e0d27e160 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945969.791920:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+21:12433:x1877942616562176:12345-192.168.204.20@tcp:55:lhsmtool_posix.0 Request processed in 7525us (7850us total) trans 0 rc -22/-22 00000100:00100000:2.0:1790945969.791957:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 245 00000100:00100000:2.0:1790945969.794757:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945969.794890:0:8436:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616562432 00000100:00100000:3.0:1790945969.794901:0:8436:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616562432 00000100:00100000:3.0:1790945969.794972:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 78 00000100:00100000:3.0:1790945969.794982:0:8436:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+8:2403:x1877942616562432:12345-192.168.204.20@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1790945969.795033:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005f272f75/0xd9f4181e0d27e167 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.795054:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ed15cc62/0xd9f4181e0d27e144 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e8c expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.795077:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945969.795083:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790945969.795088:0:8436:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f272f75/0xd9f4181e0d27e167 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.795135:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ed15cc62/0xd9f4181e0d27e144 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e8c expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.795150:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ed15cc62/0xd9f4181e0d27e144 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e8c expref: 8 pid: 8435 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945969.795198:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f845ed180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1877942638627456:192.168.204.20@tcp:104: 00000100:00100000:3.0:1790945969.795275:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408a9346c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790945969.798899:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945969.799119:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616562560 00000100:00100000:0.0:1790945969.799129:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616562560 00010000:00010000:0.0:1790945969.799215:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ed15cc62/0xd9f4181e0d27e144 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e8c expref: 9 pid: 8435 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945969.799265:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 103 00000100:00100000:3.0:1790945969.799296:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f845ed180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1877942638627456:192.168.204.20@tcp:104: 00010000:00010000:3.0:1790945969.799320:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005f272f75/0xd9f4181e0d27e167 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945969.799593:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+9:2403:x1877942616562560:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790945969.799611:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945969.799633:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ed15cc62/0xd9f4181e0d27e144 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e8c expref: 9 pid: 8435 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.799647:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ed15cc62/0xd9f4181e0d27e144 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e8c expref: 9 pid: 8435 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.799671:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed15cc62/0xd9f4181e0d27e144 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e8c expref: 9 pid: 8435 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.799689:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790945969.799693:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790945969.799838:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005f272f75/0xd9f4181e0d27e167 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.799848:0:6506:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f272f75/0xd9f4181e0d27e167 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.799880:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945969.799942:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+8:2403:x1877942616562560:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 352us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945969.799950:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 103 00010000:00010000:3.0:1790945969.799983:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005f272f75/0xd9f4181e0d27e167 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.799994:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f272f75/0xd9f4181e0d27e167 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.800017:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005f272f75/0xd9f4181e0d27e167 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.800033:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f272f75/0xd9f4181e0d27e167 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.800040:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f272f75/0xd9f4181e0d27e167 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.800047:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef0800 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:3.0:1790945969.800051:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f272f75/0xd9f4181e0d27e167 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.800061:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f272f75/0xd9f4181e0d27e167 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.800073:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f272f75/0xd9f4181e0d27e167 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.800079:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f272f75/0xd9f4181e0d27e167 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945969.800134:0:8436:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:2403:x1877942616562432:12345-192.168.204.20@tcp:1:lhsmtool_posix.0 Request processed in 5154us (5398us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945969.800142:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 78 00000100:00100000:2.0:1790945969.804666:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945969.804828:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616562816 00000100:00100000:3.0:1790945969.804839:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616562816 00000100:00100000:3.0:1790945969.804912:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 246 00000100:00100000:3.0:1790945969.804941:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+21:12433:x1877942616562816:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1790945969.805026:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0a00/0xd9f4181e0d27e16e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.805044:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6a00/0xd9f4181e0d27e05d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e38 expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.805054:0:6521:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0a00/0xd9f4181e0d27e16e lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.805091:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6a00/0xd9f4181e0d27e05d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e38 expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.805119:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6a00/0xd9f4181e0d27e05d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e38 expref: 21 pid: 6522 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945969.805133:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f845ed180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1877942638627584:192.168.204.20@tcp:104: 00000100:00100000:3.0:1790945969.805590:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408a9346c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790945969.809566:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945969.809759:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616562944 00000100:00100000:1.0:1790945969.809768:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616562944 00010000:00010000:1.0:1790945969.809809:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6a00/0xd9f4181e0d27e05d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e38 expref: 22 pid: 6522 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945969.809851:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 104 00000100:00100000:1.0:1790945969.809861:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84568000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+22:2403:x1877942616562944:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790945969.809879:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945969.809908:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6a00/0xd9f4181e0d27e05d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e38 expref: 22 pid: 6522 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945969.809920:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6a00/0xd9f4181e0d27e05d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e38 expref: 22 pid: 6522 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945969.809945:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3f824ef300) 00010000:00010000:1.0:1790945969.809950:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64c00/0xd9f4181e0d27e0bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e5b expref: 22 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945969.809962:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0a00/0xd9f4181e0d27e16e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945969.809970:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0a00/0xd9f4181e0d27e16e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945969.809978:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0a00/0xd9f4181e0d27e16e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.810720:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6a00/0xd9f4181e0d27e05d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e38 expref: 22 pid: 6522 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945969.810747:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f845ed180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1877942638627584:192.168.204.20@tcp:104: 00010000:00010000:3.0:1790945969.810773:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0a00/0xd9f4181e0d27e16e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.810783:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0a00/0xd9f4181e0d27e16e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.810805:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0a00/0xd9f4181e0d27e16e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.810989:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0800/0xd9f4181e0d27e175 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.811017:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1c00/0xd9f4181e0d27e128 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e77 expref: 22 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.811026:0:6521:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0800/0xd9f4181e0d27e175 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.811057:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1c00/0xd9f4181e0d27e128 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e77 expref: 22 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.811073:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1c00/0xd9f4181e0d27e128 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e77 expref: 22 pid: 13005 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945969.811086:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f845ed180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1877942638627712:192.168.204.20@tcp:104: 00000100:00100000:3.0:1790945969.811237:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40811caa80 going to sleep for 11 seconds 00010000:00010000:1.0:1790945969.813046:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945969.813127:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84568000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+22:2403:x1877942616562944:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 3262us (3564us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945969.813139:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 104 00000100:00100000:3.0:1790945969.818335:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f845ed180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1877942638627712:192.168.204.20@tcp:104: 00010000:00010000:3.0:1790945969.818366:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0800/0xd9f4181e0d27e175 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945969.822048:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945969.822160:0:7471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616563072 00000100:00100000:1.0:1790945969.822207:0:7471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616563072 00010000:00010000:1.0:1790945969.822258:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1c00/0xd9f4181e0d27e128 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e77 expref: 22 pid: 13005 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945969.822305:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 105 00000100:00100000:1.0:1790945969.822314:0:7471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+22:2404:x1877942616563072:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790945969.822345:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945969.822352:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1c00/0xd9f4181e0d27e128 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e77 expref: 22 pid: 13005 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945969.822365:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1c00/0xd9f4181e0d27e128 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e77 expref: 22 pid: 13005 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945969.822386:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1c00/0xd9f4181e0d27e128 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e77 expref: 22 pid: 13005 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945969.822402:0:7471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d3f824efa00) 00010000:00010000:1.0:1790945969.822407:0:7471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0800/0xd9f4181e0d27e175 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945969.822418:0:7471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0800/0xd9f4181e0d27e175 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945969.822427:0:7471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0800/0xd9f4181e0d27e175 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945969.822453:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945969.822522:0:7471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+21:2404:x1877942616563072:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 208us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945969.822530:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 105 00010000:00010000:3.0:1790945969.823149:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0800/0xd9f4181e0d27e175 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.823162:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0800/0xd9f4181e0d27e175 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790945969.824161:0:6521:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:2.0:1790945969.824373:0:6521:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967512 00000001:00080000:2.0:1790945969.824408:0:6521:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:2.0:1790945969.824518:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8450ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1877942638627840:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790945969.824584:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945969.824620:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40854e56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790945969.824699:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638627840 00000100:00100000:1.0:1790945969.824707:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638627840 00000100:00100000:1.0:1790945969.824773:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1790945969.824782:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6521:x1877942638627840:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1790945969.824870:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6521:x1877942638627840:12345-0@lo:1000:mdt00_000.0 Request processed in 89us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945969.824891:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1790945969.825488:0:6521:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:2.0:1790945969.825496:0:6521:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967323 00000004:00080000:2.0:1790945969.825522:0:6521:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d40bff96680, transno 4294967322 00000004:00080000:2.0:1790945969.825539:0:6521:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d40bff96300, transno 4294967323 00000100:00100000:2.0:1790945969.825548:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8450ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1877942638627840:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1790945969.825681:0:6521:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967514 00000100:00100000:2.0:1790945969.825945:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8450ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1877942638627968:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790945969.825995:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945969.826107:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408a9346c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945969.829927:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638627968 00000100:00100000:3.0:1790945969.829945:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638627968 00000100:00100000:2.0:1790945969.830160:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1790945969.830188:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4096d76450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6521:x1877942638627968:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790945969.830420:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4096d76450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6521:x1877942638627968:12345-0@lo:1000:mdt00_000.0 Request processed in 248us (4423us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1790945969.830427:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1790945969.830786:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8450ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1877942638627968:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1790945969.830837:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0800/0xd9f4181e0d27e175 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.830849:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0800/0xd9f4181e0d27e175 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.830857:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0800/0xd9f4181e0d27e175 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.830863:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef0800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945969.830868:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0800/0xd9f4181e0d27e175 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.830875:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0800/0xd9f4181e0d27e175 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.830889:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d3f824efa00) 00010000:00010000:3.0:1790945969.830893:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790945969.830897:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0800/0xd9f4181e0d27e175 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.830904:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0800/0xd9f4181e0d27e175 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.830928:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27e0b8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.830934:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27e0b8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.830953:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27e0b8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.830958:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080031800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790945969.830961:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27e0b8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.830967:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27e0b8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.830975:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3f824ef300) 00010000:00010000:3.0:1790945969.830977:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790945969.830984:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64c00/0xd9f4181e0d27e0bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e5b expref: 24 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.830995:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64c00/0xd9f4181e0d27e0bf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e5b expref: 24 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.831005:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64c00/0xd9f4181e0d27e0bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e5b expref: 24 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.831043:0:6521:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64c00/0xd9f4181e0d27e0bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e5b expref: 24 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945969.831057:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f845ed180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1877942638628096:192.168.204.20@tcp:105: 00000100:00100000:3.0:1790945969.831141:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40811caa80 going to sleep for 11 seconds 00000100:00100000:0.0:1790945969.833900:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f845ed180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1877942638628096:192.168.204.20@tcp:105: 00010000:00010000:0.0:1790945969.833934:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27e0b8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.833945:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27e0b8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.833977:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27e17c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.833990:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27e17c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.834002:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27e17c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.834011:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27e17c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.834017:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27e17c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.834023:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27e17c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.834027:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe1800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945969.834031:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27e17c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.834038:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27e17c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.834068:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3f824ef300) 00010000:00010000:0.0:1790945969.834071:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945969.834075:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27e17c lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.834081:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27e17c lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.834090:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0a00/0xd9f4181e0d27e16e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.834095:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0a00/0xd9f4181e0d27e16e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.834113:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0a00/0xd9f4181e0d27e16e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.834118:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef0a00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945969.834120:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0a00/0xd9f4181e0d27e16e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.834126:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0a00/0xd9f4181e0d27e16e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.834133:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3f824ef300) 00010000:00010000:0.0:1790945969.834135:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790945969.834137:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0a00/0xd9f4181e0d27e16e lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.834141:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0a00/0xd9f4181e0d27e16e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945969.834358:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+24:12433:x1877942616562816:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 29413us (29696us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1790945969.834368:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 246 00000020:00080000:0.0:1790945969.834373:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1790945969.834537:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790945969.834541:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790945969.835025:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1790945969.835032:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790945969.837620:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945969.837700:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616563200 00000100:00100000:3.0:1790945969.837711:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616563200 00000100:00100000:3.0:1790945969.837767:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 61 00000100:00100000:3.0:1790945969.837777:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8456a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+24:12432:x1877942616563200:12345-192.168.204.20@tcp:49:lfs.0 00000100:00100000:3.0:1790945969.837900:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8456a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+24:12432:x1877942616563200:12345-192.168.204.20@tcp:49:lfs.0 Request processed in 124us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945969.837907:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 61 00000100:00100000:1.0:1790945969.840613:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945969.840703:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616563456 00000100:00100000:3.0:1790945969.840712:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616563456 00000100:00100000:3.0:1790945969.840767:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 62 00000100:00100000:3.0:1790945969.840776:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4096dd8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+24:12433:x1877942616563456:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1790945969.841072:0:6525:0:(mdd_object.c:4180:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1790945969.841119:0:6525:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967516 00010000:00010000:3.0:1790945969.841156:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0800/0xd9f4181e0d27e183 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.841364:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0800/0xd9f4181e0d27e183 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.841378:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0800/0xd9f4181e0d27e183 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.841388:0:6525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0800/0xd9f4181e0d27e183 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.841395:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0800/0xd9f4181e0d27e183 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.841416:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0800/0xd9f4181e0d27e183 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945969.841446:0:6525:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790945969.841543:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4096dd8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+26:12433:x1877942616563456:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 Request processed in 767us (936us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1790945969.841551:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 62 00000020:00080000:3.0:1790945969.841557:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790945969.841647:0:10339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790945969.841654:0:10339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0800/0xd9f4181e0d27e183 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.841662:0:10339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef0800 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:0.0:1790945969.841666:0:10339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0800/0xd9f4181e0d27e183 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.841675:0:10339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0800/0xd9f4181e0d27e183 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.841687:0:10339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d3f824efa00) 00010000:00010000:0.0:1790945969.841690:0:10339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790945969.841694:0:10339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0800/0xd9f4181e0d27e183 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.841699:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0800/0xd9f4181e0d27e183 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.841712:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945969.841713:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945969.841715:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945969.848274:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945969.848373:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616563712 00000100:00100000:2.0:1790945969.848384:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616563712 00000100:00100000:2.0:1790945969.848479:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 247 00000100:00100000:2.0:1790945969.848489:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+26:12432:x1877942616563712:12345-192.168.204.20@tcp:58:lfs.0 00000040:00080000:2.0:1790945969.848657:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1790945969.848737:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+26:12432:x1877942616563712:12345-192.168.204.20@tcp:58:lfs.0 Request processed in 249us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945969.848745:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 247 00000100:00100000:2.0:1790945969.881020:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945969.881133:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616563840 00000100:00100000:0.0:1790945969.881143:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616563840 00000100:00100000:0.0:1790945969.881224:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 248 00000100:00100000:0.0:1790945969.881251:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+26:12435:x1877942616563840:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1790945969.881273:0:13005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945969.881296:0:13005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27e18a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330e93 expref: -99 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.881542:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27e191 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.881561:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27e191 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.881572:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27e191 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.881589:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27e198 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.881596:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27e198 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.881603:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27e198 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.881687:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27e19f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.881698:0:13005:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27e0aa lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e54 expref: 27 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.881706:0:13005:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27e19f lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.881751:0:13005:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27e0aa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e54 expref: 27 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.881763:0:13005:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27e0aa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e54 expref: 27 pid: 6523 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945969.881776:0:13005:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84568e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13005:1877942638628224:192.168.204.20@tcp:104: 00000100:00100000:0.0:1790945969.881916:0:13005:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4087172b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790945969.885070:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945969.885214:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616564096 00000100:00100000:2.0:1790945969.885381:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616564096 00000100:00100000:3.0:1790945969.885533:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 63 00000100:00100000:3.0:1790945969.885546:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+28:6171:x1877942616564096:12345-192.168.204.20@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1790945969.885765:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+29:6171:x1877942616564096:12345-192.168.204.20@tcp:35:ldlm_bl.0 Request processed in 222us (704us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1790945969.885772:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 63 00000100:00100000:0.0:1790945969.886523:0:13005:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84568e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13005:1877942638628224:192.168.204.20@tcp:104: 00010000:00010000:0.0:1790945969.886554:0:13005:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27e19f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945969.890588:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945969.890688:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616564224 00000100:00100000:2.0:1790945969.890700:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616564224 00010000:00010000:2.0:1790945969.890748:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27e0aa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e54 expref: 29 pid: 6523 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945969.890790:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 106 00000100:00100000:2.0:1790945969.890800:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4096cb9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+29:2403:x1877942616564224:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790945969.890816:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945969.890823:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27e0aa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e54 expref: 29 pid: 6523 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.890837:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27e0aa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e54 expref: 29 pid: 6523 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.890862:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27e0aa lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e54 expref: 29 pid: 6523 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.890880:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3f824ef300) 00010000:00010000:2.0:1790945969.890904:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27e19f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.890917:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27e19f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.890925:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27e19f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945969.890960:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945969.891027:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4096cb9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+28:2403:x1877942616564224:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 228us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945969.891035:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 106 00010000:00010000:0.0:1790945969.891761:0:13005:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27e19f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.891771:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27e19f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945969.891824:0:13005:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1790945969.891828:0:13005:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790945969.891849:0:13005:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27e19f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.891862:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27e19f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.891872:0:13005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27e191 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.891894:0:13005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27e191 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.891902:0:13005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27e191 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.891908:0:13005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe1400 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945969.891912:0:13005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27e191 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.891921:0:13005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27e191 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.891932:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d3f824ef900) 00010000:00010000:0.0:1790945969.891935:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945969.891939:0:13005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27e191 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.891945:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27e191 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.891957:0:13005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27e198 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.891963:0:13005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27e198 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.891969:0:13005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27e198 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.891974:0:13005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe1200 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945969.891983:0:13005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27e198 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.891990:0:13005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27e198 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.891998:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d40bc9ad000) 00010000:00010000:0.0:1790945969.892000:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945969.892003:0:13005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27e198 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.892009:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1200/0xd9f4181e0d27e198 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.892046:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1800/0xd9f4181e0d27e18a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e93 expref: 28 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.892059:0:13005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27e19f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e93 expref: 27 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945969.892065:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3f824ef300) 00010000:00010000:0.0:1790945969.892067:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790945969.892069:0:13005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe0600, rc 0) 00000100:00100000:0.0:1790945969.892132:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+27:12435:x1877942616563840:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 10883us (11126us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945969.892140:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 248 00000040:00080000:0.0:1790945970.554909:0:14711:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790945970.554935:0:14711:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790945970.555014:0:14711:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1790945970.555022:0:14711:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1790945970.656762:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790945970.847719:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790945970.847733:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790945970.847764:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1790945970.847774:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790945970.848025:0:13803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f845ec700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13803:1877942638628352:192.168.204.20@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790945970.848597:0:13803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408fc760c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945970.853195:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945970.853340:0:13803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f845ec700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13803:1877942638628352:192.168.204.20@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790945970.853610:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616564352 00000100:00100000:1.0:1790945970.853620:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616564352 00000100:00100000:1.0:1790945970.853736:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 249 00000100:00100000:1.0:1790945970.853746:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f845efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+27:12447:x1877942616564352:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790945970.853781:0:6521:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790945970.853904:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f845efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+27:12447:x1877942616564352:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 Request processed in 159us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945970.853912:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 249 00000100:00080000:0.0:1790945970.856261:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790945970.858752:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945970.859046:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616564608 00000100:00100000:0.0:1790945970.859057:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616564608 00000100:00100000:0.0:1790945970.859136:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 250 00000100:00100000:0.0:1790945970.859146:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+27:12447:x1877942616564608:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790945970.859194:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945970.859217:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27e1a6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330e9a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945970.859510:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27e1ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945970.859529:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27e1ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945970.859541:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27e1ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945970.859553:0:6522:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1790945970.859675:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27e1a6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e9a expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945970.859694:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27e1ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e9a expref: 29 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945970.859703:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3f824ef300) 00010000:00010000:0.0:1790945970.859706:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790945970.859723:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe0400, rc 0) 00000100:00100000:0.0:1790945970.859847:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+29:12447:x1877942616564608:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 702us (1103us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1790945970.859855:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 250 00000100:00100000:3.0:1790945970.863956:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945970.864644:0:7471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616564736 00000100:00100000:1.0:1790945970.864657:0:7471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616564736 00000100:00100000:1.0:1790945970.864733:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:1.0:1790945970.864744:0:7471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f845ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+29:2402:x1877942616564736:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790945970.864767:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945970.864793:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27e1ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e9a expref: 29 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945970.864815:0:7471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3f824ef300) 00010000:00010000:1.0:1790945970.864819:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945970.864900:0:7471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f845ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+28:2402:x1877942616564736:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 158us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945970.864924:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:3.0:1790945970.865811:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945970.865926:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616564992 00000100:00100000:0.0:1790945970.865933:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616564992 00000100:00100000:0.0:1790945970.866069:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 251 00000100:00100000:0.0:1790945970.866078:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f845edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+28:12447:x1877942616564992:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790945970.866154:0:13005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27e1bb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945970.866198:0:13005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27e1bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945970.866211:0:13005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27e1bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945970.866473:0:13005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27e1bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945970.866481:0:13005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27e1bb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945970.866488:0:13005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27e1bb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945970.866495:0:13005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0a00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945970.866500:0:13005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27e1bb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945970.866507:0:13005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27e1bb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945970.866530:0:13005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3f824ef300) 00010000:00010000:0.0:1790945970.866533:0:13005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790945970.866538:0:13005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27e1bb lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945970.866544:0:13005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27e1bb lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13005 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945970.866703:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f845edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+29:12447:x1877942616564992:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 625us (894us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1790945970.866712:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 251 00000040:00080000:3.0:1790945970.866873:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790945970.866878:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1790945970.868917:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945970.869131:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616565248 00000100:00100000:0.0:1790945970.869142:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616565248 00000040:00080000:3.0:1790945970.869149:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1790945970.869161:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790945970.869382:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 64 00000100:00100000:0.0:1790945970.869393:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+29:12447:x1877942616565248:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790945970.869695:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+30:12447:x1877942616565248:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 Request processed in 303us (785us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1790945970.869704:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 64 00000100:00100000:3.0:1790945971.040020:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790945971.040031:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790945971.040048:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f845edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638628608:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790945971.040048:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638628480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790945971.044826:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945971.044946:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945971.045477:0:13838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638628480 00000100:00100000:2.0:1790945971.045489:0:13838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638628480 00000100:00080000:0.0:1790945971.045635:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790945971.045689:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638628608 00000100:00100000:3.0:1790945971.045695:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638628608 00000100:00100000:2.0:1790945971.045737:0:13838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1790945971.045810:0:13838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1877942638628480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790945971.045837:0:13838:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:2.0:1790945971.045912:0:13838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1877942638628480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 166us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945971.045922:0:13838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1790945971.046130:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638628480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790945971.046432:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1790945971.046454:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bcd85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638628608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790945971.046466:0:8438:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:3.0:1790945971.046516:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bcd85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638628608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (1571us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945971.046523:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1790945971.046685:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f845edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638628608:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1790945971.051083:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790945971.679357:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790945972.323444:0:14762:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790945972.323456:0:14762:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790945972.323488:0:14762:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1790945972.323502:0:14762:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790945972.481421:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945972.481608:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616565504 00000100:00100000:0.0:1790945972.481619:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616565504 00000100:00100000:0.0:1790945972.481704:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 252 00000100:00100000:0.0:1790945972.481715:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f845ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+30:12467:x1877942616565504:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1790945972.481740:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945972.481771:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27e1c2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330ea1 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945972.481880:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27e1c9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945972.481896:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27e1c9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945972.481908:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27e1c9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945972.481918:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1790945972.482027:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27e1c2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ea1 expref: 33 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945972.482044:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27e1c9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ea1 expref: 32 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945972.482052:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3f824ef300) 00010000:00010000:0.0:1790945972.482055:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1790945972.482059:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe0a00, rc 0) 00000100:00080000:1.0:1790945972.482238:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790945972.482554:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f845ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+32:12467:x1877942616565504:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 830us (1147us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1790945972.482563:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 252 00000100:00100000:3.0:1790945972.490298:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945972.490429:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616565632 00000100:00100000:0.0:1790945972.490441:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616565632 00000100:00100000:0.0:1790945972.490494:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 253 00000100:00100000:0.0:1790945972.490504:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f845eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+32:12467:x1877942616565632:12345-192.168.204.20@tcp:54:lfs.0 00010000:00010000:0.0:1790945972.490614:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27e1d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945972.490635:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27e1d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945972.490646:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27e1d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945972.490686:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27e1d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945972.490694:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27e1d7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945972.490701:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27e1d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945972.490706:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0400 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790945972.490711:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27e1d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945972.490719:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27e1d7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945972.490731:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3f824ef300) 00010000:00010000:0.0:1790945972.490734:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790945972.490740:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27e1d7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945972.490746:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0400/0xd9f4181e0d27e1d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945972.490837:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f845eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+32:12467:x1877942616565632:12345-192.168.204.20@tcp:54:lfs.0 Request processed in 333us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945972.490844:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 253 00000100:00100000:2.0:1790945972.577100:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84568e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638628736:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790945972.577281:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945972.577440:0:12418:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638628736 00000100:00100000:3.0:1790945972.577450:0:12418:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638628736 00000100:00100000:3.0:1790945972.577511:0:12418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1790945972.577521:0:12418:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638628736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790945972.577558:0:12418:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1790945972.577685:0:12418:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638628736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 164us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945972.577693:0:12418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1790945972.579651:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945972.579782:0:10099:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616565760 00000100:00100000:3.0:1790945972.579792:0:10099:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616565760 00000100:00100000:3.0:1790945972.579859:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 79 00000100:00100000:3.0:1790945972.579869:0:10099:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:2404:x1877942616565760:12345-192.168.204.20@tcp:101:cat.0 00010000:00010000:3.0:1790945972.579885:0:10099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945972.579905:0:10099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050f88e0d/0xd9f4181e0d27e1de lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330ea8 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790945972.579950:0:10099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6abfaab1, atime: 0x6abfaab0, ctime: 0x6abfaab1, blocks: 0x8 00010000:00010000:3.0:1790945972.579971:0:10099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=423s v=(0 0) 00010000:00010000:3.0:1790945972.579976:0:10099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945972.579985:0:10099:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050f88e0d/0xd9f4181e0d27e1de lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ea8 expref: 8 pid: 10099 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945972.580003:0:10099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000050f88e0d/0xd9f4181e0d27e1de lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ea8 expref: 8 pid: 10099 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945972.580016:0:10099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40baef0a00, rc 0) 00000100:00100000:3.0:1790945972.580079:0:10099:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+8:2404:x1877942616565760:12345-192.168.204.20@tcp:101:cat.0 Request processed in 212us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945972.580087:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 79 00000100:00080000:1.0:1790945972.581004:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790945972.583279:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84568e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638628736:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790945972.583509:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945972.586254:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616565888 00000100:00100000:1.0:1790945972.586272:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616565888 00002000:00100000:1.0:1790945972.586341:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9d3f845eca80 x1877942616565888/t0(0) o3->0cadc7a5-c0ba-4320-984f-d871ffb3a3ef@192.168.204.20@tcp:668/0 lens 488/0 e 0 to 0 dl 1790945983 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790945972.586353:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3f845eca80 with x1877942616565888 ext(0->4095) 00002000:00010000:1.0:1790945972.586359:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d3f845eca80 00000100:00100000:1.0:1790945972.586401:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:1.0:1790945972.586422:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f845eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+8:2403:x1877942616565888:12345-192.168.204.20@tcp:3:cat.0 00000100:00100000:1.0:1790945972.587576:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f845eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+8:2403:x1877942616565888:12345-192.168.204.20@tcp:3:cat.0 Request processed in 1149us (4063us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1790945972.587588:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 7 00002000:00100000:1.0:1790945972.587598:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9d3f845eca80 x1877942616565888/t0(0) o3->0cadc7a5-c0ba-4320-984f-d871ffb3a3ef@192.168.204.20@tcp:668/0 lens 488/4536 e 0 to 0 dl 1790945983 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790945972.587607:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3f845eca80 with x1877942616565888 ext(0->4095) 00002000:00010000:1.0:1790945972.587612:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d3f845eca80 00010000:00010000:0.0:1790945972.703702:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945972.801922:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945972.801966:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945972.801999:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945972.802025:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945972.802057:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945972.802096:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616566528 00000100:00100000:3.0:1790945972.802105:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616566528 00000100:00100000:3.0:1790945972.802159:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616566144 00000100:00100000:3.0:1790945972.802162:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616566144 00000100:00100000:3.0:1790945972.802208:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616566400 00000100:00100000:3.0:1790945972.802211:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616566400 00000100:00100000:3.0:1790945972.802243:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 319 00000100:00100000:3.0:1790945972.802270:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f845ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2402:x1877942616566528:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790945972.802341:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f845ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2402:x1877942616566528:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 74us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945972.802349:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 319 00000100:00100000:3.0:1790945972.802366:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 320 00000100:00100000:3.0:1790945972.802487:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f845eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2402:x1877942616566144:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790945972.802511:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f845eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2402:x1877942616566144:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 29us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945972.802517:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 320 00000100:00100000:3.0:1790945972.802528:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 321 00000100:00100000:3.0:1790945972.802534:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f845ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2402:x1877942616566400:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790945972.802555:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f845ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2402:x1877942616566400:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 21us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945972.802560:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 321 00000100:00080000:3.0:1790945972.802644:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790945972.802648:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790945972.803784:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616566016 00000100:00100000:1.0:1790945972.803796:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616566016 00000100:00100000:1.0:1790945972.803860:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 389 00000100:00100000:1.0:1790945972.803869:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087034050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:2402:x1877942616566016:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945972.803940:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087034050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:2402:x1877942616566016:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 73us (2027us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945972.803946:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 389 00000100:00100000:2.0:1790945972.804050:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616566272 00000100:00100000:2.0:1790945972.804055:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616566272 00000100:00100000:2.0:1790945972.804107:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 129 00000100:00100000:2.0:1790945972.804114:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4f2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2402:x1877942616566272:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790945972.804141:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4f2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2402:x1877942616566272:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 28us (2175us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945972.804147:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 129 00000100:00080000:1.0:1790945972.804723:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790945973.091159:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790945973.091231:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638628864:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790945973.091309:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945973.091560:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638628864 00000100:00100000:3.0:1790945973.091569:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638628864 00000100:00100000:3.0:1790945973.091629:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1790945973.091639:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8456ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638628864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790945973.091677:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790945973.091740:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8456ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638628864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945973.091747:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1790945973.092737:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638628864:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1790945973.727462:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945974.112365:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8450fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638628992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790945974.112448:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945974.112527:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638628992 00000100:00100000:2.0:1790945974.112535:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638628992 00000100:00100000:2.0:1790945974.112591:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1790945974.112602:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638628992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790945974.112631:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790945974.112676:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638628992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945974.112683:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:2.0:1790945974.112704:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790945974.112732:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1790945974.112739:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:2.0:1790945974.112766:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d3f83fa8e00, transno 4294967308 00000004:00080000:2.0:1790945974.112776:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:2.0:1790945974.112793:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d3f8456bb80, transno 4294967311 00000100:00100000:2.0:1790945974.112804:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8450fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638628992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790945974.121786:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f845ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638629120:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790945974.121873:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945974.121939:0:11925:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638629120 00000100:00100000:3.0:1790945974.121948:0:11925:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638629120 00000100:00100000:3.0:1790945974.122010:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1790945974.122020:0:11925:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f845ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638629120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790945974.122044:0:11925:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790945974.122089:0:11925:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f845ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638629120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945974.122096:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:3.0:1790945974.122116:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790945974.122150:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f845ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638629120:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790945974.124878:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f845ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638629248:0@lo:400:kworker.0 00000100:00100000:3.0:1790945974.124958:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945974.124996:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f845ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638629760:0@lo:400:kworker.0 00000100:00100000:3.0:1790945974.125023:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945974.125044:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638630272:0@lo:400:kworker.0 00000100:00100000:3.0:1790945974.125066:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945974.125090:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1790945974.125096:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f845ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877942638629632:0@lo:400:kworker.0 00000100:00100000:3.0:1790945974.125120:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945974.125139:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f845ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638630144:0@lo:400:kworker.0 00000100:00100000:3.0:1790945974.125160:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945974.126829:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f845ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638629504:0@lo:400:kworker.0 00000100:00100000:2.0:1790945974.126891:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945974.126923:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f845ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1877942638630016:0@lo:400:kworker.0 00000100:00100000:2.0:1790945974.126946:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945974.126961:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1877942638630528:0@lo:400:kworker.0 00000100:00100000:2.0:1790945974.126978:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945974.127004:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1790945974.127011:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f845edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877942638629376:0@lo:400:kworker.0 00000100:00100000:2.0:1790945974.127031:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945974.127050:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f845ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1877942638629888:0@lo:400:kworker.0 00000100:00100000:2.0:1790945974.127069:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945974.127086:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1877942638630400:0@lo:400:kworker.0 00000100:00100000:2.0:1790945974.127104:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945974.127754:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638629248 00000100:00100000:3.0:1790945974.127764:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638629248 00000100:00100000:3.0:1790945974.127814:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1790945974.127823:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087034450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3650:x1877942638629248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945974.127886:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087034450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3650:x1877942638629248:12345-0@lo:400:kworker.0 Request processed in 64us (2928us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945974.127893:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1790945974.127923:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638629760 00000100:00100000:3.0:1790945974.127926:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638629760 00000100:00100000:3.0:1790945974.127950:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638629504 00000100:00100000:3.0:1790945974.127953:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638629504 00000100:00100000:3.0:1790945974.127963:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1790945974.127968:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638629760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945974.127997:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638629760:12345-0@lo:400:kworker.0 Request processed in 28us (2973us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945974.128002:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1790945974.128012:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1790945974.128017:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638629504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945974.128044:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638629504:12345-0@lo:400:kworker.0 Request processed in 27us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945974.128049:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1790945974.128065:0:8436:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638630272 00000100:00100000:3.0:1790945974.128068:0:8436:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638630272 00000100:00100000:3.0:1790945974.128095:0:8436:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638630144 00000100:00100000:3.0:1790945974.128098:0:8436:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638630144 00000100:00100000:3.0:1790945974.128116:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1790945974.128121:0:8436:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1877942638630272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945974.128152:0:8436:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1877942638630272:12345-0@lo:400:kworker.0 Request processed in 30us (3084us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945974.128158:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1790945974.128872:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638629632 00000100:00100000:0.0:1790945974.128880:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638629632 00000100:00100000:0.0:1790945974.128908:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638630016 00000100:00100000:0.0:1790945974.128911:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638630016 00000100:00100000:0.0:1790945974.128927:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638630528 00000100:00100000:0.0:1790945974.128930:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638630528 00000100:00100000:0.0:1790945974.128942:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638629376 00000100:00100000:0.0:1790945974.128944:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638629376 00000100:00100000:0.0:1790945974.128956:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638629888 00000100:00100000:0.0:1790945974.128959:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638629888 00000100:00100000:0.0:1790945974.128971:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638630400 00000100:00100000:0.0:1790945974.128974:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638630400 00000100:00100000:0.0:1790945974.128988:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1790945974.128996:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877942638629632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945974.129044:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877942638629632:12345-0@lo:400:kworker.0 Request processed in 49us (3922us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945974.129050:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1790945974.129065:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1790945974.129070:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1877942638630016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945974.129113:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1877942638630016:12345-0@lo:400:kworker.0 Request processed in 43us (2166us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945974.129119:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1790945974.129131:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1790945974.129137:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1877942638630528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945974.129164:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1877942638630528:12345-0@lo:400:kworker.0 Request processed in 27us (2184us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945974.129917:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1790945974.129936:0:8436:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638630144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945974.129982:0:8436:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638630144:12345-0@lo:400:kworker.0 Request processed in 49us (4821us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945974.129988:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1790945974.130017:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1790945974.130024:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1877942638629376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945974.130055:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1877942638629376:12345-0@lo:400:kworker.0 Request processed in 32us (3023us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945974.130061:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1790945974.130075:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1790945974.130081:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1877942638629888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945974.130108:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1877942638629888:12345-0@lo:400:kworker.0 Request processed in 28us (3038us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945974.130113:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1790945974.130124:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1790945974.130130:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1877942638630400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945974.130159:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1877942638630400:12345-0@lo:400:kworker.0 Request processed in 29us (3054us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945974.130164:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1790945974.131112:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1790945974.132614:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f845ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877942638629632:0@lo:400:kworker.0 00000100:00100000:3.0:1790945974.132633:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f845ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638630144:0@lo:400:kworker.0 00000100:00100000:3.0:1790945974.132645:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f845ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638629248:0@lo:400:kworker.0 00000100:00100000:3.0:1790945974.132656:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f845ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638629760:0@lo:400:kworker.0 00000100:00100000:3.0:1790945974.132685:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638630272:0@lo:400:kworker.0 00000100:00100000:3.0:1790945974.132856:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f845edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877942638629376:0@lo:400:kworker.0 00000100:00100000:3.0:1790945974.132869:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f845ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1877942638629888:0@lo:400:kworker.0 00000100:00100000:3.0:1790945974.132882:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1877942638630400:0@lo:400:kworker.0 00000100:00100000:3.0:1790945974.133013:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f845ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638629504:0@lo:400:kworker.0 00010000:00080000:3.0:1790945974.133033:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f845ef800 x1877942638630016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945974.133043:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f845ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1877942638630016:0@lo:400:kworker.0 00010000:00080000:3.0:1790945974.133055:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bff82680 x1877942638630528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945974.133064:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1877942638630528:0@lo:400:kworker.0 00000100:00080000:3.0:1790945974.133095:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790945974.133102:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790945974.133105:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790945974.751790:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790945975.138908:0:8429:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:0.0:1790945975.138922:0:8429:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:2.0:1790945975.139078:0:6500:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:2.0:1790945975.139104:0:6500:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d4081254180 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1790945975.139109:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d40bca6e200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d40812549c0 00000020:00080000:2.0:1790945975.139112:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d40bca6eb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d40bff06a00 00000020:00080000:3.0:1790945975.139148:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 5 00000020:00080000:3.0:1790945975.139225:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:1.0:1790945975.139302:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afda00/0xd9f4181e0d27e159 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945975.139317:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afda00/0xd9f4181e0d27e159 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945975.139326:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afda00/0xd9f4181e0d27e159 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945975.139333:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afda00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:1.0:1790945975.139338:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afda00/0xd9f4181e0d27e159 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945975.139348:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afda00/0xd9f4181e0d27e159 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945975.139377:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d3f824efa00) 00010000:00010000:1.0:1790945975.139381:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945975.139386:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afda00/0xd9f4181e0d27e159 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945975.139393:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afda00/0xd9f4181e0d27e159 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8457 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1790945975.139469:0:6500:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:0.0:1790945975.776739:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945976.159821:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790945976.159845:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8456a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638630656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790945976.159920:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945976.160351:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638630656 00000100:00100000:2.0:1790945976.160359:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638630656 00000100:00080000:1.0:1790945976.160419:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790945976.160429:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1790945976.160439:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8456b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638630656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790945976.160470:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1790945976.160594:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790945976.160600:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8456b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638630656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 163us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945976.160603:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84568380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638630784:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790945976.160608:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1790945976.160630:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945976.160662:0:11925:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638630784 00000100:00100000:0.0:1790945976.160666:0:11925:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638630784 00000100:00100000:0.0:1790945976.160693:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1790945976.160699:0:11925:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8456bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638630784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790945976.160709:0:11925:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00080000:2.0:1790945976.161035:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790945976.166285:0:11925:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8456bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638630784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5574us (5641us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945976.166301:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1790945976.166414:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84568380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638630784:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790945976.166450:0:3650:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:0.0:1790945976.166455:0:3650:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:0.0:1790945976.166506:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8456a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638630656:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1790945976.549593:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790945976.799315:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790945976.992370:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790945976.992379:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790945976.992399:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1790945976.992406:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790945977.210014:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945977.210158:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616566656 00000100:00100000:0.0:1790945977.210199:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616566656 00000100:00100000:0.0:1790945977.210266:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 254 00000100:00100000:0.0:1790945977.210276:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+18:12121:x1877942616566656:12345-192.168.204.20@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1790945977.210386:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+18:12121:x1877942616566656:12345-192.168.204.20@tcp:60:lhsmtool_posix.0 Request processed in 111us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945977.210394:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 254 00000100:00080000:2.0:1790945977.210700:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790945977.221222:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945977.221704:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616566784 00000100:00100000:0.0:1790945977.221716:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616566784 00000100:00100000:0.0:1790945977.221810:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 255 00000100:00100000:0.0:1790945977.221822:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:12121:x1877942616566784:12345-192.168.204.20@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1790945977.221963:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:12121:x1877942616566784:12345-192.168.204.20@tcp:60:lhsmtool_posix.0 Request processed in 144us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945977.221970:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 255 00000100:00080000:2.0:1790945977.222260:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790945977.240044:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945977.240331:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616567040 00000100:00100000:0.0:1790945977.240342:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616567040 00000100:00100000:0.0:1790945977.240437:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 65 00000100:00100000:0.0:1790945977.240460:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+18:12121:x1877942616567040:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790945977.240717:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+19:12121:x1877942616567040:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 Request processed in 258us (683us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1790945977.240725:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 65 00000100:00100000:3.0:1790945977.697659:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8456a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638630912:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790945977.697736:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945977.697966:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638630912 00000100:00100000:0.0:1790945977.697975:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638630912 00000100:00100000:0.0:1790945977.698144:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1790945977.698155:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638630912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790945977.698223:0:6526:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1790945977.698281:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638630912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945977.698288:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1790945977.698546:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8456a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638630912:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1790945977.823363:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945977.928312:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945977.928385:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945977.928421:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945977.928455:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945977.928479:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945977.928663:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616567296 00000100:00100000:0.0:1790945977.928674:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616567296 00000100:00100000:0.0:1790945977.928719:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 328 00000100:00100000:0.0:1790945977.928729:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+19:2402:x1877942616567296:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790945977.928808:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+19:2402:x1877942616567296:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 80us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945977.928815:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 328 00000100:00100000:0.0:1790945977.928832:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616567808 00000100:00100000:0.0:1790945977.928835:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616567808 00000100:00100000:0.0:1790945977.928867:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616567424 00000100:00100000:0.0:1790945977.928871:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616567424 00000100:00100000:0.0:1790945977.928911:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 329 00000100:00100000:0.0:1790945977.928919:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2402:x1877942616567808:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790945977.928968:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2402:x1877942616567808:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 48us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945977.928975:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 329 00000100:00100000:0.0:1790945977.928988:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 330 00000100:00100000:0.0:1790945977.928995:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2402:x1877942616567424:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790945977.929018:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2402:x1877942616567424:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 25us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945977.929024:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 330 00000100:00080000:0.0:1790945977.929040:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790945977.929070:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616567168 00000100:00100000:0.0:1790945977.929073:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616567168 00000100:00100000:0.0:1790945977.929097:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 391 00000100:00100000:0.0:1790945977.929103:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087035850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:2402:x1877942616567168:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790945977.929131:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087035850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:2402:x1877942616567168:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 27us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945977.929137:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 391 00000100:00100000:1.0:1790945977.929876:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945977.930064:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945977.930147:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616567552 00000100:00100000:2.0:1790945977.930154:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616567552 00000100:00100000:2.0:1790945977.930234:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616567680 00000100:00100000:2.0:1790945977.930238:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616567680 00000100:00100000:2.0:1790945977.930269:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 132 00000100:00100000:2.0:1790945977.930277:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:2402:x1877942616567552:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790945977.930333:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:2402:x1877942616567552:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 56us (1947us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945977.930340:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 132 00000100:00100000:2.0:1790945977.930356:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 133 00000100:00100000:2.0:1790945977.930362:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2402:x1877942616567680:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790945977.930387:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2402:x1877942616567680:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 25us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945977.930393:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 133 00000100:00080000:1.0:1790945977.930624:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790945977.930628:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790945977.932231:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616567936 00000100:00100000:0.0:1790945977.932258:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616567936 00000100:00100000:0.0:1790945977.932347:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 331 00000100:00100000:0.0:1790945977.932358:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2402:x1877942616567936:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790945977.932468:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2402:x1877942616567936:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 111us (2403us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945977.932477:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 331 00000100:00080000:1.0:1790945977.933115:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790945978.207481:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790945978.207504:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638631040:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790945978.207571:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945978.207687:0:12418:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638631040 00000100:00100000:1.0:1790945978.207694:0:12418:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638631040 00000100:00100000:1.0:1790945978.207749:0:12418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1790945978.207757:0:12418:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638631040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790945978.207791:0:12418:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790945978.207839:0:12418:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638631040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945978.207846:0:12418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1790945978.208364:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638631040:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1790945978.848315:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945979.231491:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8450c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638631168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790945979.231580:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945979.231696:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638631296:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790945979.231720:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945979.231753:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638631168 00000100:00100000:3.0:1790945979.231761:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638631168 00000100:00100000:3.0:1790945979.231809:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638631296 00000100:00100000:3.0:1790945979.231812:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638631296 00000100:00100000:3.0:1790945979.231838:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1790945979.231847:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638631168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790945979.231878:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790945979.231917:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638631168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945979.231924:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1790945979.231956:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1790945979.231963:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638631296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790945979.231973:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790945979.232001:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638631296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945979.232007:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:3.0:1790945979.232022:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790945979.232060:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638631296:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790945979.232090:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8450c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638631168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790945979.232640:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8450c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877942638631552:0@lo:400:kworker.0 00000100:00100000:2.0:1790945979.232680:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945979.232713:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8450ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1877942638632064:0@lo:400:kworker.0 00000100:00100000:2.0:1790945979.232734:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945979.232755:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1877942638632576:0@lo:400:kworker.0 00000100:00100000:2.0:1790945979.232776:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945979.232809:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1790945979.232816:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8450f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8841fcfb-fb47-4307-92c2-97500c1c82bd:3648:1877942638631424:0@lo:400:kworker.0 00000100:00100000:2.0:1790945979.232849:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945979.232861:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638631552 00000100:00100000:1.0:1790945979.232868:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638631552 00000100:00100000:2.0:1790945979.232869:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8450c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638631936:0@lo:400:kworker.0 00000100:00100000:2.0:1790945979.232895:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945979.232910:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638632064 00000100:00100000:1.0:1790945979.232913:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638632064 00000100:00100000:2.0:1790945979.232914:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638632448:0@lo:400:kworker.0 00000100:00100000:1.0:1790945979.232938:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638632576 00000100:00100000:1.0:1790945979.232941:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638632576 00000100:00100000:2.0:1790945979.232953:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945979.232958:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1790945979.232966:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1877942638631552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945979.232983:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638631936 00000100:00100000:2.0:1790945979.232986:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638631936 00000100:00100000:1.0:1790945979.233021:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1877942638631552:12345-0@lo:400:kworker.0 Request processed in 55us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945979.233022:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1790945979.233028:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1790945979.233029:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638631936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945979.233051:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1790945979.233057:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1877942638632064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945979.233061:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638631936:12345-0@lo:400:kworker.0 Request processed in 35us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945979.233067:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1790945979.233083:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1877942638632064:12345-0@lo:400:kworker.0 Request processed in 26us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945979.233088:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1790945979.233100:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1790945979.233118:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1877942638632576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945979.233145:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1877942638632576:12345-0@lo:400:kworker.0 Request processed in 41us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945979.233151:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00080000:1.0:1790945979.233196:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790945979.233218:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8450c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638631936:0@lo:400:kworker.0 00000100:00100000:1.0:1790945979.233228:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8450c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877942638631552:0@lo:400:kworker.0 00000100:00100000:1.0:1790945979.233236:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8450ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1877942638632064:0@lo:400:kworker.0 00000100:00100000:1.0:1790945979.233244:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1877942638632576:0@lo:400:kworker.0 00000100:00100000:3.0:1790945979.233839:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638631424 00000100:00100000:3.0:1790945979.233847:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638631424 00000100:00100000:3.0:1790945979.233895:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1790945979.233905:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3648:x1877942638631424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945979.233977:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3648:x1877942638631424:12345-0@lo:400:kworker.0 Request processed in 74us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945979.233983:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1790945979.234012:0:8435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638632448 00000100:00100000:3.0:1790945979.234015:0:8435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638632448 00000100:00100000:3.0:1790945979.234043:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1790945979.234049:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bacec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638632448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945979.234079:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bacec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638632448:12345-0@lo:400:kworker.0 Request processed in 31us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945979.234085:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:1.0:1790945979.234210:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790945979.234254:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8450f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8841fcfb-fb47-4307-92c2-97500c1c82bd:3648:1877942638631424:0@lo:400:kworker.0 00000100:00100000:2.0:1790945979.234267:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638632448:0@lo:400:kworker.0 00000100:00100000:0.0:1790945979.235353:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8450e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638631680:0@lo:400:kworker.0 00000100:00100000:0.0:1790945979.235406:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945979.235440:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1877942638632192:0@lo:400:kworker.0 00000100:00100000:0.0:1790945979.235464:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945979.235483:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1877942638632704:0@lo:400:kworker.0 00000100:00100000:0.0:1790945979.235505:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945979.235529:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1790945979.235536:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8450e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638631808:0@lo:400:kworker.0 00000100:00100000:2.0:1790945979.235673:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638631680 00000100:00100000:2.0:1790945979.235680:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638631680 00000100:00100000:2.0:1790945979.235722:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1790945979.235730:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638631680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945979.235777:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638631680:12345-0@lo:400:kworker.0 Request processed in 48us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945979.235784:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1790945979.239351:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638632192 00000100:00100000:1.0:1790945979.239368:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638632192 00000100:00100000:1.0:1790945979.239423:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638632704 00000100:00100000:1.0:1790945979.239427:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638632704 00000100:00100000:1.0:1790945979.239463:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1790945979.239472:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8456aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877942638632192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945979.239582:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8456aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877942638632192:12345-0@lo:400:kworker.0 Request processed in 111us (4116us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945979.239590:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1790945979.239616:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1790945979.239623:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877942638632704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945979.239656:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877942638632704:12345-0@lo:400:kworker.0 Request processed in 33us (4149us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945979.239661:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00080000:1.0:1790945979.239678:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790945979.243181:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945979.243283:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638632320:0@lo:400:kworker.0 00000100:00100000:0.0:1790945979.243352:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945979.243405:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8450e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638631680:0@lo:400:kworker.0 00010000:00080000:0.0:1790945979.243423:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f8441c000 x1877942638632192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945979.243434:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1877942638632192:0@lo:400:kworker.0 00000100:00100000:1.0:1790945979.243446:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638631808 00010000:00080000:0.0:1790945979.243446:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f8441df80 x1877942638632704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945979.243454:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1877942638632704:0@lo:400:kworker.0 00000100:00100000:1.0:1790945979.243455:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638631808 00000100:00100000:1.0:1790945979.243506:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1790945979.243516:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638631808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945979.243535:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638632320 00000100:00100000:0.0:1790945979.243538:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638632320 00000100:00100000:1.0:1790945979.243572:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638631808:12345-0@lo:400:kworker.0 Request processed in 58us (8014us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945979.243575:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1790945979.243580:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1790945979.243581:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8456b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638632320:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1790945979.243602:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790945979.243628:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8456b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638632320:12345-0@lo:400:kworker.0 Request processed in 47us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945979.243650:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1790945979.243679:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8450e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638631808:0@lo:400:kworker.0 00000100:00100000:0.0:1790945979.243689:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638632320:0@lo:400:kworker.0 00000001:02000400:2.0:1790945979.267916:0:14960:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 08:59:38 (1790945978) 00010000:00010000:2.0:1790945979.873276:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945980.896883:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945981.280019:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638632832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790945981.280099:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945981.280680:0:13838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638632832 00000100:00100000:1.0:1790945981.280690:0:13838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638632832 00000100:00100000:1.0:1790945981.280747:0:13838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1790945981.280757:0:13838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84569880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638632832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790945981.280800:0:13838:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1790945981.280855:0:13838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84569880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638632832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945981.280863:0:13838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:1.0:1790945981.280896:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790945981.281084:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638632832:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1790945981.282384:0:6500:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000020:00080000:0.0:1790945981.282395:0:6500:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1790945981.282470:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1790945981.282486:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:1.0:1790945981.284376:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790945981.293247:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638632960:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790945981.293330:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945981.296003:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638632960 00000100:00100000:3.0:1790945981.296021:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638632960 00000100:00100000:0.0:1790945981.296300:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1790945981.296313:0:11925:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84568e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638632960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790945981.296345:0:11925:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1790945981.296441:0:11925:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84568e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638632960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 130us (3110us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945981.296447:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1790945981.296561:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638632960:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1790945981.302288:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790945981.337042:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945981.337267:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616568064 00000100:00100000:2.0:1790945981.337278:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616568064 00000100:00100000:2.0:1790945981.337463:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 256 00000100:00100000:2.0:1790945981.337474:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fac916e-06af-4e43-ae6d-171b0debcf61+5:13139:x1877942616568064:12345-192.168.204.20@tcp:101:lsof.0 00010000:00010000:2.0:1790945981.337495:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945981.337517:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27e1e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330eaf expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945981.337581:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27e1ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945981.337596:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27e1ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945981.337609:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27e1ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945981.337653:0:6522:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790945981.337657:0:6522:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790945981.337699:0:6522:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27e1ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945981.337725:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27e1e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330eaf expref: 7 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945981.337744:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27e1ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330eaf expref: 6 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945981.337766:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3f824ef400) 00010000:00010000:2.0:1790945981.337769:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790945981.337773:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c65400, rc 0) 00000100:00100000:2.0:1790945981.337856:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fac916e-06af-4e43-ae6d-171b0debcf61+6:13139:x1877942616568064:12345-192.168.204.20@tcp:101:lsof.0 Request processed in 384us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945981.337865:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 256 00000100:00080000:1.0:1790945981.340325:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790945981.922696:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945982.589383:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945982.589493:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616568320 00000100:00100000:0.0:1790945982.589506:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616568320 00000100:00100000:0.0:1790945982.589595:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 66 00000100:00100000:0.0:1790945982.589606:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+18:13140:x1877942616568320:12345-192.168.204.20@tcp:35:umount.0 00000100:00100000:0.0:1790945982.589897:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+19:13140:x1877942616568320:12345-192.168.204.20@tcp:35:umount.0 Request processed in 293us (523us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1790945982.589905:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 66 00000100:00080000:2.0:1790945982.591525:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790945982.599330:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945982.599440:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616568576 00000100:00100000:3.0:1790945982.599450:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616568576 00000100:00100000:3.0:1790945982.599514:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 67 00000100:00100000:3.0:1790945982.599525:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8456b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+19:13140:x1877942616568576:12345-192.168.204.20@tcp:35:umount.0 00000100:00100000:3.0:1790945982.599860:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8456b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+20:13140:x1877942616568576:12345-192.168.204.20@tcp:35:umount.0 Request processed in 337us (541us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1790945982.599869:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 67 00000100:00100000:1.0:1790945982.606359:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945982.606452:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616568832 00000100:00100000:3.0:1790945982.606463:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616568832 00000100:00100000:3.0:1790945982.606526:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 68 00000100:00100000:3.0:1790945982.606553:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4096ddbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+20:13140:x1877942616568832:12345-192.168.204.20@tcp:35:umount.0 00000100:00100000:3.0:1790945982.606815:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4096ddbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+21:13140:x1877942616568832:12345-192.168.204.20@tcp:35:umount.0 Request processed in 264us (467us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1790945982.606823:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 68 00000100:00100000:0.0:1790945982.609525:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945982.609607:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616569088 00000100:00100000:3.0:1790945982.609617:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616569088 00000100:00100000:3.0:1790945982.609682:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 69 00000100:00100000:3.0:1790945982.609693:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+21:13140:x1877942616569088:12345-192.168.204.20@tcp:35:umount.0 00000100:00100000:3.0:1790945982.610482:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+22:13140:x1877942616569088:12345-192.168.204.20@tcp:35:umount.0 Request processed in 789us (965us total) trans 4294967527 rc 0/0 00000100:00100000:3.0:1790945982.610492:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 69 00000100:00100000:0.0:1790945982.632643:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945982.632690:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945982.632732:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945982.632769:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945982.632801:0:10099:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616569472 00000100:00100000:0.0:1790945982.632810:0:10099:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616569472 00000100:00100000:0.0:1790945982.632887:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 80 00000100:00100000:2.0:1790945982.632889:0:7471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616569216 00000100:00100000:2.0:1790945982.632893:0:7471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616569216 00000100:00100000:0.0:1790945982.632898:0:10099:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84569500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2400:x1877942616569472:12345-192.168.204.20@tcp:9:umount.0 00000100:00100000:2.0:1790945982.632926:0:7471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616569344 00000100:00100000:2.0:1790945982.632928:0:7471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616569344 00000020:00000080:0.0:1790945982.632932:0:10099:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27d4ef 00000100:00100000:2.0:1790945982.632938:0:7471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616569600 00000100:00100000:2.0:1790945982.632940:0:7471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616569600 00000100:00080000:0.0:1790945982.632941:0:10099:0:(import.c:65:import_set_state_nolock()) ffff9d40914e7800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1790945982.632954:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 20 00000100:00100000:2.0:1790945982.632960:0:7471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84568000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+15:2404:x1877942616569216:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790945982.632970:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945982.632989:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d4086a4c400/0xd9f4181e0d27d153 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a09 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1790945982.632994:0:10099:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00010000:00010000:2.0:1790945982.633006:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945982.633283:0:7471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84568000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+14:2404:x1877942616569216:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 320us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945982.633296:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 20 00000100:00100000:2.0:1790945982.633315:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 21 00000100:00100000:2.0:1790945982.633322:0:7471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8456a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+13:2404:x1877942616569344:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790945982.633331:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790945982.633331:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 22 00010000:00010000:2.0:1790945982.633356:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d4080031600/0xd9f4181e0d27d114 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223309ca expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945982.633367:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945982.633473:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84568a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+12:2402:x1877942616569600:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790945982.633482:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945982.633492:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40c21d6000/0xd9f4181e0d27d3ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ae2 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945982.633502:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945982.633772:0:10099:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84569500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+2:2400:x1877942616569472:12345-192.168.204.20@tcp:9:umount.0 Request processed in 875us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945982.633781:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 80 00010000:00010000:0.0:1790945982.633804:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790945982.634305:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790945982.640871:0:7471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8456a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+11:2404:x1877942616569344:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 7523us (8156us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945982.640886:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 21 00000100:00100000:1.0:1790945982.646927:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84568a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:2402:x1877942616569600:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 12726us (13462us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945982.646947:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 22 00000100:00100000:1.0:1790945982.651659:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945982.652893:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616569984 00000100:00100000:0.0:1790945982.652908:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616569984 00000100:00100000:0.0:1790945982.653053:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 81 00000100:00100000:0.0:1790945982.653065:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+7:2400:x1877942616569984:12345-192.168.204.20@tcp:9:umount.0 00000020:00000080:0.0:1790945982.653097:0:8437:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27d765 00000020:00010000:0.0:1790945982.653105:0:8437:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9d40914e0000: total 0 00000100:00080000:0.0:1790945982.653110:0:8437:0:(import.c:65:import_set_state_nolock()) ffff9d40914e0800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790945982.653191:0:8437:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1790945982.653372:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2400:x1877942616569984:12345-192.168.204.20@tcp:9:umount.0 Request processed in 310us (1723us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945982.653396:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 81 00000020:00010000:1.0:1790945982.654245:0:6510:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9d40914e0000: total 0 00010000:00010000:1.0:1790945982.654299:0:6510:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9d40914e0000, canceled 0 locks, left on hash table 2. 00000100:00080000:2.0:1790945982.654701:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790945982.654800:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050f88e0d/0xd9f4181e0d27e1de lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ea8 expref: 4 pid: 10099 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945982.654856:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000089c8595/0xd9f4181e0d27db1d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ccc expref: 3 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945982.654873:0:6510:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9d40914e0000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1790945982.654889:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945982.654892:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945982.654894:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945982.666860:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945982.666962:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616571008 00000100:00100000:1.0:1790945982.666997:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616571008 00000100:00100000:1.0:1790945982.667071:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 257 00000100:00100000:1.0:1790945982.667491:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8456b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+22:2400:x1877942616571008:12345-192.168.204.20@tcp:39:umount.0 00000020:00000080:1.0:1790945982.667541:0:6523:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27d122 00000020:00010000:1.0:1790945982.667560:0:6523:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9d40bfe99800: total 0 00000100:00080000:1.0:1790945982.667565:0:6523:0:(import.c:65:import_set_state_nolock()) ffff9d40bfe98800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790945982.667584:0:6523:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:1.0:1790945982.667770:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8456b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+21:2400:x1877942616571008:12345-192.168.204.20@tcp:39:umount.0 Request processed in 689us (928us total) trans 4294967528 rc 0/0 00000100:00100000:1.0:1790945982.667779:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 257 00000020:00010000:0.0:1790945982.667895:0:10339:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9d40bfe99800: total 0 00010000:00010000:0.0:1790945982.667948:0:10339:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9d40bfe99800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1790945982.667998:0:10339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d40bc9ad200) 00010000:00010000:0.0:1790945982.668002:0:10339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1790945982.668010:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030200/0xd9f4181e0d27d4c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330b0c expref: 20 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945982.668030:0:10339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d40bc937800) 00010000:00010000:0.0:1790945982.668033:0:10339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1790945982.668036:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d000/0xd9f4181e0d27db08 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cc5 expref: 19 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945982.668060:0:10339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d3f824ef900) 00010000:00010000:0.0:1790945982.668062:0:10339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1790945982.668066:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27db94 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ce8 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945982.668078:0:10339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3f824ef300) 00010000:00010000:0.0:1790945982.668093:0:10339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790945982.668097:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0600/0xd9f4181e0d27e19f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e93 expref: 17 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945982.668111:0:10339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3f824ec400) 00010000:00010000:0.0:1790945982.668113:0:10339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945982.668116:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363dc00/0xd9f4181e0d27d46a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330af7 expref: 16 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945982.668161:0:10339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d40bc937800) 00010000:00010000:0.0:1790945982.668164:0:10339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790945982.668224:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27dade lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330cb7 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945982.668240:0:10339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d3f824ef900) 00010000:00010000:0.0:1790945982.668243:0:10339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790945982.668246:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc400/0xd9f4181e0d27de81 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330dc1 expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945982.668260:0:10339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d40bc9ad200) 00010000:00010000:0.0:1790945982.668262:0:10339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790945982.668265:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363cc00/0xd9f4181e0d27d7c0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330be5 expref: 13 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945982.668281:0:10339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3f824ef400) 00010000:00010000:0.0:1790945982.668283:0:10339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790945982.668287:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363c400/0xd9f4181e0d27db78 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ce1 expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945982.668298:0:10339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3f824ef300) 00010000:00010000:0.0:1790945982.668300:0:10339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1790945982.668303:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27e1c9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ea1 expref: 11 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945982.668315:0:10339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3f824ef300) 00010000:00010000:0.0:1790945982.668318:0:10339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790945982.668343:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64c00/0xd9f4181e0d27e0bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330e5b expref: 10 pid: 13005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945982.668364:0:10339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d40bc937800) 00010000:00010000:0.0:1790945982.668366:0:10339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790945982.668370:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d600/0xd9f4181e0d27d9fe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330c7f expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945982.668384:0:10339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d3f824ecd00) 00010000:00010000:0.0:1790945982.668386:0:10339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790945982.668390:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f8363d200/0xd9f4181e0d27d44e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330af0 expref: 8 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945982.668403:0:10339:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9d40bfe99800, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1790945982.668418:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945982.668421:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945982.668422:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945982.679802:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945982.680203:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616571136 00000100:00100000:3.0:1790945982.680228:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616571136 00000100:00100000:3.0:1790945982.680314:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 258 00000100:00100000:3.0:1790945982.680326:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8456a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+5:2400:x1877942616571136:12345-192.168.204.20@tcp:39:umount.0 00000100:00080000:1.0:1790945982.680557:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000080:3.0:1790945982.680677:0:6521:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27d129 00000100:00080000:3.0:1790945982.680706:0:6521:0:(import.c:65:import_set_state_nolock()) ffff9d40bff08800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790945982.680774:0:6521:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1790945982.681375:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8456a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cadc7a5-c0ba-4320-984f-d871ffb3a3ef+3:2400:x1877942616571136:12345-192.168.204.20@tcp:39:umount.0 Request processed in 1049us (1581us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1790945982.681385:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 258 00010000:00010000:2.0:1790945982.688136:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945982.815528:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638633088:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790945982.815610:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945982.815948:0:12418:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638633088 00000100:00100000:1.0:1790945982.815958:0:12418:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638633088 00000100:00100000:1.0:1790945982.816020:0:12418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1790945982.816028:0:12418:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bacece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638633088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790945982.816076:0:12418:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1790945982.816163:0:12418:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bacece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638633088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 135us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945982.816338:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638633088:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790945982.816369:0:12418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00010000:00010000:1.0:1790945982.945571:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945983.047423:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945983.047536:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945983.047578:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945983.047642:0:6514:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616571264 00000100:00100000:0.0:1790945983.047654:0:6514:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616571264 00000100:00100000:0.0:1790945983.047720:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 393 00000100:00100000:0.0:1790945983.047730:0:6514:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:2403:x1877942616571264:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790945983.047814:0:6514:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:2403:x1877942616571264:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 85us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945983.047822:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 393 00000100:00100000:3.0:1790945983.059223:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616571392 00000100:00100000:3.0:1790945983.059243:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616571392 00000100:00100000:1.0:1790945983.059253:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616571520 00000100:00100000:1.0:1790945983.059260:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616571520 00000100:00080000:2.0:1790945983.059291:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790945983.059297:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790945983.059409:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 338 00000100:00100000:3.0:1790945983.059424:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40baced180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0fac916e-06af-4e43-ae6d-171b0debcf61+6:2403:x1877942616571392:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790945983.059531:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40baced180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0fac916e-06af-4e43-ae6d-171b0debcf61+6:2403:x1877942616571392:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 111us (12120us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945983.059950:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 338 00000100:00100000:1.0:1790945983.062648:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 339 00000100:00100000:1.0:1790945983.062678:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bacee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2403:x1877942616571520:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790945983.063552:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bacee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2403:x1877942616571520:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 883us (15965us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945983.063564:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 339 00000100:00100000:0.0:1790945983.327840:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638633216:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790945983.327944:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945983.328924:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638633216 00000100:00100000:3.0:1790945983.328936:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638633216 00000100:00100000:3.0:1790945983.329021:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1790945983.329031:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638633216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790945983.329069:0:6526:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790945983.329140:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638633216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (1195us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945983.329148:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1790945983.329357:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638633216:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1790945983.967381:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945984.320081:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790945984.320127:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945984.320839:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616571648 00000100:00100000:3.0:1790945984.320852:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616571648 00000100:00100000:3.0:1790945984.320926:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616571776 00000100:00100000:3.0:1790945984.320929:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616571776 00000100:00100000:3.0:1790945984.320955:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 23 00000100:00100000:3.0:1790945984.320964:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40baced880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+11:2401:x1877942616571648:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790945984.320983:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945984.321003:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3f8363d800/0xd9f4181e0d27d225 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a1e expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945984.321022:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945984.321262:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40baced880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+10:2401:x1877942616571648:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 298us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945984.321271:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 23 00000100:00100000:3.0:1790945984.321293:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 24 00000100:00100000:3.0:1790945984.321300:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40baced500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+9:2401:x1877942616571776:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790945984.321323:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945984.321332:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3f8363c800/0xd9f4181e0d27d22c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a4f expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945984.321341:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945984.321360:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40baced500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+8:2401:x1877942616571776:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 61us (1232us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945984.321365:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 24 00000100:00100000:2.0:1790945984.322761:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790945984.324009:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616571904 00000100:00100000:0.0:1790945984.324023:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616571904 00000100:00100000:0.0:1790945984.324102:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 25 00000100:00100000:0.0:1790945984.324112:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4096cbac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+8:2403:x1877942616571904:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790945984.324129:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945984.324151:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40813ff000/0xd9f4181e0d27d3e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330adb expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945984.324214:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945984.324273:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4096cbac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+7:2403:x1877942616571904:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 161us (1519us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945984.324282:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 25 00000100:00100000:0.0:1790945984.330930:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945984.331206:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616572160 00000100:00100000:3.0:1790945984.331218:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616572160 00000100:00100000:3.0:1790945984.331293:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 259 00000100:00100000:3.0:1790945984.331302:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0fac916e-06af-4e43-ae6d-171b0debcf61+6:2400:x1877942616572160:12345-192.168.204.20@tcp:39:umount.0 00000020:00000080:3.0:1790945984.331349:0:6521:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27d23a 00000020:00010000:3.0:1790945984.331357:0:6521:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9d3f83706800: total 0 00000100:00080000:3.0:1790945984.331362:0:6521:0:(import.c:65:import_set_state_nolock()) ffff9d3f83707800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790945984.331390:0:6521:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00100000:3.0:1790945984.331555:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2400:x1877942616572160:12345-192.168.204.20@tcp:39:umount.0 Request processed in 253us (633us total) trans 4294967529 rc 0/0 00000100:00100000:3.0:1790945984.331563:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 259 00000020:00010000:0.0:1790945984.332242:0:6509:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9d3f83706800: total 0 00010000:00010000:0.0:1790945984.332248:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945984.332300:0:6509:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9d3f83706800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1790945984.332351:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3f824ef400) 00010000:00010000:0.0:1790945984.332354:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790945984.332364:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27e1ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330eaf expref: 4 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945984.332399:0:6509:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9d3f83706800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1790945984.332409:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945984.332411:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945984.332413:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945984.348431:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790945984.350496:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616572288 00000100:00100000:1.0:1790945984.350512:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616572288 00000100:00100000:1.0:1790945984.350595:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 260 00000100:00100000:1.0:1790945984.350607:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fac916e-06af-4e43-ae6d-171b0debcf61+5:2400:x1877942616572288:12345-192.168.204.20@tcp:39:umount.0 00000020:00000080:1.0:1790945984.350653:0:8457:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27d241 00000100:00080000:1.0:1790945984.350663:0:8457:0:(import.c:65:import_set_state_nolock()) ffff9d3f83707000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790945984.350703:0:8457:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1790945984.350895:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fac916e-06af-4e43-ae6d-171b0debcf61+3:2400:x1877942616572288:12345-192.168.204.20@tcp:39:umount.0 Request processed in 290us (2478us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1790945984.350905:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 260 00010000:00010000:3.0:1790945984.351075:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945984.351382:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40baceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638633472:0@lo:400:kworker.0 00000100:00100000:2.0:1790945984.351447:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945984.351505:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1877942638633984:0@lo:400:kworker.0 00000100:00100000:2.0:1790945984.351528:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945984.351552:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1877942638634496:0@lo:400:kworker.0 00000100:00100000:2.0:1790945984.351573:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945984.351596:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1790945984.351602:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638633600:0@lo:400:kworker.0 00000100:00100000:2.0:1790945984.351646:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945984.351666:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1877942638634112:0@lo:400:kworker.0 00000100:00100000:2.0:1790945984.351686:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945984.351707:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1877942638634624:0@lo:400:kworker.0 00000100:00100000:2.0:1790945984.351726:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945984.351754:0:12418:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638633600 00000100:00100000:2.0:1790945984.351759:0:12418:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638633600 00000100:00100000:2.0:1790945984.351801:0:12418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1790945984.351809:0:12418:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638633600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945984.351857:0:12418:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638633600:12345-0@lo:400:kworker.0 Request processed in 48us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945984.351864:0:12418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1790945984.351910:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638633600:0@lo:400:kworker.0 00000100:00100000:2.0:1790945984.351937:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638633472 00000100:00100000:2.0:1790945984.351941:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638633472 00000100:00100000:2.0:1790945984.351960:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638633984 00000100:00100000:2.0:1790945984.351963:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638633984 00000100:00100000:2.0:1790945984.351983:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638634496 00000100:00100000:2.0:1790945984.351986:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638634496 00000100:00100000:2.0:1790945984.351999:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638634112 00000100:00100000:2.0:1790945984.352001:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638634112 00000100:00100000:2.0:1790945984.352011:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638634624 00000100:00100000:2.0:1790945984.352013:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638634624 00000100:00100000:2.0:1790945984.352025:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1790945984.352031:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40baced500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638633472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945984.352066:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40baced500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638633472:12345-0@lo:400:kworker.0 Request processed in 35us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945984.352083:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1790945984.352096:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1790945984.352102:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1877942638633984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945984.352131:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1877942638633984:12345-0@lo:400:kworker.0 Request processed in 30us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945984.352137:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1790945984.352148:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1790945984.352155:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1877942638634496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945984.352219:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1877942638634496:12345-0@lo:400:kworker.0 Request processed in 65us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945984.352226:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1790945984.352237:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1790945984.352242:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1877942638634112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945984.352267:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1877942638634112:12345-0@lo:400:kworker.0 Request processed in 25us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945984.352272:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1790945984.352283:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1790945984.352288:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1877942638634624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945984.352315:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1877942638634624:12345-0@lo:400:kworker.0 Request processed in 27us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945984.352321:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00010000:00080000:2.0:1790945984.352348:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bacec000 x1877942638634112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945984.352360:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1877942638634112:0@lo:400:kworker.0 00010000:00080000:2.0:1790945984.352378:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bacef800 x1877942638634624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945984.352387:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1877942638634624:0@lo:400:kworker.0 00000100:00100000:2.0:1790945984.352396:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40baceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638633472:0@lo:400:kworker.0 00000100:00100000:2.0:1790945984.352404:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1877942638633984:0@lo:400:kworker.0 00000100:00100000:2.0:1790945984.352412:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1877942638634496:0@lo:400:kworker.0 00000100:00080000:2.0:1790945984.352451:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790945984.352456:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790945984.353212:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40baceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638633344:0@lo:400:kworker.0 00000100:00100000:3.0:1790945984.353258:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945984.353287:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638633856:0@lo:400:kworker.0 00000100:00100000:3.0:1790945984.353311:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945984.353331:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40baceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638634368:0@lo:400:kworker.0 00000100:00100000:3.0:1790945984.353379:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945984.353400:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40baced880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638634880:0@lo:400:kworker.0 00000100:00100000:3.0:1790945984.353420:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945984.353439:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1790945984.353446:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877942638633728:0@lo:400:kworker.0 00000100:00100000:3.0:1790945984.353468:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945984.353485:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638634240:0@lo:400:kworker.0 00000100:00100000:3.0:1790945984.353504:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945984.353518:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638634752:0@lo:400:kworker.0 00000100:00100000:3.0:1790945984.353537:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945984.353565:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638633856 00000100:00100000:3.0:1790945984.353572:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638633856 00000100:00100000:3.0:1790945984.353615:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1790945984.353623:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638633856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945984.353672:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638633856:12345-0@lo:400:kworker.0 Request processed in 50us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945984.353679:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1790945984.353700:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638634368 00000100:00100000:3.0:1790945984.353704:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638634368 00000100:00100000:3.0:1790945984.353735:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638634880 00000100:00100000:3.0:1790945984.353738:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638634880 00000100:00100000:3.0:1790945984.353750:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638634240 00000100:00100000:3.0:1790945984.353753:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638634240 00000100:00100000:3.0:1790945984.353765:0:8916:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638634752 00000100:00100000:3.0:1790945984.353767:0:8916:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638634752 00000100:00100000:3.0:1790945984.353778:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1790945984.353783:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638634368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945984.353890:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638634368:12345-0@lo:400:kworker.0 Request processed in 106us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945984.353898:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1790945984.353912:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1790945984.353919:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638634880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945984.353947:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638634880:12345-0@lo:400:kworker.0 Request processed in 30us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945984.353953:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1790945984.353964:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1790945984.353970:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638634240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945984.353995:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638634240:12345-0@lo:400:kworker.0 Request processed in 26us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945984.354000:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1790945984.354010:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1790945984.354016:0:8916:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f845ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638634752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945984.354040:0:8916:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f845ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638634752:12345-0@lo:400:kworker.0 Request processed in 25us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945984.354046:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1790945984.354094:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638634240:0@lo:400:kworker.0 00000100:00100000:3.0:1790945984.354105:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638634752:0@lo:400:kworker.0 00000100:00100000:3.0:1790945984.354113:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638633856:0@lo:400:kworker.0 00000100:00100000:3.0:1790945984.354121:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40baceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638634368:0@lo:400:kworker.0 00000100:00100000:3.0:1790945984.354129:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40baced880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638634880:0@lo:400:kworker.0 00000100:00100000:3.0:1790945984.354164:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638633728 00000100:00100000:3.0:1790945984.354202:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638633728 00000100:00100000:3.0:1790945984.354228:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1790945984.354234:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877942638633728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945984.354270:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877942638633728:12345-0@lo:400:kworker.0 Request processed in 36us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945984.354276:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1790945984.354300:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877942638633728:0@lo:400:kworker.0 00000100:00080000:3.0:1790945984.354316:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790945984.354319:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790945984.354642:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638635136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790945984.354675:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945984.354713:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790945984.354719:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638635008:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790945984.354740:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945984.354910:0:6516:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638633344 00000100:00100000:1.0:1790945984.354916:0:6516:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638633344 00000100:00100000:1.0:1790945984.354948:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1790945984.354954:0:6516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087033050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3650:x1877942638633344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945984.354995:0:6516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087033050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3650:x1877942638633344:12345-0@lo:400:kworker.0 Request processed in 41us (1737us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945984.355001:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1790945984.355028:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638635136 00000100:00100000:1.0:1790945984.355032:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638635136 00000100:00100000:1.0:1790945984.355050:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638635008 00000100:00100000:1.0:1790945984.355053:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638635008 00000100:00100000:1.0:1790945984.355070:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1790945984.355076:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638635136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790945984.355095:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790945984.355130:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638635136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945984.355147:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1790945984.355159:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1790945984.355165:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638635008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790945984.355205:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790945984.355231:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638635008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945984.355237:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1790945984.355267:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40baceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638633344:0@lo:400:kworker.0 00000100:00100000:1.0:1790945984.355301:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638635008:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790945984.355311:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638635136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790945984.401681:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790945984.401773:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616572544 00000100:00100000:3.0:1790945984.401784:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616572544 00000100:00100000:3.0:1790945984.401876:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 395 00000100:00100000:3.0:1790945984.401887:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+7:2400:x1877942616572544:12345-192.168.204.20@tcp:251:umount.0 00000020:00000080:3.0:1790945984.401936:0:6515:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27d0ff 00000020:00010000:3.0:1790945984.401944:0:6515:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9d40bff10800: total 0 00000100:00080000:3.0:1790945984.401949:0:6515:0:(import.c:65:import_set_state_nolock()) ffff9d40bff15800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1790945984.402045:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:021de7e3-4377-4cbc-9af0-2b26e9ce67a1+3:2400:x1877942616572544:12345-192.168.204.20@tcp:251:umount.0 Request processed in 160us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945984.402053:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 395 00000020:00010000:0.0:1790945984.406647:0:10339:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9d40bff10800: total 0 00010000:00010000:0.0:1790945984.406745:0:10339:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9d40bff10800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1790945984.406789:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40baef0400/0xd9f4181e0d27d15a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330a10 expref: 2 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945984.406811:0:10339:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9d40bff10800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1790945984.406823:0:10339:0:(genops.c:885:class_export_put()) final put ffff9d40bff10800/021de7e3-4377-4cbc-9af0-2b26e9ce67a1 00010000:00010000:0.0:1790945984.406850:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945984.406853:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945984.406855:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790945984.412023:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40bff10800/021de7e3-4377-4cbc-9af0-2b26e9ce67a1 for MGS 00000020:00000080:2.0:1790945984.412085:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d40bff15800 for MGS 00010000:00010000:0.0:1790945984.991285:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945986.017748:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790945986.168604:0:15156:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000040:00080000:1.0:1790945986.207587:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790945986.207598:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790945986.209099:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1790945986.209115:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000020:01000004:2.0:1790945986.209903:0:15156:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1790945986.209949:0:15156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6c00/0xd9f4181e0d27d1b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d1bc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945986.210384:0:15156:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6c00/0xd9f4181e0d27d1b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d1bc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945986.210394:0:15156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6c00/0xd9f4181e0d27d1b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27d1bc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945986.210413:0:15156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6c00/0xd9f4181e0d27d1b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27d1bc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945986.210530:0:15156:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790945986.210536:0:15156:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1790945986.210561:0:15156:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790945986.210566:0:15156:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1790945986.210571:0:15156:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790945986.210595:0:15156:0:(import.c:65:import_set_state_nolock()) ffff9d40bae3b800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1790945986.211289:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1877942638635264:0@lo:39:umount.0 00000100:00100000:3.0:1790945986.211363:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945986.211576:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638635264 00000100:00100000:2.0:1790945986.211585:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638635264 00000100:00100000:2.0:1790945986.211636:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1790945986.211644:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f845ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1877942638635264:12345-0@lo:39:umount.0 00000020:00000080:2.0:1790945986.211674:0:8457:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27cd16 00000100:00080000:2.0:1790945986.211681:0:8457:0:(import.c:65:import_set_state_nolock()) ffff9d4099033800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1790945986.211948:0:10339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790945986.211958:0:10339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6c00/0xd9f4181e0d27d1b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27d1bc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945986.212032:0:10339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d6c00 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:1.0:1790945986.212036:0:10339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6c00/0xd9f4181e0d27d1b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27d1bc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945986.212046:0:10339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6c00/0xd9f4181e0d27d1b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xd9f4181e0d27d1bc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790945986.212053:0:10339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6c00/0xd9f4181e0d27d1b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xd9f4181e0d27d1bc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945986.212069:0:10339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790945986.212072:0:10339:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1790945986.212074:0:10339:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1790945986.212104:0:10339:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6c00/0xd9f4181e0d27d1b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27d1bc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945986.212110:0:10339:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1790945986.212161:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638635392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790945986.212212:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945986.212298:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638635392 00000100:00100000:3.0:1790945986.212303:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638635392 00000100:00100000:3.0:1790945986.212341:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790945986.212347:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3649:x1877942638635392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790945986.212365:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945986.212380:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40baef0000/0xd9f4181e0d27d1bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd9f4181e0d27d1b5 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945986.212395:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790945986.212559:0:10339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6c00/0xd9f4181e0d27d1b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27d1bc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945986.212566:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6c00/0xd9f4181e0d27d1b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27d1bc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945986.212578:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945986.212579:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945986.212581:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945986.212762:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f845ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3646:x1877942638635264:12345-0@lo:39:umount.0 Request processed in 1117us (1399us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945986.212770:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000020:00000080:2.0:1790945986.212791:0:8457:0:(genops.c:885:class_export_put()) final put ffff9d4099037000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1790945986.212969:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790945986.213387:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d4099037000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1790945986.213544:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d4099033800 for lustre-MDT0000 00000100:00100000:3.0:1790945986.213611:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:3649:x1877942638635392:12345-0@lo:103:ldlm_bl.0 Request processed in 1263us (1397us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945986.213620:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1790945986.213667:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40bae3b800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1790945986.213723:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1877942638635264:0@lo:39:umount.0 00000100:00100000:0.0:1790945986.213888:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638635392:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1790945986.213927:0:15156:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790945986.213931:0:15156:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1790945986.213935:0:15156:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1790945986.216581:0:15156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4080030c00/0xd9f4181e0d27d1c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d1ca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945986.216600:0:15156:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4080030c00/0xd9f4181e0d27d1c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d1ca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945986.216626:0:15156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4080030c00/0xd9f4181e0d27d1c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27d1ca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945986.216633:0:15156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9d4080030c00/0xd9f4181e0d27d1c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27d1ca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945986.216656:0:15156:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790945986.216663:0:15156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4086a4de00/0xd9f4181e0d27d0b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d0c0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945986.216670:0:15156:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4086a4de00/0xd9f4181e0d27d0b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d0c0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945986.216675:0:15156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4086a4de00/0xd9f4181e0d27d0b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27d0c0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945986.216681:0:15156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9d4086a4de00/0xd9f4181e0d27d0b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27d0c0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945986.216886:0:15156:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790945986.216895:0:15156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7000/0xd9f4181e0d27d41d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d424 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945986.216901:0:15156:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7000/0xd9f4181e0d27d41d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d424 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945986.216906:0:15156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7000/0xd9f4181e0d27d41d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27d424 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945986.216922:0:15156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7000/0xd9f4181e0d27d41d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27d424 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945986.216954:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1790945986.216972:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d4080030c00/0xd9f4181e0d27d1c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27d1ca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945986.216980:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080030c00 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:3.0:1790945986.216984:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d4080030c00/0xd9f4181e0d27d1c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27d1ca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945986.216993:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d4080030c00/0xd9f4181e0d27d1c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xd9f4181e0d27d1ca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790945986.217001:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d4080030c00/0xd9f4181e0d27d1c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xd9f4181e0d27d1ca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790945986.217006:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790945986.217009:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1790945986.217043:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d4080030c00/0xd9f4181e0d27d1c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27d1ca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945986.217059:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790945986.217095:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d4080030c00/0xd9f4181e0d27d1c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27d1ca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945986.217102:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d4080030c00/0xd9f4181e0d27d1c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27d1ca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945986.217117:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790945986.217120:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d4086a4de00/0xd9f4181e0d27d0b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27d0c0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945986.217126:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4086a4de00 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:3.0:1790945986.217129:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d4086a4de00/0xd9f4181e0d27d0b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27d0c0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945986.217146:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d4086a4de00/0xd9f4181e0d27d0b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd9f4181e0d27d0c0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790945986.217153:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d4086a4de00/0xd9f4181e0d27d0b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd9f4181e0d27d0c0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790945986.217159:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1790945986.217160:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1790945986.217163:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1790945986.217200:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d4086a4de00/0xd9f4181e0d27d0b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27d0c0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945986.217207:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790945986.217224:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d4086a4de00/0xd9f4181e0d27d0b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27d0c0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945986.217254:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d4086a4de00/0xd9f4181e0d27d0b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27d0c0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945986.217264:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790945986.217267:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7000/0xd9f4181e0d27d41d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27d424 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945986.217273:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d7000 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:3.0:1790945986.217285:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7000/0xd9f4181e0d27d41d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27d424 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945986.217293:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7000/0xd9f4181e0d27d41d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xd9f4181e0d27d424 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790945986.217300:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7000/0xd9f4181e0d27d41d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xd9f4181e0d27d424 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790945986.217305:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1790945986.217308:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1790945986.217320:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7000/0xd9f4181e0d27d41d lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27d424 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945986.217325:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790945986.217332:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7000/0xd9f4181e0d27d41d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27d424 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945986.217339:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945986.217341:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945986.217343:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945986.217368:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f845ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638635648:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790945986.217443:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945986.217490:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790945986.217496:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f845edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638635776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790945986.217514:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945986.217545:0:7471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638635648 00000100:00100000:3.0:1790945986.217551:0:7471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638635648 00000100:00100000:3.0:1790945986.217587:0:7471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638635776 00000100:00100000:3.0:1790945986.217589:0:7471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638635776 00000100:00100000:3.0:1790945986.217606:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790945986.217614:0:7471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f845ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8841fcfb-fb47-4307-92c2-97500c1c82bd+24:3647:x1877942638635648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790945986.217627:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945986.217643:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40813ffe00/0xd9f4181e0d27d0c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd9f4181e0d27d0b9 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945986.217656:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945986.217699:0:7471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f845ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8841fcfb-fb47-4307-92c2-97500c1c82bd+23:3647:x1877942638635648:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945986.217706:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790945986.217722:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790945986.217728:0:7471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f845ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8841fcfb-fb47-4307-92c2-97500c1c82bd+22:3647:x1877942638635776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790945986.217735:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945986.217742:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40c21d7800/0xd9f4181e0d27d424 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd9f4181e0d27d41d expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945986.217751:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945986.217768:0:7471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f845ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:3647:x1877942638635776:12345-0@lo:103:ldlm_bl.0 Request processed in 41us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945986.217793:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790945986.217829:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f845edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638635776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790945986.217837:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f845ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638635648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790945986.218327:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f845ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638635520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790945986.218363:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945986.218531:0:7471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638635520 00000100:00100000:3.0:1790945986.218537:0:7471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638635520 00000100:00100000:3.0:1790945986.218576:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790945986.218583:0:7471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8841fcfb-fb47-4307-92c2-97500c1c82bd+21:3650:x1877942638635520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790945986.218593:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945986.218603:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40baef1400/0xd9f4181e0d27d1ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd9f4181e0d27d1c3 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945986.218613:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945986.218641:0:7471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8841fcfb-fb47-4307-92c2-97500c1c82bd+20:3650:x1877942638635520:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945986.218647:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790945986.218796:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f845ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638635520:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790945986.218909:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945986.219047:0:15156:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1790945986.219054:0:15156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7000/0xd9f4181e0d27d41d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27d424 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945986.219067:0:15156:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1790945986.219075:0:15156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4086a4c600/0xd9f4181e0d27cc75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cc7c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945986.219082:0:15156:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4086a4c600/0xd9f4181e0d27cc75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27cc7c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945986.219089:0:15156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4086a4c600/0xd9f4181e0d27cc75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27cc7c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945986.219095:0:15156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9d4086a4c600/0xd9f4181e0d27cc75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27cc7c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945986.219125:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790945986.219131:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d4086a4c600/0xd9f4181e0d27cc75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27cc7c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945986.219148:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4086a4c600 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:1.0:1790945986.219151:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d4086a4c600/0xd9f4181e0d27cc75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27cc7c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945986.219160:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d4086a4c600/0xd9f4181e0d27cc75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd9f4181e0d27cc7c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790945986.219209:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d4086a4c600/0xd9f4181e0d27cc75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd9f4181e0d27cc7c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945986.219215:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1790945986.219217:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:1.0:1790945986.219252:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d4086a4c600/0xd9f4181e0d27cc75 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27cc7c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945986.219260:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790945986.219289:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d4086a4c600/0xd9f4181e0d27cc75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27cc7c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945986.219297:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945986.219298:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945986.219300:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945986.219452:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638635904:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790945986.219485:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945986.219618:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638635904 00000100:00100000:1.0:1790945986.219625:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638635904 00000100:00100000:1.0:1790945986.219665:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790945986.219672:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8841fcfb-fb47-4307-92c2-97500c1c82bd+20:3649:x1877942638635904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790945986.219681:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945986.219699:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40814a2c00/0xd9f4181e0d27cc7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd9f4181e0d27cc75 expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945986.219712:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945986.219741:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8841fcfb-fb47-4307-92c2-97500c1c82bd+19:3649:x1877942638635904:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945986.219747:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790945986.219956:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638635904:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790945986.220157:0:15156:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1790945986.220163:0:15156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d4086a4c600/0xd9f4181e0d27cc75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27cc7c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945986.220195:0:15156:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:2.0:1790945986.220199:0:15156:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1790945986.220201:0:15156:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1790945986.220249:0:15156:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1790945986.220254:0:15156:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1790945986.220266:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790945986.220272:0:15156:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:2.0:1790945986.220286:0:15156:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9d40bff0c800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790945986.220292:0:15156:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9d3f81b15800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790945986.220296:0:15156:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9d408ab81000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790945986.220300:0:15156:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9d40bae39800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:2.0:1790945986.220308:0:15156:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9d3f83706800 0fac916e-06af-4e43-ae6d-171b0debcf61 192.168.204.20@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790945986.220312:0:15156:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9d40bfe99800 0cadc7a5-c0ba-4320-984f-d871ffb3a3ef 192.168.204.20@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967523 stale:0 00000020:00080000:2.0:1790945986.220317:0:15156:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff9d40accf4d40) has exports, disconnecting them 00000020:00080000:2.0:1790945986.220321:0:15156:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9d40bff0c800), last request at 1790945984 00000020:00000080:2.0:1790945986.220327:0:15156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27d026 00000100:00080000:2.0:1790945986.220344:0:15156:0:(import.c:65:import_set_state_nolock()) ffff9d40bff0d800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1790945986.220624:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1790945986.220848:0:15156:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d40bff0c800): rc 0 00000020:00000080:2.0:1790945986.220851:0:15156:0:(genops.c:885:class_export_put()) final put ffff9d40bff0c800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1790945986.220898:0:15156:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9d3f81b15800), last request at 1790945984 00000020:00000080:2.0:1790945986.220902:0:15156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27cf00 00000100:00080000:2.0:1790945986.220909:0:15156:0:(import.c:65:import_set_state_nolock()) ffff9d3f81b13000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1790945986.220924:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790945986.220947:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40bff0c800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1790945986.221062:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d40bff0d800 for lustre-MDT0000 00000020:00080000:2.0:1790945986.221163:0:15156:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d3f81b15800): rc 0 00000020:00000080:2.0:1790945986.221204:0:15156:0:(genops.c:885:class_export_put()) final put ffff9d3f81b15800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1790945986.221215:0:15156:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9d408ab81000), last request at 1790945762 00000020:00000080:2.0:1790945986.221219:0:15156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27cdfd 00000100:00080000:2.0:1790945986.221223:0:15156:0:(import.c:65:import_set_state_nolock()) ffff9d408ab85000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1790945986.222093:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f81b15800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00010000:00010000:1.0:1790945986.222181:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1790945986.222426:0:15156:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d408ab81000): rc 0 00000020:00000080:2.0:1790945986.222431:0:15156:0:(genops.c:885:class_export_put()) final put ffff9d408ab81000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1790945986.222459:0:15156:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9d40bae39800), last request at 1790945762 00000020:00000080:2.0:1790945986.222466:0:15156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27cdbe 00000100:00080000:2.0:1790945986.222480:0:15156:0:(import.c:65:import_set_state_nolock()) ffff9d40b4b74000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790945986.222492:0:15156:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000020:00080000:2.0:1790945986.222574:0:15156:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d40bae39800): rc 0 00000004:00000080:2.0:1790945986.222581:0:15156:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb827c0e33ae0 00000100:00080000:2.0:1790945986.222600:0:15156:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1790945986.222604:0:15156:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00010000:00010000:1.0:1790945986.222920:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945986.224307:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790945986.224625:0:15156:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1790945986.224660:0:15156:0:(import.c:65:import_set_state_nolock()) ffff9d40bc9bf800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1790945986.225603:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638636032:0@lo:39:umount.0 00000100:00100000:3.0:1790945986.225681:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945986.225911:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638636032 00000100:00100000:2.0:1790945986.225920:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638636032 00000100:00100000:2.0:1790945986.225992:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1790945986.226001:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f845ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1877942638636032:12345-0@lo:39:umount.0 00000020:00000080:2.0:1790945986.226033:0:6526:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27ce58 00000100:00080000:2.0:1790945986.226042:0:6526:0:(import.c:65:import_set_state_nolock()) ffff9d40ac00b000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790945986.226065:0:6526:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1790945986.226569:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f845ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3646:x1877942638636032:12345-0@lo:39:umount.0 Request processed in 565us (883us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1790945986.226579:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00080000:3.0:1790945986.226713:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40bc9bf800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1790945986.226723:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638636032:0@lo:39:umount.0 00010000:00010000:1.0:1790945986.227112:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790945986.227547:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff9d408ab81000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1790945986.227585:0:1365:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d3f81b13000 for lustre-MDT0000 00000020:00000080:0.0:1790945986.227591:0:1365:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d408ab85000 for lustre-MDT0000 00000100:00080000:2.0:1790945986.227931:0:15156:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1790945986.227936:0:15156:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1790945986.228037:0:15156:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1790945986.228099:0:15156:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1790945986.228123:0:15156:0:(import.c:65:import_set_state_nolock()) ffff9d40bfe9d800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1790945986.228153:0:15156:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1790945986.228156:0:15156:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:2.0:1790945986.228261:0:15156:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1790945986.228445:0:15156:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1790945986.228456:0:15156:0:(import.c:65:import_set_state_nolock()) ffff9d3f8340d800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1790945986.228496:0:15156:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9d40accf4d40) has no exports 00000100:00100000:3.0:1790945986.228624:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638636160:0@lo:9:umount.0 00000100:00100000:3.0:1790945986.228684:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945986.228731:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638636288:0@lo:9:umount.0 00000100:00100000:3.0:1790945986.228761:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945986.228811:0:8436:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638636160 00000100:00100000:3.0:1790945986.228818:0:8436:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638636160 00000100:00100000:3.0:1790945986.228862:0:8436:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638636288 00000100:00100000:3.0:1790945986.228864:0:8436:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638636288 00000100:00100000:3.0:1790945986.228883:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1790945986.228891:0:8436:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f845edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1877942638636160:12345-0@lo:9:umount.0 00000020:00000080:3.0:1790945986.228916:0:8436:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27cfa8 00000100:00080000:3.0:1790945986.228923:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9d40b4b75000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790945986.229081:0:8436:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1790945986.229263:0:8436:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f845edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3646:x1877942638636160:12345-0@lo:9:umount.0 Request processed in 372us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945986.229272:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1790945986.229299:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790945986.229307:0:8436:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f845ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1877942638636288:12345-0@lo:9:umount.0 00000020:00000080:3.0:1790945986.229319:0:8436:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27d0ea 00000100:00080000:3.0:1790945986.229326:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9d40bfe9b000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790945986.229348:0:8436:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1790945986.229423:0:8436:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f845ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3646:x1877942638636288:12345-0@lo:9:umount.0 Request processed in 117us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945986.229428:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1790945986.229634:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790945986.229639:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790945986.229647:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945986.229652:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790945986.229681:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40bfe9d800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1790945986.230659:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1790945986.230665:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790945986.230671:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638636160:0@lo:9:umount.0 00000100:00080000:3.0:1790945986.230719:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d3f8340d800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1790945986.230732:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1790945986.230734:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790945986.230737:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638636288:0@lo:9:umount.0 00000020:00080000:3.0:1790945986.241059:0:15156:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9d40accf4d40) has no exports 00000020:00000080:3.0:1790945986.306041:0:15156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27ccd0 00000020:00000080:3.0:1790945986.306058:0:15156:0:(genops.c:885:class_export_put()) final put ffff9d40bacda000/lustre-QMT0000_UUID 00000020:01000000:3.0:1790945986.306130:0:15156:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1790945986.306478:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790945986.306490:0:15156:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790945986.306495:0:15156:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff9d4084804d40) has no exports 00000020:00000080:0.0:1790945986.306811:0:15156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27ccc9 00000020:00000080:0.0:1790945986.306816:0:15156:0:(genops.c:885:class_export_put()) final put ffff9d4096fa2000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790945986.306868:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40bacda000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1790945986.306974:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d4096fa2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1790945986.307046:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790945986.307054:0:15156:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1790945986.307057:0:15156:0:(genops.c:885:class_export_put()) final put ffff9d4084820000/lustre-QMT0000_UUID 00000020:00000080:0.0:1790945986.307059:0:15156:0:(genops.c:844:class_export_destroy()) destroying export ffff9d4084820000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1790945986.307067:0:15156:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00100000:2.0:1790945986.401116:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790945986.401150:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638636416:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790945986.401241:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945986.401334:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638636416 00000100:00100000:2.0:1790945986.401342:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638636416 00000100:00080000:0.0:1790945986.401537:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790945986.401655:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1790945986.401666:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638636416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790945986.401700:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1790945986.401747:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638636416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945986.401755:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1790945986.401808:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638636416:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1790945986.785010:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790945987.039619:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945987.938501:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638636544:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790945987.938587:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945987.938736:0:12418:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638636544 00000100:00100000:2.0:1790945987.938747:0:12418:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638636544 00000100:00100000:2.0:1790945987.938800:0:12418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1790945987.938809:0:12418:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f845ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3647:x1877942638636544:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1790945987.938820:0:12418:0:(tgt_handler.c:821:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1790945987.938878:0:12418:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f845ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3647:x1877942638636544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (290us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790945987.938886:0:12418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:02020000:0.0:1790945987.939881:0:3647:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000001:00100000:2.0:1790945987.949380:0:9515:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790945987.949391:0:9515:0:(genops.c:885:class_export_put()) final put ffff9d40bfe9c000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1790945987.949412:0:9515:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0cadc7a5-c0ba-4320-984f-d871ffb3a3ef 00000020:00000080:2.0:1790945987.949415:0:9515:0:(genops.c:885:class_export_put()) final put ffff9d40914e7000/0cadc7a5-c0ba-4320-984f-d871ffb3a3ef 00000020:00000080:1.0:1790945987.950019:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40bfe9c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1790945987.950898:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40914e7000/0cadc7a5-c0ba-4320-984f-d871ffb3a3ef for lustre-OST0001 00000020:00000080:1.0:1790945987.950945:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d40bfe9b000 for lustre-OST0001 00000020:00000080:1.0:1790945987.950950:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d40914e7800 for lustre-OST0001 00000001:00100000:3.0:1790945987.951228:0:7452:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1790945987.951237:0:6500:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:3.0:1790945987.951240:0:7452:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:1.0:1790945987.951243:0:6500:0:(genops.c:885:class_export_put()) final put ffff9d40bae39800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1790945987.951245:0:7452:0:(genops.c:885:class_export_put()) final put ffff9d40ac00e800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1790945987.951271:0:6500:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0fac916e-06af-4e43-ae6d-171b0debcf61 00000001:00080000:1.0:1790945987.951279:0:6500:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967529 is committed 00000020:00000080:1.0:1790945987.951283:0:6500:0:(genops.c:885:class_export_put()) final put ffff9d3f83706800/0fac916e-06af-4e43-ae6d-171b0debcf61 00000100:00080000:0.0:1790945987.952307:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1790945987.952315:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9d40bb1a5800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1790945987.952320:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000001:00100000:3.0:1790945987.961213:0:7452:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 0fac916e-06af-4e43-ae6d-171b0debcf61 00000001:00080000:3.0:1790945987.961229:0:7452:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:3.0:1790945987.961234:0:7452:0:(genops.c:885:class_export_put()) final put ffff9d3f83702800/0fac916e-06af-4e43-ae6d-171b0debcf61 00000001:00100000:3.0:1790945987.961244:0:7452:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 0cadc7a5-c0ba-4320-984f-d871ffb3a3ef 00000001:00080000:3.0:1790945987.961247:0:7452:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:3.0:1790945987.961250:0:7452:0:(genops.c:885:class_export_put()) final put ffff9d3f8340e800/0cadc7a5-c0ba-4320-984f-d871ffb3a3ef 00000001:00100000:3.0:1790945987.961336:0:8429:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790945987.961340:0:8429:0:(genops.c:885:class_export_put()) final put ffff9d40b4b74800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1790945987.961350:0:8429:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0cadc7a5-c0ba-4320-984f-d871ffb3a3ef 00000020:00000080:3.0:1790945987.961352:0:8429:0:(genops.c:885:class_export_put()) final put ffff9d40914e0000/0cadc7a5-c0ba-4320-984f-d871ffb3a3ef 00000001:00100000:1.0:1790945987.961918:0:6500:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0cadc7a5-c0ba-4320-984f-d871ffb3a3ef 00000001:00080000:1.0:1790945987.961927:0:6500:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:1.0:1790945987.961934:0:6500:0:(genops.c:885:class_export_put()) final put ffff9d40bfe99800/0cadc7a5-c0ba-4320-984f-d871ffb3a3ef 00000020:00000080:1.0:1790945987.961951:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40bae39800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1790945987.961989:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40ac00e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1790945987.962019:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f83702800/0fac916e-06af-4e43-ae6d-171b0debcf61 for lustre-MDT0001 00000020:00000080:1.0:1790945987.962044:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f8340e800/0cadc7a5-c0ba-4320-984f-d871ffb3a3ef for lustre-MDT0001 00000020:00000080:1.0:1790945987.962060:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40b4b74800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1790945987.962091:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40914e0000/0cadc7a5-c0ba-4320-984f-d871ffb3a3ef for lustre-OST0000 00000020:00000080:1.0:1790945987.962116:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f83706800/0fac916e-06af-4e43-ae6d-171b0debcf61 for lustre-MDT0000 00000020:00000080:1.0:1790945987.962133:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40bfe99800/0cadc7a5-c0ba-4320-984f-d871ffb3a3ef for lustre-MDT0000 00000020:00000080:1.0:1790945987.962158:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d40b4b74000 for lustre-MDT0000 00000020:00000080:1.0:1790945987.962311:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d40ac00b000 for lustre-MDT0001 00000020:00000080:1.0:1790945987.962316:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d3f83707000 for lustre-MDT0001 00000020:00000080:1.0:1790945987.962319:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d40bff08800 for lustre-MDT0001 00000020:00000080:1.0:1790945987.962323:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d40b4b75000 for lustre-OST0000 00000020:00000080:1.0:1790945987.962326:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d40914e0800 for lustre-OST0000 00000020:00000080:1.0:1790945987.962329:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d3f83707800 for lustre-MDT0000 00000020:00000080:1.0:1790945987.962332:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d40bfe98800 for lustre-MDT0000 00000100:00080000:0.0:1790945987.970063:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9d40bb1a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790945987.970578:0:3647:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 213 00000100:00080000:0.0:1790945987.970594:0:3647:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9d40bb1a5800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1790945987.970655:0:3647:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f8265d500 x1877942638636672/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790945987.971222:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638636672:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1790945987.971293:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945987.974518:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638636672 00000100:00100000:2.0:1790945987.974541:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638636672 00000100:00100000:2.0:1790945987.974618:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1790945987.974626:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f845ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1877942638636672:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1790945987.974647:0:6527:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1790945987.986321:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f845ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1877942638636672:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 11686us (15018us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790945987.986338:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00080000:3.0:1790945987.986385:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40bb1a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790945987.986393:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790945987.986419:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638636672:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:3.0:1790945988.067651:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1790945988.319423:0:15156:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9d3f810eeba0 - data ffff9d408f6fa948/ffff9d3f83426800 00000020:01000000:0.0:1790945988.319599:0:15156:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9d40a70dae40 - data ffff9d408f5621b0/ffff9d408ee85800 00000001:00000004:0.0:1790945988.330824:0:15156:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000100:00080000:3.0:1790945988.451600:0:15156:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1790945988.451610:0:15156:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1790945988.451628:0:15156:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9d40b4d01180 x1877942638636032/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1790945996 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945988.451657:0:15156:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1790945988.464496:0:15156:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1790945988.464508:0:15156:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:3.0:1790945988.464584:0:15156:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790945988.464587:0:15156:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1790945988.465863:0:8914:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1790945988.465870:0:8914:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1790945988.465880:0:8914:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1790945988.466960:0:15156:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1790945988.466967:0:15156:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:3.0:1790945988.467758:0:15156:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790945988.467762:0:15156:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1790945988.468431:0:9885:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1790945988.468436:0:9885:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1790945988.468447:0:9885:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1790945988.470849:0:15156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27cc98 00000020:00000080:3.0:1790945988.470862:0:15156:0:(genops.c:885:class_export_put()) final put ffff9d40ac009800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1790945988.471215:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40ac009800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1790945988.476483:0:15156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27ccad 00000020:00000080:3.0:1790945988.476502:0:15156:0:(genops.c:885:class_export_put()) final put ffff9d40ac00a800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1790945988.476524:0:15156:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1790945988.476531:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790945988.476539:0:15156:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790945988.476544:0:15156:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff9d40accf19c0) has no exports 00000004:01000000:3.0:1790945988.476727:0:15156:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1790945988.476820:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40ac00a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1790945988.476923:0:15156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27d0e3 00000020:00000080:3.0:1790945988.477002:0:15156:0:(genops.c:885:class_export_put()) final put ffff9d3f8340d000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1790945988.477050:0:15156:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1790945988.477056:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790945988.477077:0:15156:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1790945988.477080:0:15156:0:(genops.c:1557:class_disconnect_exports()) OBD device 28 (ffff9d3f836cb380) has no exports 00000020:00000080:3.0:1790945988.477088:0:15156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27d0dc 00000020:00000080:3.0:1790945988.477110:0:15156:0:(genops.c:885:class_export_put()) final put ffff9d3f8340c800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1790945988.477845:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f8340d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1790945988.478010:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f8340c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1790945988.479544:0:15156:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1790945988.479552:0:15156:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1790945988.479556:0:15156:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:0.0:1790945988.479563:0:15156:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790945988.479566:0:15156:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790945988.479647:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790945988.479662:0:15156:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790945988.479669:0:15156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27cfa1 00000020:00000080:0.0:1790945988.479676:0:15156:0:(genops.c:885:class_export_put()) final put ffff9d40bfe9b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790945988.479841:0:1365:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d3f8340d800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1790945988.479849:0:1365:0:(genops.c:885:class_export_put()) final put ffff9d3f83409000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790945988.479852:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f83409000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1790945988.479858:0:1365:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1790945988.480554:0:15156:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1790945988.480562:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790945988.480575:0:15156:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790945988.480581:0:15156:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff9d40bfe90000) has no exports 00000020:00000080:0.0:1790945988.480589:0:15156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27cf9a 00000020:00000080:0.0:1790945988.480595:0:15156:0:(genops.c:885:class_export_put()) final put ffff9d40bfe9c800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790945988.480813:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40bfe9b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1790945988.480820:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40bfe9c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1790945988.482598:0:15156:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1790945988.482610:0:15156:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1790945988.482616:0:15156:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:0.0:1790945988.482627:0:15156:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790945988.482630:0:15156:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790945988.482688:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790945988.482702:0:15156:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1790945988.482721:0:15156:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1790945988.482728:0:15156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27ce51 00000020:00000080:1.0:1790945988.483028:0:1365:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d40bfe9d800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1790945988.483041:0:1365:0:(genops.c:885:class_export_put()) final put ffff9d3f81bb2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790945988.483044:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f81bb2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1790945988.483052:0:1365:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790945988.486057:0:15156:0:(genops.c:885:class_export_put()) final put ffff9d40bc916000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1790945988.487844:0:15156:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1790945988.487859:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790945988.487873:0:15156:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790945988.487878:0:15156:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9d40bc9e19c0) has no exports 00000020:00000080:0.0:1790945988.487899:0:15156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27ce4a 00000020:00000080:0.0:1790945988.487906:0:15156:0:(genops.c:885:class_export_put()) final put ffff9d40b4b73000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790945988.492344:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40bc916000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1790945988.492367:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40b4b73000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1790945988.494293:0:15156:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1790945988.494301:0:15156:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1790945988.494306:0:15156:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1790945988.494327:0:15156:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790945988.494393:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790945988.494421:0:15156:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790945988.494481:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790945988.494486:0:15156:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790945988.494492:0:15156:0:(genops.c:885:class_export_put()) final put ffff9d4099037800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790945988.494497:0:15156:0:(genops.c:844:class_export_destroy()) destroying export ffff9d4099037800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1790945988.494504:0:15156:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790945988.494613:0:15156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27ccb4 00000020:00000080:1.0:1790945988.494621:0:15156:0:(genops.c:885:class_export_put()) final put ffff9d40ac008000/lustre-MDD0000_UUID 00000020:01000000:1.0:1790945988.494626:0:15156:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1790945988.494631:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790945988.494636:0:15156:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1790945988.494640:0:15156:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff9d40accf0000) has no exports 00000020:00000080:1.0:1790945988.494662:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790945988.494665:0:15156:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1790945988.494669:0:15156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27ccbb 00000020:00000080:1.0:1790945988.494673:0:15156:0:(genops.c:885:class_export_put()) final put ffff9d40ac008800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1790945988.494681:0:15156:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d4087223000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1790945988.494684:0:15156:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d4087223000 3 00000020:01000004:1.0:1790945988.494687:0:15156:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9d4087223000 from lustre-MDT0000 00000020:00000080:1.0:1790945988.494706:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790945988.494709:0:15156:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1790945988.494712:0:15156:0:(genops.c:885:class_export_put()) final put ffff9d40ac00c000/lustre-MDT0000_UUID 00000020:00000080:1.0:1790945988.494714:0:15156:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40ac00c000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1790945988.494720:0:15156:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1790945988.494766:0:15156:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1790945988.494771:0:15156:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1790945988.494773:0:15156:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1790945988.494776:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790945988.494779:0:15156:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1790945988.494786:0:15156:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff9d4087221000 8841fcfb-fb47-4307-92c2-97500c1c82bd 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790945988.494791:0:15156:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff9d40a763cd40) has exports, disconnecting them 00000020:00080000:1.0:1790945988.494795:0:15156:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9d4087221000), last request at 1790945743 00000020:00000080:1.0:1790945988.494810:0:15156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27cc52 00000020:00010000:1.0:1790945988.494820:0:15156:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9d4087221000: total 2 00000100:00080000:1.0:1790945988.494823:0:15156:0:(import.c:65:import_set_state_nolock()) ffff9d4087223800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1790945988.494835:0:15156:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d4087221000): rc 0 00000020:00080000:1.0:1790945988.494840:0:15156:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff9d40a763cd40) has no exports 00000100:00100000:1.0:1790945988.494906:0:6516:0:(service.c:3206:ptlrpc_main()) ll_mgs_0002: service thread [ffff9d4086a4ee00:6516] 2 exiting: rc = 0 00000020:00010000:3.0:1790945988.495753:0:6510:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9d4087221000: total 2 00010000:00010000:3.0:1790945988.495816:0:6510:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9d4087221000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1790945988.495858:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3f8363de00/0xd9f4181e0d27d3fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd9f4181e0d27d3f3 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945988.495881:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40baef0200/0xd9f4181e0d27d1a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd9f4181e0d27d199 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945988.495894:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40813ff600/0xd9f4181e0d27cd55 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd9f4181e0d27cd4e expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945988.495912:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40c21d6400/0xd9f4181e0d27d1ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd9f4181e0d27d1a7 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945988.495935:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d4086a4d400/0xd9f4181e0d27cd63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd9f4181e0d27cd5c expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945988.495950:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40bcbe1000/0xd9f4181e0d27d408 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd9f4181e0d27d401 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945988.495959:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40c21d6600/0xd9f4181e0d27d416 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd9f4181e0d27d40f expref: 8 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945988.495972:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40baef1800/0xd9f4181e0d27d176 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd9f4181e0d27d16f expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945988.495984:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d4086a4d800/0xd9f4181e0d27d1d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd9f4181e0d27d1d1 expref: 6 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945988.495994:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40baef1e00/0xd9f4181e0d27d168 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd9f4181e0d27d161 expref: 5 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945988.496026:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40813fe400/0xd9f4181e0d27d07a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd9f4181e0d27d073 expref: 4 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945988.496039:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d4086a4c800/0xd9f4181e0d27d184 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd9f4181e0d27d17d expref: 3 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945988.496049:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40c21d7600/0xd9f4181e0d27d192 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd9f4181e0d27d18b expref: 2 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945988.496062:0:6510:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9d4087221000, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1790945988.496077:0:6510:0:(genops.c:885:class_export_put()) final put ffff9d4087221000/8841fcfb-fb47-4307-92c2-97500c1c82bd 00010000:00010000:3.0:1790945988.496088:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945988.496090:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945988.496102:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945988.496144:0:6515:0:(service.c:3206:ptlrpc_main()) ll_mgs_0001: service thread [ffff9d4086a4e400:6515] 1 exiting: rc = 0 00000020:00000080:3.0:1790945988.496246:0:1365:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d40bc9bf800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1790945988.496254:0:1365:0:(genops.c:885:class_export_put()) final put ffff9d40a71d2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790945988.496257:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40a71d2800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1790945988.496262:0:1365:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790945988.496308:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40ac008000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1790945988.496312:0:1365:0:(genops.c:885:class_export_put()) final put ffff9d40ac00a000/lustre-MDD0000_UUID 00000020:00000080:3.0:1790945988.496327:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40ac00a000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1790945988.496332:0:1365:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1790945988.496360:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40ac008800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1790945988.496365:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff9d4087221000/8841fcfb-fb47-4307-92c2-97500c1c82bd for MGS 00000020:00000080:3.0:1790945988.496398:0:1365:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d4087223800 for MGS 00000100:00100000:1.0:1790945988.497466:0:6514:0:(service.c:3206:ptlrpc_main()) ll_mgs_0000: service thread [ffff9d4099de3400:6514] 0 exiting: rc = 1 00000100:00100000:3.0:1790945988.497797:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.497807:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.497828:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.497835:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.497840:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.497846:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.497852:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.497858:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.497864:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.497870:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.497876:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.497882:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.497889:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.497896:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.497901:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.497907:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.497922:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498112:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498120:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498125:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498137:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498143:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498150:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498155:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498161:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498258:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498266:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498272:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498277:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498283:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498288:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498294:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498299:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498304:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498309:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498477:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498487:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498502:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498508:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498513:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498518:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498524:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498529:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498534:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498539:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498545:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498550:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498557:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498563:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498568:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498574:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498579:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498585:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498591:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498596:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498602:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498607:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498612:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498618:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498623:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498628:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498633:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498638:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945988.498644:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1790945988.502812:0:15156:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9d3f831e1000 - data ffff9d3f81d15798/ffff9d4096cfb400 00000020:01000000:3.0:1790945988.502989:0:15156:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9d40836bef60 - data ffff9d408f496e58/ffff9d40832bb800 00000020:00000080:3.0:1790945988.503955:0:15156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27cc3d 00000020:00000080:3.0:1790945988.503969:0:15156:0:(genops.c:885:class_export_put()) final put ffff9d4085505000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1790945988.503994:0:15156:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d4087223000 from MGS, refs=2 00000020:01000004:3.0:1790945988.503999:0:15156:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d4087223000 2 00000020:01000004:3.0:1790945988.504003:0:15156:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9d4087223000 from MGS 00000020:00000080:3.0:1790945988.504051:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790945988.504060:0:15156:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1790945988.504063:0:15156:0:(genops.c:885:class_export_put()) final put ffff9d4096fa1000/MGS 00000020:00000080:3.0:1790945988.504067:0:15156:0:(genops.c:844:class_export_destroy()) destroying export ffff9d4096fa1000/MGS for MGS 00000020:01000000:3.0:1790945988.504073:0:15156:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1790945988.504163:0:15156:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1790945988.504266:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d4085505000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1790945988.504393:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790945988.504402:0:15156:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1790945988.504488:0:15156:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9d40bae3f000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790945988.504495:0:15156:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff9d40a7638000) has exports, disconnecting them 00000020:00080000:3.0:1790945988.504500:0:15156:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9d40bae3f000), last request at 1790945743 00000020:00000080:3.0:1790945988.504505:0:15156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27cd08 00000020:00080000:3.0:1790945988.504517:0:15156:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d40bae3f000): rc 0 00000020:00000080:3.0:1790945988.504523:0:15156:0:(genops.c:885:class_export_put()) final put ffff9d40bae3f000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1790945988.504875:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40bae3f000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1790945988.568628:0:15156:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1790945988.568638:0:15156:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790945988.568649:0:15156:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1790945988.568657:0:15156:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790945988.568688:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d40bae3b800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1790945988.568868:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790945988.568877:0:15156:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1790945988.568882:0:15156:0:(genops.c:885:class_export_put()) final put ffff9d40bae3c800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1790945988.568886:0:15156:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40bae3c800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1790945988.568898:0:15156:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1790945988.568979:0:15156:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d4087223000 1 00000020:00000080:1.0:1790945988.568989:0:15156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27cc2f 00000020:00000080:1.0:1790945988.568996:0:15156:0:(genops.c:885:class_export_put()) final put ffff9d4096fa3000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1790945988.569004:0:15156:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1790945988.569011:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d4096fa3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1790945988.569021:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790945988.569025:0:15156:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790945988.569029:0:15156:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff9d40a76399c0) has no exports 00000020:00000080:1.0:1790945988.707708:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790945988.707722:0:15156:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1790945988.707729:0:15156:0:(genops.c:885:class_export_put()) final put ffff9d4096fa7800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790945988.707734:0:15156:0:(genops.c:844:class_export_destroy()) destroying export ffff9d4096fa7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1790945988.707749:0:15156:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1790945988.707870:0:15156:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9d4096fa4800 00000020:02000400:1.0:1790945988.707935:0:15156:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1790945989.087490:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790945989.471524:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790945989.471531:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790945989.471534:0:36:0:(import.c:65:import_set_state_nolock()) ffff9d40bb1a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790945989.471542:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 438 00000100:00080000:2.0:1790945989.471548:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790945989.471561:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9d40bb1a5800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1790945989.471584:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d40b4d00700 x1877942638636928/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790945989.471667:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638636928:0@lo:38:kworker.0 00000100:00100000:2.0:1790945989.471736:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945989.471802:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638637056:0@lo:400:kworker.0 00000100:00100000:2.0:1790945989.471834:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945989.471860:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1877942638637568:0@lo:400:kworker.0 00000100:00100000:1.0:1790945989.471966:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1877942638637312:0@lo:400:kworker.0 00000100:00100000:1.0:1790945989.471999:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945989.472025:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638637824:0@lo:400:kworker.0 00000100:00100000:1.0:1790945989.472048:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945989.472070:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790945989.472087:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638636800:0@lo:400:kworker.0 00000400:00000100:1.0:1790945989.472107:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877942638636800 offset 0 length 224: 4 00000100:00100000:1.0:1790945989.472124:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638637440:0@lo:400:kworker.0 00000100:00100000:1.0:1790945989.472144:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945989.472215:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638637056 00000100:00100000:1.0:1790945989.472222:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638637056 00000100:00100000:1.0:1790945989.472255:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638637312 00000100:00100000:1.0:1790945989.472259:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638637312 00000100:00100000:1.0:1790945989.472293:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1790945989.472303:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1877942638637312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945989.472354:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1877942638637312:12345-0@lo:400:kworker.0 Request processed in 53us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945989.472362:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1790945989.472378:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1790945989.472382:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40baceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1877942638637056:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1790945989.472388:0:6523:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1790945989.472414:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40baceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1877942638637056:12345-0@lo:400:kworker.0 Request processed in 30us (579us total) trans 0 rc -107/-107 00000100:00100000:1.0:1790945989.472432:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1790945989.472453:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638637824 00000100:00100000:1.0:1790945989.472457:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638637824 00000100:00100000:1.0:1790945989.472487:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638637440 00000100:00100000:1.0:1790945989.472490:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638637440 00000100:00100000:1.0:1790945989.472512:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1790945989.472519:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638637824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945989.472550:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638637824:12345-0@lo:400:kworker.0 Request processed in 32us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945989.472556:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1790945989.472568:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1790945989.472573:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638637440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945989.472600:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638637440:12345-0@lo:400:kworker.0 Request processed in 27us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945989.472606:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:1.0:1790945989.472653:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790945989.472657:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790945989.472659:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790945989.472692:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638637440:0@lo:400:kworker.0 00010000:00080000:1.0:1790945989.472702:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9d40b4d02a00 x1877942638637312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945989.472711:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1877942638637312:0@lo:400:kworker.0 00000100:00100000:1.0:1790945989.472720:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638637824:0@lo:400:kworker.0 00000100:00100000:1.0:1790945989.472736:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790945989.472743:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638637952:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790945989.472776:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945989.472806:0:11925:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638637952 00000100:00100000:1.0:1790945989.472809:0:11925:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638637952 00000100:00100000:1.0:1790945989.472834:0:11925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1790945989.472840:0:11925:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638637952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790945989.472862:0:11925:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790945989.472910:0:11925:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638637952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945989.472915:0:11925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1790945989.472945:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638637952:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790945989.473234:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638636928 00000100:00100000:0.0:1790945989.473239:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638636928 00000100:00100000:0.0:1790945989.473266:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1790945989.473272:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1877942638636928:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1790945989.473289:0:6526:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1790945989.473327:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1877942638636928:12345-0@lo:38:kworker.0 Request processed in 54us (1590us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790945989.473333:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1790945989.473353:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1877942638637184:0@lo:400:kworker.0 00000100:00100000:0.0:1790945989.473380:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945989.473414:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1877942638637696:0@lo:400:kworker.0 00000100:00100000:0.0:1790945989.473437:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945989.473474:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638637184 00000100:00100000:0.0:1790945989.473477:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638637184 00000100:00100000:0.0:1790945989.473494:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638637696 00000100:00100000:0.0:1790945989.473497:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638637696 00000100:00100000:0.0:1790945989.473521:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1790945989.473529:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877942638637696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945989.473566:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877942638637696:12345-0@lo:400:kworker.0 Request processed in 39us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945989.473572:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1790945989.473585:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1790945989.473589:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3650:x1877942638637184:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1790945989.473594:0:13005:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1790945989.473617:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3650:x1877942638637184:12345-0@lo:400:kworker.0 Request processed in 26us (236us total) trans 0 rc -107/-107 00000100:00100000:0.0:1790945989.473632:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00080000:0.0:1790945989.473660:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1790945989.473665:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d3f8224a800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1790945989.473669:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1790945989.473850:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790945989.473898:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1790945989.473902:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9d40871fe000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1790945989.473905:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1790945989.473910:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9d40871fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790945989.473922:0:3649:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 213 00000100:00080000:2.0:1790945989.473931:0:3649:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9d40871fe000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1790945989.473956:0:3649:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d40baced880 x1877942638638080/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790945989.473970:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638637056:0@lo:400:kworker.0 00000100:00100000:2.0:1790945989.473991:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638637568 00000100:00100000:2.0:1790945989.473994:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638637568 00000100:00100000:2.0:1790945989.474010:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1790945989.474015:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bacec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1877942638637568:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1790945989.474019:0:8457:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1790945989.474047:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bacec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1877942638637568:12345-0@lo:400:kworker.0 Request processed in 31us (197us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790945989.474053:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:2.0:1790945989.474087:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1790945989.474091:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9d3f832dc800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1790945989.474093:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1790945989.474096:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9d3f832dc800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790945989.474099:0:3649:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 254 00000100:00080000:2.0:1790945989.474104:0:3649:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9d3f832dc800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1790945989.474116:0:3649:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d40baceca80 x1877942638638208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790945989.474127:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1877942638637568:0@lo:400:kworker.0 00000100:00080000:1.0:1790945989.475845:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790945989.480881:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40baced880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1877942638638080:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1790945989.480960:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945989.481000:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40baceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1877942638638208:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1790945989.481022:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790945989.481066:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40bb1a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790945989.481080:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790945989.481084:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638636928:0@lo:38:kworker.0 00000100:00100000:1.0:1790945989.481129:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638638080 00000100:00100000:1.0:1790945989.481136:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638638080 00000100:00100000:1.0:1790945989.481188:0:13005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638638208 00000100:00100000:1.0:1790945989.481191:0:13005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638638208 00000100:00100000:1.0:1790945989.481209:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1790945989.481216:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3646:x1877942638638080:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1790945989.481237:0:13005:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1790945989.481294:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3646:x1877942638638080:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 77us (333us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790945989.481301:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1790945989.481319:0:13005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1790945989.481322:0:13005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3646:x1877942638638208:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1790945989.481331:0:13005:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1790945989.481350:0:13005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3646:x1877942638638208:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 26us (327us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790945989.481354:0:13005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:1.0:1790945989.481381:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40871fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790945989.481385:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790945989.481388:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40baced880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1877942638638080:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1790945989.481476:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d3f832dc800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790945989.481481:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790945989.481484:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40baceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1877942638638208:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:0.0:1790945989.509417:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d3f8224a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790945989.509428:0:3650:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 233 00000100:00080000:0.0:1790945989.509443:0:3650:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9d3f8224a800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1790945989.509521:0:3650:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f8265c380 x1877942638638336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790945989.509548:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1877942638637184:0@lo:400:kworker.0 00000100:00100000:0.0:1790945989.509564:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1877942638638336:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1790945989.509629:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945989.509690:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638638336 00000100:00100000:0.0:1790945989.509697:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638638336 00010000:00080000:2.0:1790945989.510280:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9d40b4d03b80 x1877942638637696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945989.510306:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1877942638637696:0@lo:400:kworker.0 00000100:00100000:0.0:1790945989.510465:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1790945989.510473:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1877942638638336:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:0.0:1790945989.510492:0:6523:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1790945989.510545:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1877942638638336:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 72us (915us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790945989.510552:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:0.0:1790945989.510585:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d3f8224a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790945989.510590:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790945989.510593:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1877942638638336:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:3.0:1790945990.111852:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945991.138528:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945991.520424:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790945991.520449:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638638464:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790945991.520536:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945991.520871:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638638464 00000100:00100000:2.0:1790945991.520881:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638638464 00000100:00100000:2.0:1790945991.520964:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1790945991.520975:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638638464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790945991.521096:0:8439:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1790945991.521160:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638638464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 188us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945991.521189:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1790945991.521235:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638638464:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1790945991.521312:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790945992.160503:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790945992.880844:0:15357:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1790945992.906260:0:15357:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1790945992.906325:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef1600/0xd9f4181e0d27d199 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d1a0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945992.906340:0:15357:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef1600/0xd9f4181e0d27d199 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d1a0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945992.906347:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef1600/0xd9f4181e0d27d199 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27d1a0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945992.906354:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9d40baef1600/0xd9f4181e0d27d199 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27d1a0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945992.906370:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790945992.906376:0:15357:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1790945992.906401:0:15357:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790945992.906418:0:15357:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1790945992.906423:0:15357:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790945992.906429:0:15357:0:(import.c:65:import_set_state_nolock()) ffff9d40871fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1790945992.906434:0:15357:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790945992.906435:0:15357:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1790945992.906438:0:15357:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1790945992.907226:0:10339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790945992.907235:0:10339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40baef1600/0xd9f4181e0d27d199 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27d1a0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945992.907244:0:10339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef1600 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:3.0:1790945992.907249:0:10339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40baef1600/0xd9f4181e0d27d199 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27d1a0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945992.907259:0:10339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40baef1600/0xd9f4181e0d27d199 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xd9f4181e0d27d1a0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790945992.907267:0:10339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40baef1600/0xd9f4181e0d27d199 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xd9f4181e0d27d1a0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790945992.907272:0:10339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790945992.907283:0:10339:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1790945992.907285:0:10339:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1790945992.907324:0:10339:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40baef1600/0xd9f4181e0d27d199 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27d1a0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945992.907330:0:10339:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790945992.907354:0:10339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40baef1600/0xd9f4181e0d27d199 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27d1a0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945992.907362:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40baef1600/0xd9f4181e0d27d199 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27d1a0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945992.907375:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945992.907377:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945992.907378:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945992.907395:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638638592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790945992.907461:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790945992.908514:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4080031e00/0xd9f4181e0d27d1a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d1ae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945992.908529:0:15357:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4080031e00/0xd9f4181e0d27d1a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d1ae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945992.908537:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4080031e00/0xd9f4181e0d27d1a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27d1ae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945992.908545:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9d4080031e00/0xd9f4181e0d27d1a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27d1ae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945992.908558:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790945992.908562:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40813ffa00/0xd9f4181e0d27d073 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d07a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945992.908569:0:15357:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40813ffa00/0xd9f4181e0d27d073 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d07a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945992.908576:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40813ffa00/0xd9f4181e0d27d073 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27d07a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945992.908583:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9d40813ffa00/0xd9f4181e0d27d073 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27d07a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945992.908609:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790945992.908616:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7c00/0xd9f4181e0d27d40f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d416 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945992.908623:0:15357:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7c00/0xd9f4181e0d27d40f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d416 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945992.908630:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7c00/0xd9f4181e0d27d40f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27d416 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945992.908636:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7c00/0xd9f4181e0d27d40f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27d416 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945992.908646:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1790945992.908651:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7a00/0xd9f4181e0d27cd5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27cd63 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945992.908658:0:15357:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7a00/0xd9f4181e0d27cd5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27cd63 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945992.908664:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7a00/0xd9f4181e0d27cd5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27cd63 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945992.908669:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7a00/0xd9f4181e0d27cd5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27cd63 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945992.908676:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1790945992.908679:0:15357:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1790945992.908707:0:15357:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1790945992.908711:0:15357:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1790945992.908715:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790945992.908720:0:15357:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1790945992.908726:0:15357:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff9d3f832da800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790945992.908732:0:15357:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff9d3f81bb4000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790945992.908737:0:15357:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff9d40af68b380) has exports, disconnecting them 00000020:00080000:2.0:1790945992.908741:0:15357:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9d3f832da800), last request at 1790945989 00000020:00000080:2.0:1790945992.908748:0:15357:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27d03b 00000100:00080000:2.0:1790945992.908762:0:15357:0:(import.c:65:import_set_state_nolock()) ffff9d3f832db800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1790945992.908798:0:15357:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d3f832da800): rc 0 00000020:00000080:2.0:1790945992.908801:0:15357:0:(genops.c:885:class_export_put()) final put ffff9d3f832da800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1790945992.908813:0:15357:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9d3f81bb4000), last request at 1790945989 00000020:00000080:2.0:1790945992.908816:0:15357:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27cf15 00000100:00080000:2.0:1790945992.908821:0:15357:0:(import.c:65:import_set_state_nolock()) ffff9d3f81bb5800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1790945992.908826:0:15357:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d3f81bb4000): rc 0 00000020:00000080:2.0:1790945992.908828:0:15357:0:(genops.c:885:class_export_put()) final put ffff9d3f81bb4000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1790945992.908835:0:15357:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb827c0d87ae0 00000100:00080000:2.0:1790945992.908851:0:15357:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790945992.908859:0:15357:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9d3f8265ca80 x1877942638636544/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1790946003 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945992.908873:0:15357:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00100000:0.0:1790945992.909436:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638638592 00000100:00100000:0.0:1790945992.909498:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638638592 00000100:00100000:0.0:1790945992.909542:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790945992.909550:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84415f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3650:x1877942638638592:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1790945992.909556:0:6507:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790945992 with bad export cookie 15705204317896559698 00000020:00000080:1.0:1790945992.909601:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f832da800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1790945992.909641:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f81bb4000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1790945992.909659:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d3f832db800 for lustre-MDT0001 00000020:00000080:1.0:1790945992.909663:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d3f81bb5800 for lustre-MDT0001 00010000:00010000:3.0:1790945992.910182:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1790945992.910191:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d4080031e00/0xd9f4181e0d27d1a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27d1ae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945992.910200:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080031e00 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:3.0:1790945992.910204:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d4080031e00/0xd9f4181e0d27d1a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27d1ae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945992.910215:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d4080031e00/0xd9f4181e0d27d1a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xd9f4181e0d27d1ae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790945992.910222:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d4080031e00/0xd9f4181e0d27d1a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xd9f4181e0d27d1ae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790945992.910244:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790945992.910247:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:3.0:1790945992.910250:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:3.0:1790945992.910281:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d4080031e00/0xd9f4181e0d27d1a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27d1ae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945992.910288:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790945992.910305:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d4080031e00/0xd9f4181e0d27d1a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27d1ae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945992.910312:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d4080031e00/0xd9f4181e0d27d1a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27d1ae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945992.910326:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1790945992.910330:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40813ffa00/0xd9f4181e0d27d073 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27d07a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945992.910336:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40813ffa00 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:3.0:1790945992.910338:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40813ffa00/0xd9f4181e0d27d073 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27d07a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945992.910344:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40813ffa00/0xd9f4181e0d27d073 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd9f4181e0d27d07a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790945992.910349:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40813ffa00/0xd9f4181e0d27d073 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd9f4181e0d27d07a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790945992.910354:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1790945992.910356:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1790945992.910358:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1790945992.910377:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40813ffa00/0xd9f4181e0d27d073 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27d07a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945992.910383:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790945992.910389:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40813ffa00/0xd9f4181e0d27d073 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27d07a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945992.910395:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40813ffa00/0xd9f4181e0d27d073 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27d07a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945992.910407:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790945992.910410:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7c00/0xd9f4181e0d27d40f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27d416 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945992.910416:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d7c00 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:3.0:1790945992.910420:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7c00/0xd9f4181e0d27d40f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27d416 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945992.910426:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7c00/0xd9f4181e0d27d40f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd9f4181e0d27d416 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790945992.910432:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7c00/0xd9f4181e0d27d40f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd9f4181e0d27d416 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790945992.910437:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1790945992.910439:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1790945992.910440:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1790945992.910452:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7c00/0xd9f4181e0d27d40f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27d416 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945992.910458:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790945992.910470:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7c00/0xd9f4181e0d27d40f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27d416 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945992.910482:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7c00/0xd9f4181e0d27d40f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27d416 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945992.910492:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790945992.910495:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7a00/0xd9f4181e0d27cd5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27cd63 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945992.910501:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d7a00 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:3.0:1790945992.910504:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7a00/0xd9f4181e0d27cd5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27cd63 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945992.910511:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7a00/0xd9f4181e0d27cd5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd9f4181e0d27cd63 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790945992.910518:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7a00/0xd9f4181e0d27cd5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd9f4181e0d27cd63 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790945992.910523:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1790945992.910525:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1790945992.910527:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1790945992.910540:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7a00/0xd9f4181e0d27cd5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27cd63 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945992.910545:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790945992.910552:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7a00/0xd9f4181e0d27cd5c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27cd63 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945992.910558:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7a00/0xd9f4181e0d27cd5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27cd63 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945992.910579:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945992.910581:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945992.910583:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945992.910589:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945992.910603:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638638976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790945992.910668:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945992.910711:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790945992.910717:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84415880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638639104:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790945992.910738:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945992.910770:0:7471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638638976 00000100:00100000:3.0:1790945992.910775:0:7471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638638976 00000100:00100000:3.0:1790945992.910802:0:7471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638639104 00000100:00100000:3.0:1790945992.910806:0:7471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638639104 00000100:00100000:3.0:1790945992.910819:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790945992.910824:0:7471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4096cb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3649:x1877942638638976:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1790945992.910844:0:7471:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790945992 with bad export cookie 15705204317896559698 00000100:00100000:1.0:1790945992.912101:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84417b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8841fcfb-fb47-4307-92c2-97500c1c82bd:3648:1877942638638848:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790945992.912149:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945992.912204:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790945992.912211:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84414a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8841fcfb-fb47-4307-92c2-97500c1c82bd:3648:1877942638638720:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790945992.912232:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790945992.912265:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945992.912275:0:6508:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1790945992.912282:0:6508:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:1.0:1790945992.912378:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638638848 00000100:00100000:1.0:1790945992.912384:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638638848 00000100:00100000:1.0:1790945992.912407:0:6508:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1790945992.912413:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638638720 00000100:00100000:1.0:1790945992.912415:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638638720 00000100:00100000:1.0:1790945992.912497:0:15358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790945992.912503:0:15358:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84416a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3649:x1877942638639104:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1790945992.912508:0:15358:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790945992 with bad export cookie 15705204317896559698 00000100:00100000:1.0:1790945992.912544:0:15358:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84416a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3649:x1877942638639104:12345-0@lo:103:ldlm_bl.0 Request processed in 40us (1805us total) trans 0 rc -107/-107 00000100:00100000:1.0:1790945992.912551:0:15358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790945992.912568:0:15358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790945992.912572:0:15358:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3648:x1877942638638848:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1790945992.912577:0:15358:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790945992 with bad export cookie 15705204317896559698 00000100:00100000:1.0:1790945992.912605:0:15358:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3648:x1877942638638848:12345-0@lo:103:ldlm_bl.0 Request processed in 31us (455us total) trans 0 rc -107/-107 00000100:00100000:1.0:1790945992.912611:0:15358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1790945992.912638:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.120@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1790945992.912643:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9d4087227800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1790945992.912647:0:3648:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.120@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:3.0:1790945992.915052:0:7471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4096cb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3649:x1877942638638976:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (218us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790945992.915074:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790945992.915111:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790945992.915118:0:7471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3648:x1877942638638720:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1790945992.915124:0:7471:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790945992 with bad export cookie 15705204317896559698 00000100:00100000:3.0:1790945992.919657:0:7471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3648:x1877942638638720:12345-0@lo:103:ldlm_bl.0 Request processed in 4528us (7413us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790945992.919672:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1790945992.919741:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.120@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:2.0:1790945992.920597:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638636544:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1790945992.920637:0:15357:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790945992.920643:0:15357:0:(import.c:65:import_set_state_nolock()) ffff9d40bb1a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1790945992.925400:0:15357:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1790945992.925408:0:15357:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:2.0:1790945992.925437:0:15357:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1790945992.925508:0:15357:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1790945992.925540:0:15357:0:(import.c:65:import_set_state_nolock()) ffff9d40bc913000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1790945992.925557:0:15357:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1790945992.925559:0:15357:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:2.0:1790945992.925572:0:15357:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1790945992.925628:0:15357:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1790945992.925636:0:15357:0:(import.c:65:import_set_state_nolock()) ffff9d3f8340b000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1790945992.925659:0:15357:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9d40af68b380) has no exports 00000100:00080000:1.0:1790945992.943955:0:3648:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.120@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1790945992.943961:0:3648:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1790945992.943970:0:3648:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d40b4d01500 x1877942638636800/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790946005 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945992.943998:0:3648:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d3f84417480 x1877942638638592/t0(0) o103->MGC192.168.204.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790946008 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945992.944042:0:3648:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d3f84415c00 x1877942638638976/t0(0) o103->MGC192.168.204.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790946008 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945992.944061:0:3648:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d3f84415880 x1877942638639104/t0(0) o103->MGC192.168.204.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790946008 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945992.944075:0:3648:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d3f84417b80 x1877942638638848/t0(0) o103->MGC192.168.204.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790946008 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945992.944079:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8841fcfb-fb47-4307-92c2-97500c1c82bd:3647:1877942638636800:0@lo:400:kworker.0 00000100:00100000:1.0:1790945992.944083:0:3648:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d3f84414a80 x1877942638638720/t0(0) o103->MGC192.168.204.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790946008 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790945992.944111:0:3649:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9d4087227800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1790945992.944164:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8841fcfb-fb47-4307-92c2-97500c1c82bd:3650:1877942638638592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790945992.944272:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638638976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790945992.944283:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84415880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8841fcfb-fb47-4307-92c2-97500c1c82bd:3649:1877942638639104:0@lo:103:ldlm_bl.0 10000000:01000000:1.0:1790945992.945444:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1790945992.945450:0:3648:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1790945992.945451:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1790945992.945455:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9d4087227800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790945992.945461:0:3648:0:(import.c:545:import_select_connection()) MGC192.168.204.120@tcp: connect to NID 0@lo last attempt 194 00000100:00080000:1.0:1790945992.945475:0:3648:0:(import.c:666:import_select_connection()) MGC192.168.204.120@tcp: import ffff9d4087227800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1790945992.945904:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638639232:0@lo:9:umount.0 00000100:00100000:1.0:1790945992.945968:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945992.946025:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638639360:0@lo:9:umount.0 00000100:00100000:1.0:1790945992.946044:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945992.946248:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638639232 00000100:00100000:1.0:1790945992.946256:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638639232 00000100:00100000:1.0:1790945992.946292:0:8437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638639360 00000100:00100000:1.0:1790945992.946295:0:8437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638639360 00000100:00100000:1.0:1790945992.946318:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1790945992.946385:0:8437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1877942638639232:12345-0@lo:9:umount.0 00000020:00000080:1.0:1790945992.946411:0:8437:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27cf62 00000100:00080000:1.0:1790945992.946418:0:8437:0:(import.c:65:import_set_state_nolock()) ffff9d3f81b14000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790945992.946456:0:8437:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1790945992.947548:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1790945992.947564:0:8435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1877942638639360:12345-0@lo:9:umount.0 00000020:00000080:3.0:1790945992.947587:0:8435:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27d0a4 00000100:00080000:3.0:1790945992.947595:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9d40bff0d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790945992.947637:0:8435:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00010000:00010000:2.0:1790945992.947758:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945992.948228:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945992.952431:0:8437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3646:x1877942638639232:12345-0@lo:9:umount.0 Request processed in 6094us (6450us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945992.952448:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1790945992.952466:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40bc913000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1790945992.952487:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1790945992.952489:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790945992.952494:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638639232:0@lo:9:umount.0 00000100:00100000:3.0:1790945992.952553:0:3648:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f84417480 x1877942638639488/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790945992.952598:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84414a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8841fcfb-fb47-4307-92c2-97500c1c82bd:3648:1877942638638720:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790945992.952605:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84417b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8841fcfb-fb47-4307-92c2-97500c1c82bd:3648:1877942638638848:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790945992.952967:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8841fcfb-fb47-4307-92c2-97500c1c82bd:3646:1877942638639488:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:1.0:1790945992.953021:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877942638639488 offset 0 length 520: 4 00000100:00100000:2.0:1790945992.953150:0:8435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3646:x1877942638639360:12345-0@lo:9:umount.0 Request processed in 5591us (7103us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945992.953160:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1790945992.953650:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d3f8340b000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1790945992.953672:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1790945992.953675:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790945992.953678:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638639360:0@lo:9:umount.0 00000100:00080000:1.0:1790945992.954294:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000400:00000100:0.0:1790945992.957832:0:6507:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1877942638638592 offset 224 length 224: 4 00000100:00100000:0.0:1790945992.957862:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84415f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3650:x1877942638638592:12345-0@lo:103:ldlm_bl.0 Request processed in 48310us (50399us total) trans 0 rc -107/-107 00000100:00100000:0.0:1790945992.957876:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000020:00080000:2.0:1790945992.966415:0:15357:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9d40af68b380) has no exports 00000020:01000000:3.0:1790945993.044100:0:15357:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9d40baf48360 - data ffff9d3f81d16360/ffff9d3f836c3800 00000020:01000000:3.0:1790945993.044387:0:15357:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9d40baf489c0 - data ffff9d408f568360/ffff9d40b4955800 00000001:00000004:3.0:1790945993.069602:0:15357:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:1.0:1790945993.134066:0:15357:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790945993.134076:0:15357:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1790945993.134083:0:15357:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1790945993.136421:0:15357:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1790945993.136428:0:15357:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:1.0:1790945993.136484:0:15357:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790945993.136488:0:15357:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1790945993.136908:0:8910:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1790945993.136914:0:8910:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:3.0:1790945993.136925:0:8910:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1790945993.137934:0:15357:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1790945993.137940:0:15357:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:1.0:1790945993.138075:0:15357:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790945993.138078:0:15357:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1790945993.138472:0:9880:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1790945993.138479:0:9880:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:3.0:1790945993.138498:0:9880:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1790945993.140426:0:15357:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27cd7f 00000020:00000080:1.0:1790945993.140438:0:15357:0:(genops.c:885:class_export_put()) final put ffff9d40bb1a6800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1790945993.142700:0:15357:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27cd94 00000020:00000080:1.0:1790945993.142714:0:15357:0:(genops.c:885:class_export_put()) final put ffff9d40bb1a0000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1790945993.146279:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40bb1a6800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1790945993.146431:0:15357:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1790945993.146442:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790945993.146451:0:15357:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1790945993.146456:0:15357:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff9d40af688000) has no exports 00000004:01000000:1.0:1790945993.146620:0:15357:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1790945993.146708:0:15357:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27d09d 00000020:00000080:1.0:1790945993.146717:0:15357:0:(genops.c:885:class_export_put()) final put ffff9d40bfe9f800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1790945993.146760:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40bb1a0000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1790945993.146816:0:15357:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1790945993.146820:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790945993.146827:0:15357:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1790945993.146829:0:15357:0:(genops.c:1557:class_disconnect_exports()) OBD device 27 (ffff9d40bca83380) has no exports 00000020:00000080:1.0:1790945993.146835:0:15357:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27d096 00000020:00000080:1.0:1790945993.146838:0:15357:0:(genops.c:885:class_export_put()) final put ffff9d40bfee1800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1790945993.146858:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40bfe9f800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:1.0:1790945993.147512:0:15357:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1790945993.147518:0:15357:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1790945993.147523:0:15357:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:1.0:1790945993.147528:0:15357:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790945993.147531:0:15357:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790945993.147581:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40bfee1800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1790945993.147715:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790945993.147725:0:15357:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1790945993.147731:0:15357:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27cf5b 00000020:00000080:1.0:1790945993.147736:0:15357:0:(genops.c:885:class_export_put()) final put ffff9d3f82248000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1790945993.147758:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d3f8340b000 for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1790945993.147763:0:36:0:(genops.c:885:class_export_put()) final put ffff9d3f832de000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1790945993.147765:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f832de000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:2.0:1790945993.147769:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1790945993.147943:0:15357:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1790945993.147948:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790945993.147953:0:15357:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1790945993.147956:0:15357:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff9d40bca819c0) has no exports 00000020:00000080:1.0:1790945993.147962:0:15357:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27cf54 00000020:00000080:1.0:1790945993.147972:0:15357:0:(genops.c:885:class_export_put()) final put ffff9d40871fc800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1790945993.148048:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f82248000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00010000:01000000:1.0:1790945993.148554:0:15357:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1790945993.148562:0:15357:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1790945993.148565:0:15357:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:1.0:1790945993.148569:0:15357:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790945993.148571:0:15357:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790945993.148705:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40871fc800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1790945993.148785:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790945993.148792:0:15357:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1790945993.148803:0:15357:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1790945993.148808:0:15357:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27cdb7 00000020:00000080:1.0:1790945993.148821:0:15357:0:(genops.c:885:class_export_put()) final put ffff9d40b4b72000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1790945993.148853:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d40bc913000 for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1790945993.148859:0:36:0:(genops.c:885:class_export_put()) final put ffff9d3f8224e800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1790945993.148861:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f8224e800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:2.0:1790945993.148865:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1790945993.149120:0:15357:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1790945993.149125:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790945993.149139:0:15357:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1790945993.149143:0:15357:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff9d40b4a43380) has no exports 00000020:00000080:1.0:1790945993.149148:0:15357:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27cdb0 00000020:00000080:1.0:1790945993.149151:0:15357:0:(genops.c:885:class_export_put()) final put ffff9d40bb1a7000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1790945993.149272:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40b4b72000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1790945993.149707:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40bb1a7000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1790945993.153239:0:15357:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1790945993.153247:0:15357:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790945993.153252:0:15357:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1790945993.153262:0:15357:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790945993.153320:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790945993.153331:0:15357:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1790945993.153366:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790945993.153368:0:15357:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1790945993.153374:0:15357:0:(genops.c:885:class_export_put()) final put ffff9d40baeb8000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1790945993.153378:0:15357:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40baeb8000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1790945993.153386:0:15357:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1790945993.153541:0:15357:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27cd9b 00000020:00000080:2.0:1790945993.153547:0:15357:0:(genops.c:885:class_export_put()) final put ffff9d40bb1a0800/lustre-MDD0001_UUID 00000020:01000000:2.0:1790945993.153552:0:15357:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1790945993.153555:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790945993.153560:0:15357:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1790945993.153563:0:15357:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff9d40af6899c0) has no exports 00000020:00000080:2.0:1790945993.153582:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790945993.153584:0:15357:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1790945993.153588:0:15357:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27cda2 00000020:00000080:2.0:1790945993.153592:0:15357:0:(genops.c:885:class_export_put()) final put ffff9d40bb1a3000/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1790945993.153609:0:15357:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d40bacd0800 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1790945993.153612:0:15357:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d40bacd0800 2 00000020:01000004:2.0:1790945993.153616:0:15357:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9d40bacd0800 from lustre-MDT0001 00000020:00000080:2.0:1790945993.153634:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790945993.153648:0:15357:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1790945993.153651:0:15357:0:(genops.c:885:class_export_put()) final put ffff9d40bb1a1800/lustre-MDT0001_UUID 00000020:00000080:2.0:1790945993.153653:0:15357:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40bb1a1800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1790945993.153658:0:15357:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1790945993.153686:0:15357:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1790945993.153689:0:15357:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1790945993.153692:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790945993.153695:0:15357:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790945993.153701:0:15357:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9d408ab84000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790945993.153706:0:15357:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff9d40accf3380) has exports, disconnecting them 00000020:00080000:2.0:1790945993.153710:0:15357:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9d408ab84000), last request at 1790945762 00000020:00000080:2.0:1790945993.153714:0:15357:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27cdf6 00000020:00080000:2.0:1790945993.153725:0:15357:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d408ab84000): rc 0 00000020:00000080:2.0:1790945993.153728:0:15357:0:(genops.c:885:class_export_put()) final put ffff9d408ab84000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1790945993.154621:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d40bb1a5800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1790945993.154644:0:36:0:(genops.c:885:class_export_put()) final put ffff9d40b4a29000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1790945993.154655:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40b4a29000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1790945993.154661:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1790945993.154776:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40bb1a0800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1790945993.154780:0:36:0:(genops.c:885:class_export_put()) final put ffff9d40bb1a6000/lustre-MDD0001_UUID 00000020:00000080:3.0:1790945993.154782:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40bb1a6000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1790945993.154786:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1790945993.154925:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40bb1a3000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1790945993.154930:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d408ab84000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1790945993.155387:0:15357:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1790945993.155393:0:15357:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790945993.155397:0:15357:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1790945993.155402:0:15357:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790945993.155420:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d40871fe000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1790945993.155549:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790945993.155555:0:15357:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1790945993.155558:0:15357:0:(genops.c:885:class_export_put()) final put ffff9d40871fb800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1790945993.155560:0:15357:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40871fb800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1790945993.155564:0:15357:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1790945993.155597:0:15357:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d40bacd0800 1 00000020:00000080:3.0:1790945993.155602:0:15357:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27cd32 00000020:00000080:3.0:1790945993.155608:0:15357:0:(genops.c:885:class_export_put()) final put ffff9d40bacd2800/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1790945993.155616:0:15357:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1790945993.155622:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40bacd2800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1790945993.155630:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790945993.155634:0:15357:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1790945993.155651:0:15357:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff9d4084800000) has no exports 00010000:00010000:2.0:1790945993.221059:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790945993.221691:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790945993.221702:0:15357:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1790945993.221709:0:15357:0:(genops.c:885:class_export_put()) final put ffff9d40bacd0000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1790945993.221714:0:15357:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40bacd0000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1790945993.221728:0:15357:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1790945993.221850:0:15357:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9d40bacd5800 00000020:01000000:1.0:1790945993.221873:0:15357:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1790945993.221877:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790945993.221881:0:15357:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790945993.221885:0:15357:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff9d40848019c0) has no exports 00000100:00100000:0.0:1790945993.222629:0:6522:0:(service.c:3206:ptlrpc_main()) mdt00_001: service thread [ffff9d4090e95c00:6522] 1 exiting: rc = 0 00000100:00100000:0.0:1790945993.222740:0:6523:0:(service.c:3206:ptlrpc_main()) mdt00_002: service thread [ffff9d4096cf7400:6523] 2 exiting: rc = 0 00000100:00100000:0.0:1790945993.222814:0:8457:0:(service.c:3206:ptlrpc_main()) mdt00_003: service thread [ffff9d3f81bda000:8457] 3 exiting: rc = 0 00000100:00100000:3.0:1790945993.222924:0:13005:0:(service.c:3206:ptlrpc_main()) mdt00_004: service thread [ffff9d3f8268e600:13005] 4 exiting: rc = 0 00000100:00100000:2.0:1790945993.223123:0:6521:0:(service.c:3206:ptlrpc_main()) mdt00_000: service thread [ffff9d4090e95800:6521] 0 exiting: rc = 1 00000100:00100000:1.0:1790945993.223556:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223566:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223573:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223579:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223585:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223592:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223598:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223604:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223611:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223617:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223622:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223630:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223636:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223643:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223649:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223656:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223662:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223684:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223689:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223695:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223700:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223706:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223712:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223718:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223723:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223728:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223733:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223739:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223743:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223748:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223754:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223759:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223765:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223771:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223776:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223782:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223787:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223792:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223798:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223805:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223811:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223818:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223824:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223830:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223836:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223841:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223848:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223854:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223861:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223866:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223872:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223878:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223891:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223896:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223902:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223908:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223915:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223920:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223925:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223930:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223936:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223942:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223947:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.223953:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945993.227761:0:6525:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9d4090e95e00:6525] 1 exiting: rc = 0 00000100:00100000:0.0:1790945993.227866:0:6524:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9d4090e95400:6524] 0 exiting: rc = 1 00000100:00100000:1.0:1790945993.227958:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228048:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228058:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228064:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228070:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228076:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228082:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228087:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228092:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228098:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228104:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228110:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228118:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228124:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228129:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228134:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228140:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228145:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228151:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228156:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228160:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228217:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228224:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228242:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228247:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228253:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228258:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228262:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228267:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228272:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228277:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228282:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228287:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228292:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228297:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228302:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228306:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228311:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228315:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228320:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228325:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228329:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228334:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228339:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228344:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228349:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228354:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228359:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228364:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228368:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228373:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228379:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228384:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228389:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228394:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228400:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228405:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228410:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228423:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228428:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228432:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228437:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228442:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.228453:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945993.229125:0:6527:0:(service.c:3206:ptlrpc_main()) mdt_out00_001: service thread [ffff9d408fc74400:6527] 1 exiting: rc = 0 00000100:00100000:0.0:1790945993.229220:0:6526:0:(service.c:3206:ptlrpc_main()) mdt_out00_000: service thread [ffff9d408fc75c00:6526] 0 exiting: rc = 1 00000100:00100000:1.0:1790945993.229438:0:12418:0:(service.c:3206:ptlrpc_main()) mdt_out00_002: service thread [ffff9d3f8302a800:12418] 2 exiting: rc = 0 00000100:00100000:1.0:1790945993.229512:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229520:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229565:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229572:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229578:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229584:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229591:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229597:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229602:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229607:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229613:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229621:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229639:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229645:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229651:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229657:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229662:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229669:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229675:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229681:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229687:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229693:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229699:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229704:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229722:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229730:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229737:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229743:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229760:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229767:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229773:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229780:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229788:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229795:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229801:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229807:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229828:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229837:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229844:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229851:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229858:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229864:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229871:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229877:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229883:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229889:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229896:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229902:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229936:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229949:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.229960:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.230157:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.230409:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.230418:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.230425:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.230432:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.230440:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.230447:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.230454:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.230462:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.230483:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.230491:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.230497:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.230510:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945993.239951:0:6528:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9d40a70efa00:6528] 0 exiting: rc = 1 00000100:00100000:1.0:1790945993.240086:0:6529:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9d408538d800:6529] 1 exiting: rc = 0 00000100:00100000:1.0:1790945993.240386:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240394:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240399:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240404:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240410:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240415:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240420:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240425:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240429:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240434:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240439:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240444:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240449:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240454:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240459:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240463:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240468:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240472:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240477:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240482:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240487:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240491:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240496:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240501:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240505:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240510:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240515:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240520:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240526:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240530:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240680:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240690:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240696:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240714:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240719:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240724:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240729:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240734:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240739:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240744:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240749:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240754:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240759:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240764:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240768:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240772:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240777:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240782:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240787:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240792:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240797:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240803:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240808:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240813:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240818:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240822:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240827:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240833:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240838:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240842:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240846:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240851:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240856:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.240861:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.241445:0:6531:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9d40848c4200:6531] 1 exiting: rc = 0 00000100:00100000:0.0:1790945993.241456:0:6530:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9d40848c4000:6530] 0 exiting: rc = 1 00000100:00100000:1.0:1790945993.241505:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241511:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241516:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241521:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241538:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241543:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241548:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241554:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241558:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241563:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241568:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241573:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241578:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241583:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241598:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241604:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241609:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241614:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241619:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241624:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241629:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241634:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241640:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241645:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241649:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241654:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241660:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241665:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241671:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241758:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241763:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241768:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241772:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241777:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241781:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241786:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241791:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241795:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241803:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241814:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241818:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241823:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241828:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241832:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241836:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241841:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241845:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241849:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241854:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241859:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241863:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241867:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241871:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241875:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241879:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241883:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241887:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241891:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241895:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241899:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241903:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241907:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241915:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.241920:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242470:0:6533:0:(service.c:3206:ptlrpc_main()) mdt_fld_0001: service thread [ffff9d40848c4a00:6533] 1 exiting: rc = 0 00000100:00100000:2.0:1790945993.242574:0:6532:0:(service.c:3206:ptlrpc_main()) mdt_fld_0000: service thread [ffff9d40848c4400:6532] 0 exiting: rc = 1 00000100:00100000:1.0:1790945993.242707:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242713:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242723:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242731:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242738:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242742:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242747:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242752:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242757:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242770:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242775:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242780:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242785:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242792:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242797:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242802:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242807:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242811:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242815:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242820:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242824:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242828:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242833:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242837:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242841:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242846:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242850:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242854:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242859:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242863:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242868:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242872:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242876:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242880:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242885:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242888:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242892:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242896:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242900:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242905:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242909:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242913:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242917:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242922:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242931:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242936:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242940:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242945:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242950:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242954:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242958:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242962:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242966:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242970:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242975:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242979:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242984:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242989:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.242993:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.243006:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.243012:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.243017:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.243022:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945993.243026:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.249856:0:6535:0:(service.c:3206:ptlrpc_main()) mdt_io00_001: service thread [ffff9d40848c5a00:6535] 1 exiting: rc = 0 00000100:00100000:1.0:1790945993.250096:0:6536:0:(service.c:3206:ptlrpc_main()) mdt_io00_002: service thread [ffff9d40848c4e00:6536] 2 exiting: rc = 0 00000100:00100000:0.0:1790945993.250430:0:6534:0:(service.c:3206:ptlrpc_main()) mdt_io00_000: service thread [ffff9d40848c5e00:6534] 0 exiting: rc = 1 00000100:00100000:3.0:1790945993.250513:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250525:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250532:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250537:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250542:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250548:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250554:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250560:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250565:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250570:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250576:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250582:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250595:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250603:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250608:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250613:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250619:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250625:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250630:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250636:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250642:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250661:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250668:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250675:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250680:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250685:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250690:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250695:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250701:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250707:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250713:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250718:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250723:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250728:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250733:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250745:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250751:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250757:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250763:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250768:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250773:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250778:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250783:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250788:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250794:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250813:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250820:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250825:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250831:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250836:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250841:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250847:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250852:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250857:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250862:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250867:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250872:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250877:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250882:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250888:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250893:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250899:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250904:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945993.250915:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1790945993.257654:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790945993.257666:0:15357:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1790945993.257671:0:15357:0:(genops.c:885:class_export_put()) final put ffff9d4084823000/MDS_uuid 00000020:00000080:2.0:1790945993.257676:0:15357:0:(genops.c:844:class_export_destroy()) destroying export ffff9d4084823000/MDS_uuid for MDS 00000020:01000000:2.0:1790945993.257683:0:15357:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1790945993.257816:0:15357:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1790945994.280151:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790945994.591330:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8841fcfb-fb47-4307-92c2-97500c1c82bd->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790945994.591340:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8841fcfb-fb47-4307-92c2-97500c1c82bd->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790945994.591352:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790945994.591355:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790945994.591359:0:8:0:(import.c:65:import_set_state_nolock()) ffff9d3f8224a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790945994.591369:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 440 00000100:00080000:2.0:1790945994.591375:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790945994.591389:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9d3f8224a800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1790945994.591432:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d40bacedc00 x1877942638639616/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790945994.591606:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:2.0:1790945994.591639:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790945994.591643:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790945994.591645:0:8:0:(import.c:65:import_set_state_nolock()) ffff9d3f832dc800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790945994.591649:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 440 00000100:00080000:2.0:1790945994.591652:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790945994.591658:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9d3f832dc800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1790945994.591672:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d40bacef100 x1877942638639872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790945994.591940:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1877942638639616:0@lo:38:kworker.0 00000400:00000100:1.0:1790945994.592090:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877942638639616 offset 0 length 520: 4 00000100:00100000:1.0:1790945994.592136:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1877942638639872:0@lo:38:kworker.0 00000400:00000100:1.0:1790945994.592154:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877942638639872 offset 0 length 520: 4 00000100:00100000:3.0:1790945994.594566:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40baceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1877942638640000:0@lo:400:kworker.0 00000400:00000100:3.0:1790945994.594762:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877942638640000 offset 0 length 224: 4 00000100:00100000:3.0:1790945994.594805:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1877942638639744:0@lo:400:kworker.0 00000400:00000100:3.0:1790945994.594830:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877942638639744 offset 0 length 224: 4 00010000:00010000:3.0:1790945995.295796:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945996.335191:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790945996.848602:0:15558:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1790945996.857352:0:15558:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1790945996.857405:0:15558:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4080030400/0xd9f4181e0d27d17d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d184 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945996.857421:0:15558:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4080030400/0xd9f4181e0d27d17d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d184 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945996.857428:0:15558:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4080030400/0xd9f4181e0d27d17d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27d184 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945996.857436:0:15558:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9d4080030400/0xd9f4181e0d27d17d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27d184 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945996.857461:0:15558:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790945996.857466:0:15558:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1790945996.857490:0:15558:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790945996.857502:0:15558:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d40bacedc00 x1877942638639616/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790946009 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945996.857526:0:15558:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1790945996.857533:0:15558:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790945996.857540:0:15558:0:(import.c:65:import_set_state_nolock()) ffff9d3f8224a800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1790945996.857545:0:15558:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790945996.857556:0:15558:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d40bacedc00 x1877942638639616/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790946009 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945996.857563:0:15558:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1790945996.857577:0:15558:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00010000:00010000:2.0:1790945996.857763:0:10339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790945996.857770:0:10339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d4080030400/0xd9f4181e0d27d17d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27d184 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945996.857777:0:10339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080030400 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:2.0:1790945996.857781:0:10339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d4080030400/0xd9f4181e0d27d17d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27d184 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945996.857790:0:10339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d4080030400/0xd9f4181e0d27d17d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xd9f4181e0d27d184 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790945996.857805:0:10339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d4080030400/0xd9f4181e0d27d17d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xd9f4181e0d27d184 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945996.857811:0:10339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790945996.857813:0:10339:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1790945996.857815:0:10339:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1790945996.857828:0:10339:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d4087227800 00010000:00010000:2.0:1790945996.857831:0:10339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d4080030400/0xd9f4181e0d27d17d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xd9f4181e0d27d184 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945996.857838:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d4080030400/0xd9f4181e0d27d17d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xd9f4181e0d27d184 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945996.857850:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945996.857851:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945996.857853:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945996.860053:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1877942638639616:0@lo:38:kworker.0 00000100:00080000:3.0:1790945996.870386:0:15558:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1790945996.870406:0:15558:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d40bacefb80 x1877942638639744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946010 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945996.870436:0:15558:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1790945996.870443:0:15558:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1790945996.870472:0:15558:0:(import.c:65:import_set_state_nolock()) ffff9d3f8224c000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1790945996.870533:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84417b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1877942638640128:0@lo:39:umount.0 00000400:00000100:0.0:1790945996.870589:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877942638640128 offset 0 length 224: 4 00000100:00100000:2.0:1790945996.871051:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1877942638639744:0@lo:400:kworker.0 00010000:00010000:3.0:1790945997.344538:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790945997.599364:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8841fcfb-fb47-4307-92c2-97500c1c82bd->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790945997.599375:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8841fcfb-fb47-4307-92c2-97500c1c82bd->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790945997.599379:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790945997.599382:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790945997.599518:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84414a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1877942638640256:0@lo:400:kworker.0 00000400:00000100:2.0:1790945997.599574:0:3649:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877942638640256 offset 0 length 224: 4 00010000:00010000:2.0:1790945998.370803:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790945999.202867:0:8429:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1790945999.202876:0:8429:0:(genops.c:885:class_export_put()) final put ffff9d3f81b16800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1790945999.208405:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f81b16800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1790945999.208571:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d3f81b14000 for lustre-OST0000 00000001:00100000:2.0:1790945999.209643:0:9515:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1790945999.209650:0:9515:0:(genops.c:885:class_export_put()) final put ffff9d40bff0e000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1790945999.209718:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40bff0e000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1790945999.209781:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d40bff0d000 for lustre-OST0001 00010000:00010000:2.0:1790945999.391564:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790945999.647340:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8841fcfb-fb47-4307-92c2-97500c1c82bd->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790945999.647352:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8841fcfb-fb47-4307-92c2-97500c1c82bd->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790945999.647355:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790945999.647359:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790945999.647513:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790945999.647534:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1877942638640384:0@lo:400:kworker.0 00000400:00000100:2.0:1790945999.647594:0:3649:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877942638640384 offset 0 length 224: 4 00010000:00010000:3.0:1790946000.415272:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946001.439349:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946002.015320:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790945992/real 1790945992] req@ffff9d3f84417480 x1877942638639488/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790946002 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946002.015390:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d3f84417480 x1877942638639488/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790946002 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790946002.015744:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d4087227800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790946002.015773:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1790946002.015778:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8841fcfb-fb47-4307-92c2-97500c1c82bd:3646:1877942638639488:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:3.0:1790946002.015946:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8841fcfb-fb47-4307-92c2-97500c1c82bd->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790946002.015952:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1790946002.015955:0:8:0:(import.c:65:import_set_state_nolock()) ffff9d4087227800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790946002.015961:0:8:0:(import.c:545:import_select_connection()) MGC192.168.204.120@tcp: connect to NID 0@lo last attempt 443 00000100:00080000:3.0:1790946002.015977:0:8:0:(import.c:630:import_select_connection()) MGC192.168.204.120@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1790946002.015989:0:8:0:(import.c:666:import_select_connection()) MGC192.168.204.120@tcp: import ffff9d4087227800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1790946002.016029:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f84414380 x1877942638640512/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790946002.016063:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790946002.016069:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790946002.016117:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1877942638640640:0@lo:400:kworker.0 00000400:00000100:3.0:1790946002.016206:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877942638640640 offset 0 length 224: 4 00000100:00100000:1.0:1790946002.017928:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8841fcfb-fb47-4307-92c2-97500c1c82bd:3646:1877942638640512:0@lo:250:kworker.0 00000400:00000100:1.0:1790946002.017977:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877942638640512 offset 0 length 520: 4 00010000:00010000:2.0:1790946002.468859:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946003.488995:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946004.511634:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946005.535725:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946006.111306:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790945996/real 1790945996] req@ffff9d3f84417b80 x1877942638640128/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790946006 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946006.111353:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d3f84417b80 x1877942638640128/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790946006 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790946006.111373:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d3f8224c000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1790946006.111395:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84417b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1877942638640128:0@lo:39:umount.0 00000100:00080000:3.0:1790946006.112793:0:15558:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1790946006.112801:0:15558:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1790946006.112807:0:15558:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1790946006.114092:0:15558:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef0c00/0xd9f4181e0d27d18b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d192 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946006.114112:0:15558:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef0c00/0xd9f4181e0d27d18b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d192 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946006.114120:0:15558:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef0c00/0xd9f4181e0d27d18b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27d192 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946006.114129:0:15558:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9d40baef0c00/0xd9f4181e0d27d18b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27d192 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946006.114155:0:15558:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790946006.114162:0:15558:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27d401 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d408 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946006.114198:0:15558:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27d401 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d408 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946006.114222:0:15558:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27d401 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27d408 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946006.114229:0:15558:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27d401 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27d408 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946006.114371:0:15558:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1790946006.114377:0:15558:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1790946006.114419:0:15558:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1790946006.114424:0:15558:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1790946006.114429:0:15558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790946006.114435:0:15558:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1790946006.114439:0:15558:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff9d40a763b380) has no exports 00000020:00080000:3.0:1790946006.114464:0:15558:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff9d40a763b380) has no exports 00000020:01000000:3.0:1790946006.123445:0:15558:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9d3f8341f360 - data ffff9d408f745510/ffff9d3f83559800 00000020:01000000:3.0:1790946006.123606:0:15558:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9d40baf484e0 - data ffff9d408f683360/ffff9d40bce3d800 00010000:00010000:0.0:1790946006.123959:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790946006.123970:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40baef0c00/0xd9f4181e0d27d18b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27d192 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946006.123980:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef0c00 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:0.0:1790946006.123984:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40baef0c00/0xd9f4181e0d27d18b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27d192 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946006.123995:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40baef0c00/0xd9f4181e0d27d18b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xd9f4181e0d27d192 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790946006.124002:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40baef0c00/0xd9f4181e0d27d18b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xd9f4181e0d27d192 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790946006.124008:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790946006.124024:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1790946006.124028:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1790946006.124043:0:6509:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d4087227800 00010000:00010000:0.0:1790946006.124047:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40baef0c00/0xd9f4181e0d27d18b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xd9f4181e0d27d192 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946006.124054:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40baef0c00/0xd9f4181e0d27d18b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xd9f4181e0d27d192 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946006.124082:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790946006.124086:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27d401 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27d408 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946006.124091:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d6200 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:0.0:1790946006.124094:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27d401 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27d408 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946006.124101:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27d401 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd9f4181e0d27d408 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790946006.124106:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27d401 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd9f4181e0d27d408 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790946006.124111:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1790946006.124113:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1790946006.124115:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1790946006.124122:0:6509:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d4087227800 00010000:00010000:0.0:1790946006.124124:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27d401 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd9f4181e0d27d408 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946006.124130:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27d401 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd9f4181e0d27d408 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946006.124138:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946006.124139:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946006.124141:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946006.126247:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1790946006.134666:0:15558:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1790946006.154897:0:15558:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27cecf 00000020:00000080:2.0:1790946006.154911:0:15558:0:(genops.c:885:class_export_put()) final put ffff9d3f81bb4800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1790946006.154939:0:15558:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d40bc9be000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1790946006.154943:0:15558:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d40bc9be000 2 00000020:01000004:2.0:1790946006.154946:0:15558:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9d40bc9be000 from lustre-OST0000 00000020:00000080:2.0:1790946006.154974:0:15558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790946006.154985:0:15558:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1790946006.154987:0:15558:0:(genops.c:885:class_export_put()) final put ffff9d3f81bb5000/lustre-OST0000_UUID 00000020:00000080:2.0:1790946006.154990:0:15558:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f81bb5000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1790946006.155066:0:15558:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1790946006.155130:0:15558:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1790946006.155134:0:15558:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1790946006.155138:0:15558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790946006.155143:0:15558:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790946006.155149:0:15558:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9d3f8224f800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790946006.155155:0:15558:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff9d40b4a44d40) has exports, disconnecting them 00000020:00080000:2.0:1790946006.155160:0:15558:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9d3f8224f800), last request at 1790945783 00000020:00000080:2.0:1790946006.155164:0:15558:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27cef9 00000020:00080000:2.0:1790946006.155267:0:15558:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d3f8224f800): rc 0 00000020:00000080:2.0:1790946006.155273:0:15558:0:(genops.c:885:class_export_put()) final put ffff9d3f8224f800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1790946006.156102:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f81bb4800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1790946006.156118:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f8224f800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1790946006.167981:0:15558:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1790946006.168234:0:15558:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790946006.168256:0:15558:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790946006.168264:0:15558:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790946006.168358:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d3f8224a800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1790946006.168499:0:15558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790946006.168509:0:15558:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1790946006.168514:0:15558:0:(genops.c:885:class_export_put()) final put ffff9d40b4b76000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1790946006.168517:0:15558:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40b4b76000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1790946006.168526:0:15558:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1790946006.168616:0:15558:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1790946006.168627:0:15558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790946006.168633:0:15558:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790946006.168640:0:15558:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9d3f81b17800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790946006.168646:0:15558:0:(genops.c:1552:class_disconnect_exports()) OBD device 20 (ffff9d40b4a40000) has exports, disconnecting them 00000020:00080000:2.0:1790946006.168662:0:15558:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9d3f81b17800), last request at 1790945783 00000020:00000080:2.0:1790946006.168668:0:15558:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27cf0e 00000020:00080000:2.0:1790946006.168680:0:15558:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d3f81b17800): rc 0 00000020:00000080:2.0:1790946006.168684:0:15558:0:(genops.c:885:class_export_put()) final put ffff9d3f81b17800/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1790946006.168767:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f81b17800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1790946006.177269:0:15558:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1790946006.177278:0:15558:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1790946006.177282:0:15558:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790946006.177289:0:15558:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790946006.177382:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d3f8224c000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1790946006.177597:0:15558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790946006.177606:0:15558:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1790946006.177612:0:15558:0:(genops.c:885:class_export_put()) final put ffff9d3f8224f000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1790946006.177616:0:15558:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f8224f000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1790946006.178268:0:15558:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1790946006.178347:0:15558:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d40bc9be000 1 00000020:00000080:0.0:1790946006.178354:0:15558:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27ce97 00000020:00000080:0.0:1790946006.178361:0:15558:0:(genops.c:885:class_export_put()) final put ffff9d40bc910000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1790946006.178373:0:15558:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1790946006.178386:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40bc910000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1790946006.178400:0:15558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790946006.178406:0:15558:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790946006.178410:0:15558:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff9d40bc9e4d40) has no exports 00000020:00000080:0.0:1790946006.331932:0:15558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790946006.331946:0:15558:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1790946006.331953:0:15558:0:(genops.c:885:class_export_put()) final put ffff9d40871fa800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1790946006.331957:0:15558:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40871fa800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1790946006.331971:0:15558:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1790946006.332092:0:15558:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9d40bc9ba000 00000020:02000400:0.0:1790946006.332714:0:15558:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1790946006.559966:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790946007.392425:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8841fcfb-fb47-4307-92c2-97500c1c82bd->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790946007.392433:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8841fcfb-fb47-4307-92c2-97500c1c82bd->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790946007.392436:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790946007.392439:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790946007.392641:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1877942638640768:0@lo:400:kworker.0 00000400:00000100:2.0:1790946007.392696:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877942638640768 offset 0 length 224: 4 00010000:00010000:2.0:1790946007.587402:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946008.611040:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946009.184311:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790945994/real 1790945994] req@ffff9d40bacef100 x1877942638639872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1790946009 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946009.184344:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d40bacef100 x1877942638639872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1790946009 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790946009.184366:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d3f832dc800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790946009.184389:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1790946009.184393:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1877942638639872:0@lo:38:kworker.0 00000100:00080000:2.0:1790946009.184551:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8841fcfb-fb47-4307-92c2-97500c1c82bd->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790946009.184557:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8841fcfb-fb47-4307-92c2-97500c1c82bd->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790946009.184559:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790946009.184563:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790946009.184566:0:8:0:(import.c:65:import_set_state_nolock()) ffff9d3f832dc800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790946009.184571:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 445 00000100:00080000:2.0:1790946009.184577:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790946009.184588:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9d3f832dc800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1790946009.184629:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d40bacef800 x1877942638640896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790946009.184700:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1877942638641024:0@lo:400:kworker.0 00000400:00000100:0.0:1790946009.184755:0:3649:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877942638641024 offset 0 length 224: 4 00000100:00100000:1.0:1790946009.185902:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1877942638640896:0@lo:38:kworker.0 00000400:00000100:1.0:1790946009.185943:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877942638640896 offset 0 length 520: 4 00010000:00010000:2.0:1790946009.631421:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790946010.229489:0:15760:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1790946010.249353:0:15760:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1790946010.249445:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4080030800/0xd9f4181e0d27d161 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d168 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946010.249460:0:15760:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4080030800/0xd9f4181e0d27d161 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d168 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946010.249467:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4080030800/0xd9f4181e0d27d161 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27d168 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946010.249474:0:15760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9d4080030800/0xd9f4181e0d27d161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27d168 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946010.249495:0:15760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790946010.249500:0:15760:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1790946010.249550:0:15760:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790946010.249562:0:15760:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d40bacef800 x1877942638640896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790946029 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946010.249581:0:15760:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1790946010.249600:0:15760:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790946010.249608:0:15760:0:(import.c:65:import_set_state_nolock()) ffff9d3f832dc800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1790946010.249613:0:15760:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790946010.249617:0:15760:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d40bacef800 x1877942638640896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790946029 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946010.249624:0:15760:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1790946010.249643:0:15760:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00000100:00100000:3.0:1790946010.250032:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1877942638640896:0@lo:38:kworker.0 00010000:00010000:0.0:1790946010.254845:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790946010.254860:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d4080030800/0xd9f4181e0d27d161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27d168 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946010.254872:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080030800 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:0.0:1790946010.254877:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d4080030800/0xd9f4181e0d27d161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27d168 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946010.254889:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d4080030800/0xd9f4181e0d27d161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd9f4181e0d27d168 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790946010.254897:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d4080030800/0xd9f4181e0d27d161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd9f4181e0d27d168 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790946010.254903:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790946010.254906:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1790946010.254909:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1790946010.254926:0:6509:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d4087227800 00010000:00010000:0.0:1790946010.254930:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d4080030800/0xd9f4181e0d27d161 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd9f4181e0d27d168 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946010.254937:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d4080030800/0xd9f4181e0d27d161 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd9f4181e0d27d168 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946010.254951:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946010.254952:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946010.254954:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790946010.255136:0:15760:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1790946010.255149:0:15760:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d40baceed80 x1877942638640000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946010 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946010.255195:0:15760:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d3f84414a80 x1877942638640256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946013 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946010.255210:0:15760:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d3f84414700 x1877942638640384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946015 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946010.255219:0:15760:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d3f84414000 x1877942638640640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946018 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946010.255231:0:15760:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d40bacefb80 x1877942638640768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946023 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946010.255240:0:15760:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d40bacec000 x1877942638641024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946025 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946010.255248:0:15760:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:2.0:1790946010.255277:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1877942638640640:0@lo:400:kworker.0 00000100:00080000:2.0:1790946010.255317:0:15760:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1790946010.255343:0:15760:0:(import.c:65:import_set_state_nolock()) ffff9d3f832d8800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1790946010.255520:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1877942638640768:0@lo:400:kworker.0 00000100:00100000:1.0:1790946010.255529:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40baceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1877942638640000:0@lo:400:kworker.0 00000100:00100000:0.0:1790946010.256352:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1877942638641024:0@lo:400:kworker.0 00000100:00100000:0.0:1790946010.256362:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1877942638640384:0@lo:400:kworker.0 00000100:00100000:0.0:1790946010.256387:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84414a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1877942638640256:0@lo:400:kworker.0 00000100:00100000:3.0:1790946010.257270:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1877942638641152:0@lo:39:umount.0 00000400:00000100:3.0:1790946010.257356:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877942638641152 offset 0 length 224: 4 00010000:00010000:2.0:1790946010.655582:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946011.680197:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946012.703467:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946013.727320:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790946014.559563:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8841fcfb-fb47-4307-92c2-97500c1c82bd->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790946014.559576:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8841fcfb-fb47-4307-92c2-97500c1c82bd->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1790946014.752092:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946015.775328:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946016.803910:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946017.439311:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790946002/real 1790946002] req@ffff9d3f84414380 x1877942638640512/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790946017 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946017.439349:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d3f84414380 x1877942638640512/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790946017 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790946017.439392:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d4087227800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790946017.439423:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1790946017.439428:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8841fcfb-fb47-4307-92c2-97500c1c82bd:3646:1877942638640512:0@lo:250:kworker.0 00000100:00080000:2.0:1790946017.439588:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8841fcfb-fb47-4307-92c2-97500c1c82bd->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790946017.439593:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1790946017.439597:0:36:0:(import.c:65:import_set_state_nolock()) ffff9d4087227800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790946017.439609:0:36:0:(import.c:545:import_select_connection()) MGC192.168.204.120@tcp: connect to NID 0@lo last attempt 452 00000100:00080000:2.0:1790946017.439614:0:36:0:(import.c:630:import_select_connection()) MGC192.168.204.120@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790946017.439625:0:36:0:(import.c:666:import_select_connection()) MGC192.168.204.120@tcp: import ffff9d4087227800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1790946017.439657:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d40bacec000 x1877942638641280/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790946017.439734:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8841fcfb-fb47-4307-92c2-97500c1c82bd:3646:1877942638641280:0@lo:250:kworker.0 00000400:00000100:3.0:1790946017.439782:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877942638641280 offset 0 length 520: 4 00010000:00010000:2.0:1790946017.823409:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946018.847319:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946019.871524:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946020.511434:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790946010/real 1790946010] req@ffff9d40bacedf80 x1877942638641152/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790946020 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946020.511478:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d40bacedf80 x1877942638641152/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790946020 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790946020.511498:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d3f832d8800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1790946020.511518:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1877942638641152:0@lo:39:umount.0 00000100:00080000:2.0:1790946020.511608:0:15760:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1790946020.511613:0:15760:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1790946020.511618:0:15760:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1790946020.512557:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef0600/0xd9f4181e0d27d16f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d176 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946020.512571:0:15760:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef0600/0xd9f4181e0d27d16f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d176 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946020.512579:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef0600/0xd9f4181e0d27d16f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27d176 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946020.512586:0:15760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9d40baef0600/0xd9f4181e0d27d16f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27d176 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946020.512619:0:15760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790946020.512627:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40813ff200/0xd9f4181e0d27d3f3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27d3fa expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946020.512634:0:15760:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40813ff200/0xd9f4181e0d27d3f3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27d3fa expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946020.512640:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40813ff200/0xd9f4181e0d27d3f3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27d3fa expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946020.512660:0:15760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9d40813ff200/0xd9f4181e0d27d3f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27d3fa expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946020.512687:0:15760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1790946020.512694:0:15760:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1790946020.512720:0:15760:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1790946020.512724:0:15760:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1790946020.512729:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790946020.512735:0:15760:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790946020.512740:0:15760:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff9d40bc9e0000) has no exports 00000020:00080000:2.0:1790946020.512765:0:15760:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff9d40bc9e0000) has no exports 00010000:00010000:0.0:1790946020.514563:0:10339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790946020.514578:0:10339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40baef0600/0xd9f4181e0d27d16f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27d176 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946020.514589:0:10339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef0600 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:0.0:1790946020.514594:0:10339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40baef0600/0xd9f4181e0d27d16f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27d176 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946020.514604:0:10339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40baef0600/0xd9f4181e0d27d16f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd9f4181e0d27d176 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790946020.514612:0:10339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40baef0600/0xd9f4181e0d27d16f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd9f4181e0d27d176 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790946020.514618:0:10339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790946020.514620:0:10339:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1790946020.514623:0:10339:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1790946020.514639:0:10339:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d4087227800 00010000:00010000:0.0:1790946020.514643:0:10339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40baef0600/0xd9f4181e0d27d16f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd9f4181e0d27d176 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946020.514649:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40baef0600/0xd9f4181e0d27d16f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd9f4181e0d27d176 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946020.514664:0:10339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790946020.514685:0:10339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40813ff200/0xd9f4181e0d27d3f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27d3fa expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946020.514691:0:10339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40813ff200 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:0.0:1790946020.514694:0:10339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40813ff200/0xd9f4181e0d27d3f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27d3fa expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946020.514701:0:10339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40813ff200/0xd9f4181e0d27d3f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd9f4181e0d27d3fa expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790946020.514707:0:10339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40813ff200/0xd9f4181e0d27d3f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd9f4181e0d27d3fa expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790946020.514712:0:10339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1790946020.514714:0:10339:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1790946020.514716:0:10339:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1790946020.514720:0:10339:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d4087227800 00010000:00010000:0.0:1790946020.514723:0:10339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40813ff200/0xd9f4181e0d27d3f3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xd9f4181e0d27d3fa expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946020.514728:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40813ff200/0xd9f4181e0d27d3f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xd9f4181e0d27d3fa expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946020.514740:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946020.514741:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946020.514743:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946020.514806:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1790946020.521905:0:15760:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9d3f8341f240 - data ffff9d408f6af000/ffff9d40b4c29400 00000020:01000000:2.0:1790946020.522337:0:15760:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9d40baf483c0 - data ffff9d408f690510/ffff9d4087001000 00100000:10000000:2.0:1790946020.536042:0:15760:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1790946020.549940:0:15760:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27cff5 00000020:00000080:1.0:1790946020.549955:0:15760:0:(genops.c:885:class_export_put()) final put ffff9d40bff13000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1790946020.549978:0:15760:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d3f8248e800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1790946020.549982:0:15760:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d3f8248e800 2 00000020:01000004:1.0:1790946020.549985:0:15760:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9d3f8248e800 from lustre-OST0001 00000020:00000080:1.0:1790946020.550013:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790946020.550023:0:15760:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1790946020.550027:0:15760:0:(genops.c:885:class_export_put()) final put ffff9d40b4c6c000/lustre-OST0001_UUID 00000020:00000080:1.0:1790946020.550030:0:15760:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40b4c6c000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1790946020.550037:0:15760:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1790946020.550196:0:15760:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 8841fcfb-fb47-4307-92c2-97500c1c82bd->MGS 00010000:00010000:1.0:1790946020.550212:0:15760:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40baef1200/0xd9f4181e0d27cd4e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd9f4181e0d27cd55 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790946020.550225:0:15760:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40baef1200/0xd9f4181e0d27cd4e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd9f4181e0d27cd55 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790946020.550232:0:15760:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1790946020.550235:0:15760:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1790946020.550239:0:15760:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1790946020.550259:0:15760:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d4087227800 00010000:00010000:1.0:1790946020.550263:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40baef1200/0xd9f4181e0d27cd4e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd9f4181e0d27cd55 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946020.550277:0:15760:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7400/0xd9f4181e0d27d1d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd9f4181e0d27d1d8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790946020.550285:0:15760:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7400/0xd9f4181e0d27d1d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd9f4181e0d27d1d8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790946020.550302:0:15760:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790946020.550305:0:15760:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1790946020.550318:0:15760:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1790946020.550329:0:15760:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d4087227800 00010000:00010000:1.0:1790946020.550332:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7400/0xd9f4181e0d27d1d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd9f4181e0d27d1d8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1790946020.550349:0:15760:0:(import.c:65:import_set_state_nolock()) ffff9d4087227800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1790946020.550354:0:15760:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1790946020.550356:0:15760:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1790946020.550358:0:15760:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1790946020.550363:0:15760:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1790946020.550374:0:15760:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d40bacec000 x1877942638641280/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1790946037 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1790946020.550393:0:15760:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1790946020.550396:0:15760:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000020:00000080:0.0:1790946020.550933:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40bff13000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:3.0:1790946020.554565:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8841fcfb-fb47-4307-92c2-97500c1c82bd:3646:1877942638641280:0@lo:250:kworker.0 10000000:01000000:1.0:1790946020.554664:0:15760:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1790946020.554679:0:15760:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27cc4b 00000020:00000080:1.0:1790946020.554688:0:15760:0:(genops.c:885:class_export_put()) final put ffff9d4087278000/8841fcfb-fb47-4307-92c2-97500c1c82bd 00000020:01000000:1.0:1790946020.554707:0:15760:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.120@tcp (flags='') 00000020:00000080:1.0:1790946020.554718:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790946020.554725:0:15760:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.120@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1790946020.554729:0:15760:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff9d40af68cd40) has no exports 00000020:00000080:0.0:1790946020.554785:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d4087278000/8841fcfb-fb47-4307-92c2-97500c1c82bd for MGC192.168.204.120@tcp 10000000:01000000:3.0:1790946020.554890:0:6519:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1790946020.554994:0:15760:0:(obd_class.h:668:obd_cleanup_client_import()) MGC192.168.204.120@tcp: client import never connected 00000100:00080000:1.0:1790946020.554999:0:15760:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1790946020.555002:0:15760:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1790946020.555005:0:15760:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1790946020.555007:0:15760:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1790946020.555051:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790946020.555059:0:15760:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.120@tcp (uuid 8841fcfb-fb47-4307-92c2-97500c1c82bd) 00000020:01000000:1.0:1790946020.555066:0:15760:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1790946020.555069:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790946020.555073:0:15760:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1790946020.555078:0:15760:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9d3f832dd800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790946020.555098:0:15760:0:(genops.c:1552:class_disconnect_exports()) OBD device 25 (ffff9d40bca84d40) has exports, disconnecting them 00000020:00000080:0.0:1790946020.555195:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d4087227800 for MGC192.168.204.120@tcp 00000020:00000080:0.0:1790946020.555203:0:36:0:(genops.c:885:class_export_put()) final put ffff9d4087225800/8841fcfb-fb47-4307-92c2-97500c1c82bd 00000020:00000080:0.0:1790946020.555211:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d4087225800/8841fcfb-fb47-4307-92c2-97500c1c82bd for MGC192.168.204.120@tcp 00000020:01000000:0.0:1790946020.555216:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.120@tcp (8841fcfb-fb47-4307-92c2-97500c1c82bd) 00000020:00080000:1.0:1790946020.555807:0:15760:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9d3f832dd800), last request at 1790945803 00000020:00000080:1.0:1790946020.555812:0:15760:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27d01f 00000020:00080000:1.0:1790946020.555824:0:15760:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d3f832dd800): rc 0 00000020:00000080:1.0:1790946020.555828:0:15760:0:(genops.c:885:class_export_put()) final put ffff9d3f832dd800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1790946020.556805:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f832dd800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1790946020.556837:0:15760:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1790946020.556840:0:15760:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790946020.556844:0:15760:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790946020.556848:0:15760:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790946020.557006:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790946020.557012:0:15760:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1790946020.557018:0:15760:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1790946020.557023:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790946020.557028:0:15760:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790946020.557034:0:15760:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9d3f832d8000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790946020.557039:0:15760:0:(genops.c:1552:class_disconnect_exports()) OBD device 26 (ffff9d40bca80000) has exports, disconnecting them 00000020:00080000:0.0:1790946020.557043:0:15760:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9d3f832d8000), last request at 1790945803 00000020:00000080:0.0:1790946020.557047:0:15760:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27d034 00000020:00080000:0.0:1790946020.557059:0:15760:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d3f832d8000): rc 0 00000020:00000080:0.0:1790946020.557064:0:15760:0:(genops.c:885:class_export_put()) final put ffff9d3f832d8000/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1790946020.557432:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d3f832dc800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1790946020.557440:0:36:0:(genops.c:885:class_export_put()) final put ffff9d3f832dc000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1790946020.557442:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f832dc000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1790946020.557453:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1790946020.557524:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f832d8000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1790946020.749254:0:15760:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1790946020.749265:0:15760:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1790946020.749269:0:15760:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1790946020.749277:0:15760:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1790946020.749438:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:3.0:1790946020.749583:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d3f832d8800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1790946020.749669:0:10339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1790946020.749841:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1790946020.749997:0:6505:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9d4096fb4c00:6505] 1 exiting: rc = 0 00000100:00100000:3.0:1790946020.750087:0:6504:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9d40a7149400:6504] 0 exiting: rc = 1 00000100:00100000:1.0:1790946020.750198:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946020.750577:0:6506:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9d4090163a00:6506] 0 exiting: rc = 1 00000100:00100000:1.0:1790946020.750638:0:6508:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9d408fc1d400:6508] 2 exiting: rc = 0 00000100:00100000:3.0:1790946020.750727:0:7471:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9d40bc899000:7471] 3 exiting: rc = 0 00000100:00100000:2.0:1790946020.758824:0:15358:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_004: service thread [ffff9d40bacfe800:15358] 4 exiting: rc = 0 00000100:00100000:1.0:1790946020.759321:0:6507:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9d4096fb4800:6507] 1 exiting: rc = 0 00000100:00100000:3.0:1790946020.759430:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759439:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759446:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759454:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759471:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759478:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759484:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759489:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759495:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759500:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759506:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759512:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759517:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759524:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759537:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759543:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759550:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759556:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759562:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759568:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759575:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759580:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759585:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759590:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759596:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759600:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759606:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759611:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759616:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759634:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759641:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759646:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759651:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759670:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759676:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759681:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759687:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759692:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759698:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759703:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759708:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759713:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759719:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759725:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759729:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759734:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759739:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759744:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759749:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759754:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759759:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759764:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759769:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759774:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759779:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759784:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759789:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759795:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759800:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759806:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759812:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759817:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759822:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946020.759828:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1790946020.760940:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790946020.760951:0:15760:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1790946020.760957:0:15760:0:(genops.c:885:class_export_put()) final put ffff9d3f832d9800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1790946020.760961:0:15760:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f832d9800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1790946020.760977:0:15760:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1790946020.761020:0:15760:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d3f8248e800 1 00000020:00000080:3.0:1790946020.761027:0:15760:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27cfc4 00000020:00000080:3.0:1790946020.761033:0:15760:0:(genops.c:885:class_export_put()) final put ffff9d3f82248800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1790946020.761053:0:15760:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1790946020.761058:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790946020.761063:0:15760:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790946020.761067:0:15760:0:(genops.c:1557:class_disconnect_exports()) OBD device 23 (ffff9d4084803380) has no exports 00000020:00000080:1.0:1790946020.763645:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f82248800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1790946020.822914:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790946020.822928:0:15760:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1790946020.822933:0:15760:0:(genops.c:885:class_export_put()) final put ffff9d3f8248d000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1790946020.822937:0:15760:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f8248d000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1790946020.822944:0:15760:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1790946020.828064:0:15760:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9d3f8248b800 00000020:01000000:1.0:1790946020.828112:0:15760:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1790946020.828121:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790946020.828126:0:15760:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790946020.828130:0:15760:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff9d40b4a419c0) has no exports 00000020:00000080:1.0:1790946020.828164:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790946020.828191:0:15760:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1790946020.828196:0:15760:0:(genops.c:885:class_export_put()) final put ffff9d40bc910800/OSS_uuid 00000020:00000080:1.0:1790946020.828201:0:15760:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40bc910800/OSS_uuid for OSS 00000020:01000000:1.0:1790946020.828206:0:15760:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1790946020.828292:0:6517:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1790946020.832582:0:8916:0:(service.c:3206:ptlrpc_main()) ll_ost00_003: service thread [ffff9d40b4e27a00:8916] 3 exiting: rc = 0 00000100:00100000:0.0:1790946020.835867:0:8436:0:(service.c:3206:ptlrpc_main()) ll_ost00_001: service thread [ffff9d4096cf7e00:8436] 1 exiting: rc = 0 00000100:00100000:0.0:1790946020.836037:0:10099:0:(service.c:3206:ptlrpc_main()) ll_ost00_004: service thread [ffff9d40bff04a00:10099] 4 exiting: rc = 0 00000100:00100000:2.0:1790946020.836234:0:8435:0:(service.c:3206:ptlrpc_main()) ll_ost00_000: service thread [ffff9d40a774e200:8435] 0 exiting: rc = 1 00000100:00100000:1.0:1790946020.838543:0:8437:0:(service.c:3206:ptlrpc_main()) ll_ost00_002: service thread [ffff9d40bc903200:8437] 2 exiting: rc = 0 00000100:00100000:0.0:1790946020.839431:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839442:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839472:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839481:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839497:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839503:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839509:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839514:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839520:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839537:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839543:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839549:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839555:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839560:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839566:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839571:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839577:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839582:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839587:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839593:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839598:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839603:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839609:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839614:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839619:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839623:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839628:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839633:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839638:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839643:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839648:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839654:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839659:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839665:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839671:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839677:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839683:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839688:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839693:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839700:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839705:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839711:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839716:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839721:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839733:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839739:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839744:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839750:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839756:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839762:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839767:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839772:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839778:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839783:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839790:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839796:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839807:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839814:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839820:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839826:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839832:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839838:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839843:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.839849:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946020.841676:0:13838:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_003: service thread [ffff9d409ba10000:13838] 3 exiting: rc = 0 00000100:00100000:1.0:1790946020.841792:0:11925:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9d3f8301f000:11925] 2 exiting: rc = 0 00000100:00100000:3.0:1790946020.842075:0:8438:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9d40bc902800:8438] 0 exiting: rc = 1 00000100:00100000:2.0:1790946020.848249:0:8439:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9d40bc902e00:8439] 1 exiting: rc = 0 00000100:00100000:0.0:1790946020.848449:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848468:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848476:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848482:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848487:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848491:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848496:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848502:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848507:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848512:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848518:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848522:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848527:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848533:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848540:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848559:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848565:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848571:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848576:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848582:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848587:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848592:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848598:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848603:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848608:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848613:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848618:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848635:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848641:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848646:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848652:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848658:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848663:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848668:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848673:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848678:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848684:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848690:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848695:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848700:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848705:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848710:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848715:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848720:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848725:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848730:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848737:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848742:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848747:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848752:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848766:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848771:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848777:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848782:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848787:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848793:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848798:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848803:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848809:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848815:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848820:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848826:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848831:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.848836:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.849910:0:8441:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9d40bc903a00:8441] 1 exiting: rc = 0 00000100:00100000:3.0:1790946020.853248:0:8442:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9d408487aa00:8442] 2 exiting: rc = 0 00000100:00100000:3.0:1790946020.853478:0:8440:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9d40a7186600:8440] 0 exiting: rc = 1 00000100:00100000:0.0:1790946020.859070:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859079:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859085:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859090:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859095:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859100:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859110:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859117:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859124:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859130:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859135:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859141:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859146:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859151:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859156:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859162:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859178:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859185:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859191:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859197:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859212:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859217:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859223:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859237:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859243:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859248:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859254:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859260:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859265:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859270:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859275:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859292:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859298:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859304:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859310:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859316:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859322:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859327:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859332:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859338:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859343:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859348:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859354:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859359:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859366:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859373:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859379:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859397:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859403:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859408:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859414:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859419:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859425:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859430:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859436:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859447:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859472:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859484:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859500:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859514:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859529:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859535:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859541:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.859554:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.865733:0:8444:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9d40af63bc00:8444] 1 exiting: rc = 0 00000100:00100000:2.0:1790946020.867117:0:8443:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9d40af63aa00:8443] 0 exiting: rc = 1 00000100:00100000:0.0:1790946020.867256:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867264:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867269:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867274:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867287:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867300:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867308:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867313:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867318:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867323:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867329:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867334:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867340:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867345:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867350:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867355:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867360:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867366:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867371:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867376:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867382:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867386:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867391:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867396:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867401:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867418:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867423:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867427:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867431:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867436:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867441:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867446:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867451:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867465:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867472:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867478:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867483:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867488:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867493:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867498:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867503:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867509:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867513:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867518:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867523:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867527:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867532:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867537:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867542:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867546:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867551:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867556:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867561:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867566:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867570:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867575:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867581:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867586:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867591:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867597:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867610:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867615:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867635:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.867642:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946020.868790:0:8445:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9d40b4b99a00:8445] 0 exiting: rc = 1 00000100:00100000:2.0:1790946020.868922:0:8446:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9d409943ca00:8446] 1 exiting: rc = 0 00000100:00100000:0.0:1790946020.868997:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869012:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869020:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869026:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869032:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869038:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869056:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869063:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869069:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869075:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869081:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869087:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869092:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869098:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869105:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869111:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869117:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869124:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869143:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869150:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869156:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869162:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869183:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869190:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869197:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869202:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869210:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869215:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869222:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869228:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869247:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869268:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869274:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869297:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869304:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869309:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869315:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869321:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869327:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869332:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869338:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869344:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869366:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869373:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869379:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869385:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869392:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869398:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869405:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869412:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869419:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869426:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869433:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869439:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869471:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869480:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869485:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869492:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869499:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869506:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869511:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869517:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869523:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946020.869535:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1790946020.879289:0:15760:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1790946042.435511:0:16527:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1790946054.283666:0:17126:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1790946054.283674:0:17126:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1790946054.283676:0:17126:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1790946054.284283:0:17126:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9d3f81bb7000 00000020:01000004:1.0:1790946054.284301:0:17126:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1790946054.284308:0:17126:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1790946054.284322:0:17126:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9d40bfe90000) 00000020:00000080:1.0:1790946054.284337:0:17126:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1790946054.373545:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1790946054.374253:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1790946054.375443:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1790946054.375645:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1790946054.375838:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1790946054.376058:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1790946054.376985:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1790946054.379384:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1790946054.379894:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1790946054.380133:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1790946054.380382:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1790946054.380790:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1790946054.381005:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1790946054.381564:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1790946054.381783:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1790946054.381986:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1790946054.382203:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1790946054.382843:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1790946054.383361:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1790946054.383655:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1790946054.383912:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1790946054.384200:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1790946054.384695:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1790946054.384953:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1790946054.385191:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1790946054.385700:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1790946054.385921:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1790946054.386122:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1790946054.388097:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1790946054.388586:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1790946054.388812:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1790946054.389015:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1790946054.389378:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1790946054.389696:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1790946054.393952:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1790946054.399589:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1790946054.403613:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1790946054.406253:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1790946054.406731:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1790946054.407149:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1790946054.407605:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1790946054.407883:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1790946054.408152:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1790946054.408761:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1790946054.409050:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1790946054.409640:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1790946054.410135:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1790946054.412214:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1790946054.412844:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1790946054.413041:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1790946054.413988:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1790946054.414284:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1790946054.414915:0:17126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00080000:01000000:1.0:1790946054.416202:0:17126:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1790946054.416452:0:17126:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1790946054.416461:0:17126:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:1.0:1790946054.416472:0:17126:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd9f4181e0d27e1fa 00000020:01000004:1.0:1790946054.416478:0:17126:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1790946054.416483:0:17126:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1790946054.416489:0:17126:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d3f81bb7000 from MGS 00000020:01000004:1.0:1790946054.416492:0:17126:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1790946054.416501:0:17126:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9d40bfe93380) 00000020:00000080:1.0:1790946054.416512:0:17126:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1790946054.416569:0:17126:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d3f81bb7000 from MGS, refs=2 00080000:01000000:1.0:1790946054.416575:0:17126:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790946054.416580:0:17126:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd9f4181e0d27e208 00000100:00100000:1.0:1790946054.416685:0:17126:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1790946054.416831:0:17126:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1790946054.416837:0:17126:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1790946054.418832:0:17126:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1790946054.418846:0:17126:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1790946054.419693:0:17126:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790946054.420114:0:17126:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1790946054.420120:0:17126:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1790946054.422276:0:17126:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1790946054.422288:0:17126:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1790946054.425136:0:17126:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1790946054.425155:0:17126:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1790946054.426810:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946054.426816:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946054.426818:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946054.429781:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946054.429787:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946054.429790:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946054.430837:0:17126:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1790946054.438561:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1790946054.439550:0:17126:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1790946054.446568:0:17138:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1790946054.448614:0:17126:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1790946054.448681:0:17126:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1790946054.451750:0:17126:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1790946054.452094:0:17126:0:(service.c:173:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790946054.452326:0:17126:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1790946054.452338:0:17126:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1790946054.455346:0:17126:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1790946054.455363:0:17126:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1790946054.455962:0:17126:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1790946054.455969:0:17126:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1790946054.456949:0:17126:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1790946054.456971:0:17126:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.120@tcp' 00000020:01000004:0.0:1790946054.456973:0:17126:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1790946054.457003:0:17126:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.120@tcp (typ=mgc) 00000020:00000080:0.0:1790946054.457015:0:17126:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.120@tcp (ffff9d40bc9e4d40) 00000020:00000080:0.0:1790946054.457033:0:17126:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1790946054.457109:0:17126:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d40914a7000@MGC192.168.204.120@tcp: add connection 192.168.204.120@tcp at head 00010000:00010000:0.0:1790946054.457314:0:17126:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.120@tcp-0 is initialized 00000040:01000000:0.0:1790946054.457320:0:17126:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.120@tcp ctxt 1 is initialized 00000100:00080000:3.0:1790946054.457832:0:17143:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1790946054.479062:0:17144:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1790946054.479159:0:17126:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.120@tcp (uuid 87d8d138-d2ce-4761-a98a-4e847b9142bd) 00000020:00000080:1.0:1790946054.479255:0:17126:0:(genops.c:1384:class_connect()) connect: client 87d8d138-d2ce-4761-a98a-4e847b9142bd, cookie 0xd9f4181e0d27e216 00000100:00080000:1.0:1790946054.479269:0:17126:0:(import.c:545:import_select_connection()) MGC192.168.204.120@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790946054.479290:0:17126:0:(import.c:666:import_select_connection()) MGC192.168.204.120@tcp: import ffff9d40914a7000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1790946054.479327:0:17126:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d40b4d00380 x1877942638641408/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790946054.479559:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:87d8d138-d2ce-4761-a98a-4e847b9142bd:3646:1877942638641408:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1790946054.479640:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946054.479751:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638641408 00000100:00100000:0.0:1790946054.479759:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638641408 00000100:00100000:0.0:1790946054.479816:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790946054.479825:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4daf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3646:x1877942638641408:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1790946054.479852:0:17140:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 87d8d138-d2ce-4761-a98a-4e847b9142bd@0@lo t0 exp 0000000000000000 cur 505 last 0 00000020:00000080:0.0:1790946054.479879:0:17140:0:(genops.c:1384:class_connect()) connect: client 87d8d138-d2ce-4761-a98a-4e847b9142bd, cookie 0xd9f4181e0d27e21d 00000100:00080000:0.0:1790946054.480016:0:17140:0:(import.c:65:import_set_state_nolock()) ffff9d40914a5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790946054.482151:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4daf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+5:3646:x1877942638641408:12345-0@lo:250:mount.lustre.0 Request processed in 2314us (2499us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946054.482265:0:3646:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.120@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1790946054.482277:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.120@tcp: connect to target with instance 0 00000100:00080000:2.0:1790946054.482286:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.120@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1790946054.482298:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1790946054.482302:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40914a7000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1790946054.482305:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00100000:0.0:1790946054.482409:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1790946054.482512:0:17126:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 87d8d138-d2ce-4761-a98a-4e847b9142bd->MGS 00000020:01000004:0.0:1790946054.482548:0:17126:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1790946054.482557:0:17126:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1790946054.482575:0:17126:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9d40bc9e3380) 00000020:00000080:0.0:1790946054.482594:0:17126:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:2.0:1790946054.483434:0:3646:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1790946054.483448:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:87d8d138-d2ce-4761-a98a-4e847b9142bd:3646:1877942638641408:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1790946054.506628:0:17126:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790946054.506835:0:17126:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1790946054.506842:0:17126:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1790946054.508984:0:17126:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1790946054.508999:0:17126:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1790946054.517838:0:17126:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1790946054.517854:0:17126:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1790946054.519933:0:17126:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790946054.520144:0:17126:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1790946054.520151:0:17126:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1790946054.523838:0:17126:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1790946054.523851:0:17126:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1790946054.581891:0:17126:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790946054.582100:0:17126:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1790946054.582106:0:17126:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1790946054.584061:0:17126:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1790946054.584073:0:17126:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1790946054.585023:0:17126:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790946054.585363:0:17126:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790946054.585369:0:17126:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1790946054.586083:0:17126:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790946054.586091:0:17126:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1790946054.587706:0:17126:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790946054.587892:0:17126:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790946054.587899:0:17126:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1790946054.588855:0:17126:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790946054.588865:0:17126:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1790946054.589926:0:17126:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790946054.590109:0:17126:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790946054.590115:0:17126:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1790946054.596477:0:17126:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1790946054.596495:0:17126:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1790946054.613114:0:17126:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790946054.613466:0:17126:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1790946054.613474:0:17126:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1790946054.614979:0:17126:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1790946054.614993:0:17126:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1790946054.617473:0:17126:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1790946054.617489:0:17126:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1790946054.619514:0:17126:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1790946054.619645:0:17126:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1790946054.619653:0:17126:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.120@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1790946054.619781:0:17126:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.120@tcp ctxt 0 is initialized 00000020:01000004:1.0:1790946054.619830:0:17126:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.120@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1790946054.619834:0:17126:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1790946054.619836:0:17126:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790946054.619837:0:17126:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790946054.619838:0:17126:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790946054.619840:0:17126:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790946054.619841:0:17126:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790946054.619842:0:17126:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790946054.619844:0:17126:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790946054.619845:0:17126:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790946054.619847:0:17126:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790946054.619849:0:17126:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1790946054.619852:0:17126:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790946054.619853:0:17126:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790946054.619854:0:17126:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790946054.619855:0:17126:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790946054.619856:0:17126:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790946054.619857:0:17126:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790946054.619858:0:17126:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790946054.619859:0:17126:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790946054.619860:0:17126:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790946054.619865:0:17126:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790946054.619949:0:17126:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1790946054.619970:0:17126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17126:1877942638641536:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790946054.620056:0:17126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946054.620118:0:17126:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bcac0600 going to sleep for 11 seconds 00000100:00100000:3.0:1790946054.620367:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638641536 00000100:00100000:3.0:1790946054.620376:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638641536 00000100:00100000:3.0:1790946054.620428:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790946054.620622:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4dad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+5:17126:x1877942638641536:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790946054.620668:0:17142:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1790946054.620672:0:17142:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1790946054.620675:0:17142:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1790946054.621623:0:17163:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1790946054.622368:0:17142:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:1.0:1790946054.625656:0:17164:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1790946054.625664:0:17164:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1790946054.625667:0:17164:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1790946054.625784:0:17164:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1790946054.626622:0:17164:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1790946054.627140:0:17142:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1790946054.627153:0:17142:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1790946054.631007:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4dad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+5:17126:x1877942638641536:12345-0@lo:253:mount.lustre.0 Request processed in 10380us (10942us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946054.631022:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790946054.631135:0:17126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17126:1877942638641536:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790946054.631150:0:17126:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1790946054.631153:0:17126:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790946054.631155:0:17126:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790946054.631156:0:17126:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790946054.631157:0:17126:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790946054.631158:0:17126:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790946054.631160:0:17126:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790946054.631161:0:17126:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790946054.631163:0:17126:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790946054.631164:0:17126:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790946054.631204:0:17126:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1790946054.631225:0:17126:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d3f81bb7000 from lustre-MDT0000 10000000:01000000:1.0:1790946054.631414:0:17126:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1790946054.631418:0:17126:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1790946054.631423:0:17126:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9d40bc9e4d40 10000000:01000000:1.0:1790946054.631427:0:17126:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790946054.631448:0:17126:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9d40bc9e4d40 from 1 10000000:01000000:1.0:1790946054.631451:0:17126:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790946054.631490:0:17126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4092afd400/0xd9f4181e0d27e22b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946054.631607:0:17126:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d4092afd400/0xd9f4181e0d27e22b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946054.631633:0:17126:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d4092afd400/0xd9f4181e0d27e22b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946054.631654:0:17126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17126:1877942638641664:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790946054.631845:0:17126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946054.631887:0:17126:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bcac06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790946054.631953:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638641664 00000100:00100000:0.0:1790946054.631960:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638641664 00000100:00100000:0.0:1790946054.632005:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790946054.632016:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4daf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+5:17126:x1877942638641664:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790946054.632031:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946054.632047:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40bcbe1e00/0xd9f4181e0d27e232 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27e22b expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946054.632070:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40bcbe1e00/0xd9f4181e0d27e232 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27e22b expref: 6 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946054.632080:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40bcbe1e00/0xd9f4181e0d27e232 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27e22b expref: 6 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946054.632090:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe1e00, rc 0) 00000100:00100000:0.0:1790946054.632134:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4daf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+6:17126:x1877942638641664:12345-0@lo:101:mount.lustre.0 Request processed in 120us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946054.632141:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790946054.632266:0:17126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17126:1877942638641664:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790946054.632280:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d4092afd400/0xd9f4181e0d27e22b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e232 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946054.632289:0:17126:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d4092afd400/0xd9f4181e0d27e22b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e232 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946054.632356:0:17126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40baceed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17126:1877942638641792:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790946054.632381:0:17126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946054.632411:0:17126:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40925b6180 going to sleep for 11 seconds 00000100:00100000:3.0:1790946054.632637:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638641792 00000100:00100000:3.0:1790946054.632642:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638641792 00000100:00100000:3.0:1790946054.632683:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790946054.632699:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+6:17126:x1877942638641792:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790946054.632779:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+6:17126:x1877942638641792:12345-0@lo:501:mount.lustre.0 Request processed in 89us (396us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790946054.632787:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790946054.633837:0:17126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40baceed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17126:1877942638641792:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1790946054.633873:0:17126:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1790946054.633900:0:17126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4092afd400/0xd9f4181e0d27e22b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e232 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946054.633909:0:17126:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d4092afd400/0xd9f4181e0d27e22b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e232 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946054.633919:0:17126:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d3f81bb7000 10000000:01000000:2.0:1790946054.633924:0:17126:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790946054.634048:0:17126:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9d3f81bb7000 10000000:01000000:2.0:1790946054.634053:0:17126:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1790946054.634056:0:17126:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9d3f81bb7000 from 1 10000000:01000000:2.0:1790946054.634058:0:17126:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1790946054.634087:0:17126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65400/0xd9f4181e0d27e239 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946054.634095:0:17126:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65400/0xd9f4181e0d27e239 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946054.634117:0:17126:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65400/0xd9f4181e0d27e239 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946054.634132:0:17126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40baceed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17126:1877942638641920:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790946054.634408:0:17126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946054.634624:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638641920 00000100:00100000:1.0:1790946054.634630:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638641920 00000100:00100000:1.0:1790946054.634665:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790946054.634857:0:17126:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40925b6180 going to sleep for 11 seconds 00000100:00100000:1.0:1790946054.634888:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+6:17126:x1877942638641920:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790946054.634902:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946054.634918:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d4092afca00/0xd9f4181e0d27e240 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27e239 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946054.635004:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d4092afca00/0xd9f4181e0d27e240 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27e239 expref: 7 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946054.635015:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d4092afca00/0xd9f4181e0d27e240 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27e239 expref: 7 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946054.635023:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4092afca00, rc 0) 00000100:00100000:1.0:1790946054.635072:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+7:17126:x1877942638641920:12345-0@lo:101:mount.lustre.0 Request processed in 387us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946054.635079:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790946054.635209:0:17126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40baceed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17126:1877942638641920:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790946054.635223:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65400/0xd9f4181e0d27e239 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e240 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946054.635231:0:17126:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65400/0xd9f4181e0d27e239 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e240 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946054.635244:0:17126:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1790946054.635340:0:17126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65400/0xd9f4181e0d27e239 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e240 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946054.635347:0:17126:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65400/0xd9f4181e0d27e239 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e240 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946054.635354:0:17126:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1790946054.635359:0:17126:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790946054.635363:0:17126:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9d3f81bb7000 10000000:01000000:2.0:1790946054.635366:0:17126:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1790946054.635368:0:17126:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1790946054.635370:0:17126:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1790946054.635389:0:17126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65800/0xd9f4181e0d27e247 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946054.635406:0:17126:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65800/0xd9f4181e0d27e247 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946054.635415:0:17126:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65800/0xd9f4181e0d27e247 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946054.635792:0:17126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40baceed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17126:1877942638642048:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790946054.635841:0:17126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946054.635874:0:17126:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40925b6180 going to sleep for 11 seconds 00000100:00100000:0.0:1790946054.636203:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638642048 00000100:00100000:0.0:1790946054.636210:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638642048 00000100:00100000:0.0:1790946054.636245:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790946054.636262:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+7:17126:x1877942638642048:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790946054.636283:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946054.636295:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40bcbe1800/0xd9f4181e0d27e24e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27e247 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946054.636314:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40bcbe1800/0xd9f4181e0d27e24e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27e247 expref: 8 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946054.636322:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40bcbe1800/0xd9f4181e0d27e24e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27e247 expref: 8 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946054.636329:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe1800, rc 0) 00000100:00100000:0.0:1790946054.636364:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+8:17126:x1877942638642048:12345-0@lo:101:mount.lustre.0 Request processed in 103us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946054.636370:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790946054.636470:0:17126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40baceed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17126:1877942638642048:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790946054.636484:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65800/0xd9f4181e0d27e247 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e24e expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946054.636491:0:17126:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65800/0xd9f4181e0d27e247 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e24e expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946054.636560:0:17126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40baceed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17126:1877942638642176:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790946054.636584:0:17126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946054.636617:0:17126:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40925b6180 going to sleep for 11 seconds 00000100:00100000:0.0:1790946054.637034:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638642176 00000100:00100000:0.0:1790946054.637039:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638642176 00000100:00100000:0.0:1790946054.637074:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790946054.637082:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+8:17126:x1877942638642176:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790946054.637264:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+9:17126:x1877942638642176:12345-0@lo:501:mount.lustre.0 Request processed in 182us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946054.637271:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790946054.637409:0:17126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40baceed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17126:1877942638642176:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790946054.637458:0:17126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40baceed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17126:1877942638642304:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790946054.637520:0:17126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946054.637550:0:17126:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40925b6180 going to sleep for 11 seconds 00000100:00100000:0.0:1790946054.637936:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638642304 00000100:00100000:0.0:1790946054.637942:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638642304 00000100:00100000:0.0:1790946054.637976:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790946054.637984:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+9:17126:x1877942638642304:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790946054.639415:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+9:17126:x1877942638642304:12345-0@lo:503:mount.lustre.0 Request processed in 1426us (1889us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946054.639493:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790946054.639666:0:17126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40baceed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17126:1877942638642304:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790946054.640374:0:17165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:87d8d138-d2ce-4761-a98a-4e847b9142bd:17165:1877942638642432:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790946054.640428:0:17165:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946054.640586:0:17165:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40915a5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790946054.640646:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638642432 00000100:00100000:2.0:1790946054.640657:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638642432 00000100:00100000:2.0:1790946054.640857:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790946054.640866:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+9:17165:x1877942638642432:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790946054.642301:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+9:17165:x1877942638642432:12345-0@lo:502:llog_process_th.0 Request processed in 1432us (1868us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946054.642313:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790946054.642412:0:17165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:87d8d138-d2ce-4761-a98a-4e847b9142bd:17165:1877942638642432:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790946054.642457:0:17165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790946054.642470:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946054.642472:0:17165:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1790946054.642479:0:17165:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1790946054.642482:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790946054.642508:0:17165:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9d40bc9e0000) 00000020:00000080:0.0:1790946054.642527:0:17165:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1790946054.642533:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1790946054.642614:0:17165:0:(osd_handler.c:8931:osd_obd_connect()) connect #2 00000020:00000080:0.0:1790946054.642621:0:17165:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd9f4181e0d27e25c 00000020:00000080:0.0:1790946054.643093:0:17165:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1790946054.643098:0:17165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790946054.643102:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946054.643104:0:17165:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1790946054.643106:0:17165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790946054.643110:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946054.643112:0:17165:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1790946054.643115:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790946054.643122:0:17165:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9d40bc9e19c0) 00000020:00000080:0.0:1790946054.643133:0:17165:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1790946054.643138:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1790946054.643140:0:17165:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1790946054.643143:0:17165:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1790946054.643148:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790946054.643232:0:17165:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d3f81bb7000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1790946054.643256:0:17165:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9d40b441cd40) 00000020:00000080:0.0:1790946054.643266:0:17165:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1790946054.643332:0:17165:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1790946054.643338:0:17165:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd9f4181e0d27e271 00000020:00000080:0.0:1790946054.643452:0:17165:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1790946054.643459:0:17165:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1790946054.643464:0:17165:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xd9f4181e0d27e278 00080000:01000000:0.0:1790946054.643469:0:17165:0:(osd_handler.c:8931:osd_obd_connect()) connect #3 00000020:00000080:0.0:1790946054.643473:0:17165:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd9f4181e0d27e27f 00010000:00010000:3.0:1790946054.765044:0:17165:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1790946054.767807:0:17165:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967529 00000001:00080000:3.0:1790946054.768362:0:17165:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1790946054.769370:0:17165:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9d4084803380) 00000020:00000080:3.0:1790946054.769393:0:17165:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1790946054.769519:0:17165:0:(osd_handler.c:8931:osd_obd_connect()) connect #4 00000020:00000080:3.0:1790946054.769527:0:17165:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd9f4181e0d27e28d 00000020:00000080:1.0:1790946054.770787:0:17165:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1790946054.799149:0:17165:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xd9f4181e0d27e294 00000020:00000080:2.0:1790946054.800205:0:17165:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1790946054.800219:0:17165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790946054.800226:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946054.800228:0:17165:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1790946054.800231:0:17165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790946054.800234:0:17165:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1790946054.800236:0:17165:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790946054.800238:0:17165:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790946054.800239:0:17165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790946054.800241:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946054.800242:0:17165:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790946054.800245:0:17165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790946054.800262:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946054.800264:0:17165:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1790946054.800269:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1790946054.800322:0:17165:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1790946054.800336:0:17165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790946054.800339:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946054.800341:0:17165:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1790946054.800343:0:17165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790946054.800347:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946054.800348:0:17165:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1790946054.800351:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790946054.800358:0:17165:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.120@tcp to nid 0x20000c0a8cc78 (192.168.204.120@tcp) 00000020:00000080:2.0:1790946054.800388:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790946054.800416:0:17165:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9d3f836c99c0) 00000020:00000080:2.0:1790946054.800435:0:17165:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1790946054.800443:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790946054.800532:0:17165:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1790946054.800540:0:17165:0:(osd_handler.c:8931:osd_obd_connect()) connect #5 00000020:00000080:2.0:1790946054.800548:0:17165:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd9f4181e0d27e2a2 00010000:00080000:2.0:1790946054.800594:0:17165:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d40bb1a6800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.120@tcp at head 00010000:00010000:2.0:1790946054.809893:0:17165:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1790946054.815051:0:17165:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790946054.815066:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1790946054.815105:0:17165:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1790946054.815125:0:17165:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd9f4181e0d27e2a9 00000100:00080000:2.0:1790946054.815135:0:17165:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790946054.815146:0:17165:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9d40bb1a6800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1790946054.815408:0:17165:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d40baceed80 x1877942638642560/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790946054.815637:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40baceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638642560:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790946054.815858:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946054.815975:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638642560 00000100:00100000:0.0:1790946054.815984:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638642560 00000100:00100000:0.0:1790946054.816111:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790946054.816119:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84416a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1877942638642560:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1790946054.816134:0:17152:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1790946054.817084:0:17165:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1790946054.817187:0:17165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790946054.817193:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946054.817195:0:17165:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1790946054.817199:0:17165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790946054.817202:0:17165:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1790946054.817204:0:17165:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790946054.817205:0:17165:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790946054.817206:0:17165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790946054.817208:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946054.817210:0:17165:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790946054.817212:0:17165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790946054.817217:0:17165:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1790946054.817220:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946054.817221:0:17165:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1790946054.817235:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790946054.817239:0:17165:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.120@tcp to nid 0x20000c0a8cc78 (192.168.204.120@tcp) 00000020:01000000:2.0:1790946054.817272:0:17165:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1790946054.817275:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790946054.817294:0:17165:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9d3f836ccd40) 00000020:00000080:2.0:1790946054.817313:0:17165:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1790946054.817317:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790946054.817387:0:17165:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1790946054.817393:0:17165:0:(osd_handler.c:8931:osd_obd_connect()) connect #6 00000020:00000080:2.0:1790946054.817398:0:17165:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd9f4181e0d27e2b7 00010000:00080000:2.0:1790946054.817429:0:17165:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d3f81b10000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.120@tcp at head 00010000:00010000:2.0:1790946054.820067:0:17165:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1790946054.823417:0:17165:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1790946054.824405:0:17165:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1790946054.841783:0:17165:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790946054.842860:0:17165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1790946054.849811:0:17165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1790946054.853570:0:17171:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1790946054.853579:0:17171:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1790946054.855157:0:17165:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790946054.855340:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1790946054.855387:0:17165:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1790946054.855409:0:17165:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd9f4181e0d27e2be 00000100:00080000:0.0:1790946054.855420:0:17165:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00100000:1.0:1790946054.855453:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84416a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1877942638642560:12345-0@lo:38:llog_process_th.0 Request processed in 39331us (39593us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790946054.855470:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1790946054.855602:0:17165:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9d3f81b10000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1790946054.855642:0:17165:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f8265c380 x1877942638642688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790946054.855658:0:17165:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1790946054.855663:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40bb1a6800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790946054.855668:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790946054.855683:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40baceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638642560:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790946054.855719:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638642688:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1790946054.855751:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877942638642688 offset 0 length 520: 4 00000020:01000000:0.0:1790946054.855859:0:17165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790946054.855864:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946054.855865:0:17165:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1790946054.855869:0:17165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1790946054.855872:0:17165:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1790946054.855874:0:17165:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790946054.855881:0:17165:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790946054.855883:0:17165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1790946054.855886:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946054.855888:0:17165:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1790946054.855891:0:17165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790946054.855895:0:17165:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1790946054.855898:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946054.855900:0:17165:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1790946054.855903:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790946054.855907:0:17165:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.120@tcp to nid 0x20000c0a8cc78 (192.168.204.120@tcp) 00000020:01000000:0.0:1790946054.856047:0:17165:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1790946054.856051:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790946054.856063:0:17165:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9d40b4418000) 00000020:00000080:0.0:1790946054.856077:0:17165:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1790946054.856087:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790946054.856148:0:17165:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1790946054.856155:0:17165:0:(osd_handler.c:8931:osd_obd_connect()) connect #7 00000020:00000080:0.0:1790946054.856160:0:17165:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd9f4181e0d27e2cc 00010000:00080000:0.0:1790946054.856207:0:17165:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d40bb1a7800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.120@tcp at head 00010000:00010000:0.0:1790946054.856847:0:17165:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1790946054.856988:0:17165:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1790946054.857008:0:17165:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1790946054.861001:0:17165:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790946054.861365:0:17165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1790946054.861855:0:17165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1790946054.864774:0:17173:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1790946054.864782:0:17173:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1790946054.868426:0:17165:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790946054.868460:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1790946054.869306:0:17165:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1790946054.869334:0:17165:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd9f4181e0d27e2d3 00000100:00080000:1.0:1790946054.869346:0:17165:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790946054.869359:0:17165:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d40bb1a7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1790946054.869400:0:17165:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d40b4d00e00 x1877942638642816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790946054.869445:0:17165:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1790946054.869626:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638642816:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1790946054.869681:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877942638642816 offset 0 length 520: 4 00000020:01000000:1.0:1790946054.869953:0:17165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790946054.869959:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946054.869961:0:17165:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1790946054.869964:0:17165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790946054.869968:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946054.869970:0:17165:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790946054.869972:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790946054.869974:0:17165:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790946054.869977:0:17165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790946054.869979:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946054.869980:0:17165:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1790946054.869983:0:17165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790946054.869985:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946054.869986:0:17165:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790946054.869990:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1790946054.870021:0:17165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d02680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:87d8d138-d2ce-4761-a98a-4e847b9142bd:17165:1877942638642944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790946054.870124:0:17165:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946054.870148:0:17165:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4d07180 going to sleep for 11 seconds 00000100:00100000:0.0:1790946054.870349:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638642944 00000100:00100000:0.0:1790946054.870357:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638642944 00000100:00100000:0.0:1790946054.870404:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790946054.870415:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+9:17165:x1877942638642944:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790946054.870593:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+9:17165:x1877942638642944:12345-0@lo:502:llog_process_th.0 Request processed in 179us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946054.870602:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790946054.870768:0:17165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d02680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:87d8d138-d2ce-4761-a98a-4e847b9142bd:17165:1877942638642944:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790946054.870807:0:17165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790946054.870812:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946054.870814:0:17165:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1790946054.870818:0:17165:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1790946054.872246:0:17126:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1790946054.872276:0:17126:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1790946054.872304:0:17126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65800/0xd9f4181e0d27e247 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e24e expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946054.872317:0:17126:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65800/0xd9f4181e0d27e247 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e24e expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946054.872326:0:17126:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d3f81bb7000 from 1 10000000:01000000:3.0:1790946054.872329:0:17126:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790946054.872575:0:17126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40814a2a00/0xd9f4181e0d27e2da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946054.872585:0:17126:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40814a2a00/0xd9f4181e0d27e2da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946054.872610:0:17126:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40814a2a00/0xd9f4181e0d27e2da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946054.872631:0:17126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84414380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17126:1877942638643072:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790946054.872699:0:17126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946054.872786:0:17126:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096d19180 going to sleep for 11 seconds 00000100:00100000:1.0:1790946054.877714:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638643072 00000100:00100000:1.0:1790946054.877731:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638643072 00000100:00100000:1.0:1790946054.877815:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790946054.877826:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+9:17126:x1877942638643072:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790946054.877844:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946054.877864:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d4092afda00/0xd9f4181e0d27e2e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27e2da expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946054.877894:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d4092afda00/0xd9f4181e0d27e2e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27e2da expref: 10 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946054.877906:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d4092afda00/0xd9f4181e0d27e2e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27e2da expref: 10 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946054.877915:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4092afda00, rc 0) 00000100:00100000:1.0:1790946054.878010:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+10:17126:x1877942638643072:12345-0@lo:101:mount.lustre.0 Request processed in 186us (5310us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946054.878017:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790946054.878071:0:17126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84414380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17126:1877942638643072:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790946054.878091:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40814a2a00/0xd9f4181e0d27e2da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e2e1 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946054.878100:0:17126:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40814a2a00/0xd9f4181e0d27e2da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e2e1 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946054.878740:0:17126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84414380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17126:1877942638643200:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1790946054.878815:0:17126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946054.878858:0:17126:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096d19180 going to sleep for 11 seconds 00000100:00100000:1.0:1790946054.879044:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638643200 00000100:00100000:1.0:1790946054.879051:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638643200 00000100:00100000:1.0:1790946054.879079:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790946054.879086:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+10:17126:x1877942638643200:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1790946054.879103:0:17141:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1790946054.879109:0:17141:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1790946054.879213:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+10:17126:x1877942638643200:12345-0@lo:256:mount.lustre.0 Request processed in 127us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946054.879221:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790946054.882444:0:17126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84414380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17126:1877942638643200:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1790946054.884876:0:17126:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790946054.884909:0:17126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40814a2a00/0xd9f4181e0d27e2da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e2e1 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946054.885116:0:17126:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40814a2a00/0xd9f4181e0d27e2da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e2e1 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946054.885126:0:17126:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d3f81bb7000 from 1 10000000:01000000:3.0:1790946054.885128:0:17126:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790946054.885262:0:17126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40814a2e00/0xd9f4181e0d27e2e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946054.885271:0:17126:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40814a2e00/0xd9f4181e0d27e2e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946054.885283:0:17126:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40814a2e00/0xd9f4181e0d27e2e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946054.885308:0:17126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84414380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17126:1877942638643328:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790946054.885396:0:17126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946054.885846:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638643328 00000100:00100000:1.0:1790946054.885856:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638643328 00000100:00100000:1.0:1790946054.886137:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790946054.886147:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+10:17126:x1877942638643328:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790946054.886162:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946054.886204:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d4092afc000/0xd9f4181e0d27e2ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27e2e8 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946054.886230:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d4092afc000/0xd9f4181e0d27e2ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27e2e8 expref: 11 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946054.886241:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d4092afc000/0xd9f4181e0d27e2ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27e2e8 expref: 11 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946054.886249:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4092afc000, rc 0) 00000100:00100000:1.0:1790946054.886290:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+11:17126:x1877942638643328:12345-0@lo:101:mount.lustre.0 Request processed in 145us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946054.886297:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790946054.886471:0:17126:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096d19180 going to sleep for 11 seconds 00000100:00100000:3.0:1790946054.886830:0:17126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84414380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17126:1877942638643328:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790946054.886849:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40814a2e00/0xd9f4181e0d27e2e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e2ef expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946054.886859:0:17126:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40814a2e00/0xd9f4181e0d27e2e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e2ef expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946054.887011:0:17126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84414380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17126:1877942638643456:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790946054.887050:0:17126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946054.887078:0:17126:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096d19180 going to sleep for 11 seconds 00000100:00100000:0.0:1790946054.887269:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638643456 00000100:00100000:0.0:1790946054.887285:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638643456 00000100:00100000:0.0:1790946054.887326:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790946054.887333:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+11:17126:x1877942638643456:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790946054.888153:0:17126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84414380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17126:1877942638643456:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790946054.888280:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+11:17126:x1877942638643456:12345-0@lo:501:mount.lustre.0 Request processed in 946us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946054.888290:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790946054.888417:0:17126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84414380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17126:1877942638643584:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790946054.888982:0:17126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946054.889093:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638643584 00000100:00100000:2.0:1790946054.889101:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638643584 00000100:00100000:2.0:1790946054.889202:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790946054.889211:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+11:17126:x1877942638643584:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790946054.889330:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+11:17126:x1877942638643584:12345-0@lo:503:mount.lustre.0 Request processed in 120us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946054.889337:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790946054.893094:0:17126:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096d19180 going to sleep for 11 seconds 00000100:00100000:2.0:1790946054.893136:0:17126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84414380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17126:1877942638643584:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790946054.894069:0:17175:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d03800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:87d8d138-d2ce-4761-a98a-4e847b9142bd:17175:1877942638643712:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790946054.894149:0:17175:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946054.894365:0:17175:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4d07300 going to sleep for 11 seconds 00000100:00100000:2.0:1790946054.895125:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638643712 00000100:00100000:2.0:1790946054.895145:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638643712 00000100:00100000:2.0:1790946054.895347:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790946054.895357:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+11:17175:x1877942638643712:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790946054.896811:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+11:17175:x1877942638643712:12345-0@lo:502:llog_process_th.0 Request processed in 1449us (2655us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946054.896836:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790946054.897034:0:17175:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d03800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:87d8d138-d2ce-4761-a98a-4e847b9142bd:17175:1877942638643712:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790946054.897070:0:17175:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790946054.897080:0:17175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946054.897083:0:17175:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790946054.897090:0:17175:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d3f81bb7000 00000020:00000080:1.0:1790946054.897093:0:17175:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790946054.897103:0:17175:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790946054.897105:0:17175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946054.897107:0:17175:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1790946054.897109:0:17175:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790946054.897117:0:17175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946054.897119:0:17175:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790946054.897123:0:17175:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d3f81bb7000 00000020:00000080:1.0:1790946054.897125:0:17175:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790946054.897977:0:17175:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790946054.897986:0:17175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946054.897988:0:17175:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1790946054.897991:0:17175:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790946054.897994:0:17175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946054.897996:0:17175:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790946054.897999:0:17175:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d3f81bb7000 00000020:00000080:1.0:1790946054.898001:0:17175:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790946054.901056:0:17175:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790946054.901068:0:17175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946054.901071:0:17175:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790946054.901075:0:17175:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790946054.901078:0:17175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946054.901080:0:17175:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1790946054.901085:0:17175:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d3f81bb7000 00000020:00000080:1.0:1790946054.901087:0:17175:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790946054.901189:0:17175:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d03800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:87d8d138-d2ce-4761-a98a-4e847b9142bd:17175:1877942638643840:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790946054.901269:0:17175:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946054.901323:0:17175:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4d07300 going to sleep for 11 seconds 00000100:00100000:0.0:1790946054.901414:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638643840 00000100:00100000:0.0:1790946054.901421:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638643840 00000100:00100000:0.0:1790946054.901480:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790946054.901489:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+11:17175:x1877942638643840:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790946054.901639:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+11:17175:x1877942638643840:12345-0@lo:502:llog_process_th.0 Request processed in 150us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946054.901647:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790946054.902892:0:17175:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d03800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:87d8d138-d2ce-4761-a98a-4e847b9142bd:17175:1877942638643840:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790946054.902939:0:17175:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790946054.902948:0:17175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946054.902949:0:17175:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1790946054.902953:0:17175:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1790946054.903216:0:17126:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1790946054.903239:0:17126:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790946054.903258:0:17126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40814a2e00/0xd9f4181e0d27e2e8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e2ef expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946054.903271:0:17126:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40814a2e00/0xd9f4181e0d27e2e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e2ef expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790946054.903319:0:17126:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790946054.903322:0:17126:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d3f81bb7000 10000000:01000000:0.0:1790946054.903326:0:17126:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d3f81bb7000 10000000:01000000:0.0:1790946054.903330:0:17126:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790946054.903336:0:17126:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d3f81bb7000 from 1 10000000:01000000:0.0:1790946054.903339:0:17126:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790946054.903370:0:17126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe1200/0xd9f4181e0d27e2f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946054.903385:0:17126:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe1200/0xd9f4181e0d27e2f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946054.903394:0:17126:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe1200/0xd9f4181e0d27e2f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946054.903413:0:17126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17126:1877942638643968:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790946054.903483:0:17126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946054.903533:0:17126:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4088c76540 going to sleep for 11 seconds 00000100:00100000:1.0:1790946054.906081:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638643968 00000100:00100000:1.0:1790946054.906096:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638643968 00000100:00100000:1.0:1790946054.906161:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790946054.906198:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+11:17126:x1877942638643968:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790946054.906215:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946054.906233:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d4092afc600/0xd9f4181e0d27e2fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27e2f6 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946054.906258:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d4092afc600/0xd9f4181e0d27e2fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27e2f6 expref: 12 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946054.906268:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d4092afc600/0xd9f4181e0d27e2fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27e2f6 expref: 12 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946054.906276:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4092afc600, rc 0) 00000100:00100000:1.0:1790946054.906352:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+12:17126:x1877942638643968:12345-0@lo:101:mount.lustre.0 Request processed in 156us (2869us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946054.906359:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790946054.907607:0:17126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17126:1877942638643968:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790946054.907634:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe1200/0xd9f4181e0d27e2f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e2fd expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946054.907645:0:17126:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe1200/0xd9f4181e0d27e2f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e2fd expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946054.907912:0:17126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17126:1877942638644096:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790946054.907963:0:17126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946054.907999:0:17126:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4088c76540 going to sleep for 11 seconds 00000100:00100000:1.0:1790946054.911329:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638644096 00000100:00100000:1.0:1790946054.911346:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638644096 00000100:00100000:1.0:1790946054.911411:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790946054.911421:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+12:17126:x1877942638644096:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790946054.911647:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+12:17126:x1877942638644096:12345-0@lo:501:mount.lustre.0 Request processed in 227us (3682us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946054.911655:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790946054.913524:0:17126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17126:1877942638644096:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790946054.913594:0:17126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84414e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17126:1877942638644224:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790946054.913951:0:17126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946054.913989:0:17126:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096d196c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790946054.915136:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638644224 00000100:00100000:1.0:1790946054.915149:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638644224 00000100:00100000:1.0:1790946054.915210:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790946054.915219:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+12:17126:x1877942638644224:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790946054.915368:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+12:17126:x1877942638644224:12345-0@lo:503:mount.lustre.0 Request processed in 150us (1416us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946054.915384:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790946054.917287:0:17126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84414e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17126:1877942638644224:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790946054.925362:0:17178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacefb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:87d8d138-d2ce-4761-a98a-4e847b9142bd:17178:1877942638644352:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790946054.926371:0:17178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946054.926425:0:17178:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bcbcd600 going to sleep for 11 seconds 00000100:00100000:1.0:1790946054.926998:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638644352 00000100:00100000:1.0:1790946054.927009:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638644352 00000100:00100000:1.0:1790946054.927082:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790946054.927093:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+12:17178:x1877942638644352:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790946054.927292:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+12:17178:x1877942638644352:12345-0@lo:502:llog_process_th.0 Request processed in 201us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946054.927300:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790946054.929548:0:17178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacefb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:87d8d138-d2ce-4761-a98a-4e847b9142bd:17178:1877942638644352:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1790946054.929974:0:17178:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1790946054.929992:0:17178:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9d3f836c8000) 00000020:00000080:2.0:1790946054.930017:0:17178:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1790946054.930134:0:17178:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d3f81bb7000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1790946054.930138:0:17178:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d3f81bb7000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1790946054.930140:0:17178:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d3f81bb7000 4 00010000:00080000:2.0:1790946054.930213:0:17178:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d40bff0f000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.120@tcp at head 00010000:00010000:2.0:1790946054.954001:0:17178:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1790946054.954276:0:17178:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1790946054.954322:0:17178:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790946054.954337:0:17178:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xd9f4181e0d27e30b 00000100:00080000:2.0:1790946054.954346:0:17178:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790946054.954357:0:17178:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9d40bff0f000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1790946054.954391:0:17178:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d40bacefb80 x1877942638644480/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790946054.954441:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1877942638644480:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790946054.954512:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790946054.954569:0:17178:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1790946054.956100:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638644480 00000100:00100000:1.0:1790946054.956112:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638644480 00000100:00100000:1.0:1790946054.956150:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790946054.956157:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bacef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1877942638644480:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790946054.956272:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bacef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1877942638644480:12345-0@lo:38:llog_process_th.0 Request processed in 114us (1759us total) trans 0 rc -11/-11 00000100:00100000:1.0:1790946054.956280:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790946054.956329:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790946054.956338:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40bff0f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790946054.956342:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1790946054.956346:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1877942638644480:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790946054.956896:0:17178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacef100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:87d8d138-d2ce-4761-a98a-4e847b9142bd:17178:1877942638644608:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790946054.956976:0:17178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946054.957007:0:17178:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bcbcde40 going to sleep for 11 seconds 00000100:00100000:3.0:1790946054.959112:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638644608 00000100:00100000:3.0:1790946054.959125:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638644608 00000100:00100000:3.0:1790946054.959215:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790946054.959226:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+12:17178:x1877942638644608:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790946054.959434:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+12:17178:x1877942638644608:12345-0@lo:502:llog_process_th.0 Request processed in 210us (2457us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946054.959441:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790946054.959503:0:17178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacef100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:87d8d138-d2ce-4761-a98a-4e847b9142bd:17178:1877942638644608:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790946054.959566:0:17178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84414e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:87d8d138-d2ce-4761-a98a-4e847b9142bd:17178:1877942638644736:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790946054.959608:0:17178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946054.959636:0:17178:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096d19e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790946054.959650:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638644736 00000100:00100000:3.0:1790946054.959664:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638644736 00000100:00100000:3.0:1790946054.959687:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790946054.959693:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+12:17178:x1877942638644736:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790946054.959757:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+12:17178:x1877942638644736:12345-0@lo:502:llog_process_th.0 Request processed in 63us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946054.959783:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790946054.959836:0:17178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84414e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:87d8d138-d2ce-4761-a98a-4e847b9142bd:17178:1877942638644736:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1790946054.959866:0:17178:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1790946054.963871:0:17126:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1790946054.963919:0:17126:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790946054.963952:0:17126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe1200/0xd9f4181e0d27e2f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e2fd expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946054.963966:0:17126:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe1200/0xd9f4181e0d27e2f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e2fd expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790946054.964033:0:17126:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790946054.964036:0:17126:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790946054.964037:0:17126:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790946054.964038:0:17126:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790946054.964040:0:17126:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790946054.964041:0:17126:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790946054.964042:0:17126:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790946054.964044:0:17126:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790946054.964045:0:17126:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790946054.964047:0:17126:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790946054.964051:0:17126:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1790946054.964053:0:17126:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790946054.964054:0:17126:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790946054.964055:0:17126:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790946054.964056:0:17126:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790946054.964057:0:17126:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790946054.964058:0:17126:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790946054.964059:0:17126:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790946054.964060:0:17126:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790946054.964061:0:17126:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790946054.964062:0:17126:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790946054.964089:0:17126:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1790946054.964109:0:17126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacedc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17126:1877942638644864:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790946054.964207:0:17126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946054.964248:0:17126:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096fa8180 going to sleep for 11 seconds 00000100:00100000:2.0:1790946054.967799:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638644864 00000100:00100000:2.0:1790946054.967816:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638644864 00000100:00100000:2.0:1790946054.967876:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790946054.967887:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+12:17126:x1877942638644864:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790946054.967923:0:17141:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1790946054.967940:0:17141:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1790946054.984336:0:17141:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1790946054.984356:0:17141:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1790946054.984827:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+12:17126:x1877942638644864:12345-0@lo:253:mount.lustre.0 Request processed in 16938us (20615us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946054.984840:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 20000000:01000000:1.0:1790946054.985311:0:17163:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1790946054.985317:0:17163:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1790946054.985336:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d4092afc400/0xd9f4181e0d27e312 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946054.985351:0:17163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d4092afda00/0xd9f4181e0d27e2e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27e2da expref: 11 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946054.985372:0:17163:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d4092afc400/0xd9f4181e0d27e312 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946054.985410:0:17163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d4092afda00/0xd9f4181e0d27e2e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27e2da expref: 11 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946054.985564:0:17126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacedc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17126:1877942638644864:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790946054.985580:0:17126:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1790946054.985584:0:17126:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790946054.985592:0:17126:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790946054.985593:0:17126:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790946054.985594:0:17126:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790946054.985596:0:17126:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790946054.985597:0:17126:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790946054.985598:0:17126:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790946054.985600:0:17126:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790946054.985601:0:17126:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790946054.985603:0:17126:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790946054.985617:0:17126:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1790946054.987554:0:17163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d4092afda00/0xd9f4181e0d27e2e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27e2da expref: 11 pid: 17140 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946054.987581:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d03800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17163:1877942638644992:0@lo:104: 00000100:00100000:1.0:1790946054.987650:0:17163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946054.987700:0:17163:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4d07e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790946054.988418:0:17130:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638644992 00000100:00100000:3.0:1790946054.988442:0:17130:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638644992 00000100:00100000:3.0:1790946054.988500:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790946054.988509:0:17130:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:87d8d138-d2ce-4761-a98a-4e847b9142bd+3:17163:x1877942638644992:12345-0@lo:104: 00010000:00010000:3.0:1790946054.988527:0:17130:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d40814a2a00/0xd9f4181e0d27e2da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27e2e1 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946054.988615:0:17130:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790946054.988621:0:17130:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:87d8d138-d2ce-4761-a98a-4e847b9142bd+3:17163:x1877942638644992:12345-0@lo:104: Request processed in 114us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946054.988628:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1790946054.988655:0:17136:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790946054.988662:0:17136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40814a2a00/0xd9f4181e0d27e2da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27e2e1 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946054.988670:0:17136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40814a2a00 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:3.0:1790946054.988675:0:17136:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40814a2a00/0xd9f4181e0d27e2da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27e2e1 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946054.988702:0:17136:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40814a2a00/0xd9f4181e0d27e2da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27e2e1 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790946054.988709:0:17136:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40814a2a00/0xd9f4181e0d27e2da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27e2e1 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946054.988715:0:17136:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790946054.988750:0:17136:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40814a2a00/0xd9f4181e0d27e2da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27e2e1 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946054.988756:0:17136:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790946054.988776:0:17136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40814a2a00/0xd9f4181e0d27e2da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27e2e1 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946054.988783:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40814a2a00/0xd9f4181e0d27e2da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27e2e1 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946054.988814:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946054.988816:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946054.988818:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946054.988863:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84414e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:87d8d138-d2ce-4761-a98a-4e847b9142bd:3650:1877942638645120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790946054.988900:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946054.988958:0:17132:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638645120 00000100:00100000:3.0:1790946054.988963:0:17132:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638645120 00010000:00010000:3.0:1790946054.989038:0:17132:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d4092afda00/0xd9f4181e0d27e2e1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27e2da expref: 12 pid: 17140 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946054.989058:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790946054.989065:0:17132:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84416300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87d8d138-d2ce-4761-a98a-4e847b9142bd+12:3650:x1877942638645120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790946054.989082:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946054.989087:0:17132:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d4092afda00/0xd9f4181e0d27e2e1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27e2da expref: 12 pid: 17140 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946054.989097:0:17132:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d4092afda00/0xd9f4181e0d27e2e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27e2da expref: 12 pid: 17140 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946054.989115:0:17132:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d4092afc400/0xd9f4181e0d27e312 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946054.989123:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d4092afc400/0xd9f4181e0d27e312 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790946054.989138:0:17132:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003822536s 00010000:00010000:3.0:1790946054.989143:0:17132:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d4092afc400/0xd9f4181e0d27e312 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946054.989150:0:17132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d4092afc400/0xd9f4181e0d27e312 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946054.989157:0:17132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d4092afc400/0xd9f4181e0d27e312 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946054.989163:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d4092afc400/0xd9f4181e0d27e312 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946054.989189:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afc400 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:3.0:1790946054.989193:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d4092afc400/0xd9f4181e0d27e312 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946054.989200:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d4092afc400/0xd9f4181e0d27e312 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946054.989214:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d4092afc400/0xd9f4181e0d27e312 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946054.989222:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790946054.989251:0:17132:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84416300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87d8d138-d2ce-4761-a98a-4e847b9142bd+12:3650:x1877942638645120:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946054.989258:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790946054.989294:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84414e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:87d8d138-d2ce-4761-a98a-4e847b9142bd:3650:1877942638645120:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790946054.995398:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d4092afda00/0xd9f4181e0d27e2e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27e2da expref: 11 pid: 17140 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946054.995432:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d03800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17163:1877942638644992:0@lo:104: 00010000:00010000:1.0:1790946054.995459:0:17163:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d4092afc400/0xd9f4181e0d27e312 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946054.995470:0:17163:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d4092afc400/0xd9f4181e0d27e312 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946054.995477:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d4092afc400/0xd9f4181e0d27e312 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946054.995483:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d4092afc400/0xd9f4181e0d27e312 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1790946055.025157:0:17126:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1790946055.025716:0:17126:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1790946055.025814:0:17187:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1790946055.025823:0:17187:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1790946055.026083:0:17188:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1790946055.026404:0:17126:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1790946055.026887:0:17188:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:3.0:1790946055.027751:0:17189:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9d3f84414e00 x1877942638645248/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946055.027764:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4090cc2180 going to sleep for 0 seconds 00000040:01000000:0.0:1790946055.028125:0:17126:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1790946055.028162:0:17126:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1790946055.031683:0:17126:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1790946055.031708:0:17126:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1790946055.031828:0:17126:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790946055.033010:0:17126:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1790946055.034159:0:17188:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1790946055.034872:0:17188:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1790946055.035001:0:17126:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1790946055.035047:0:17126:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1790946055.036820:0:17126:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:3.0:1790946055.041815:0:17126:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1790946055.043565:0:17126:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1790946055.043603:0:17126:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb827c160b988 00100000:10000000:3.0:1790946055.043611:0:17126:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1790946055.044355:0:17126:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790946055.044370:0:17126:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.120@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790946055.044387:0:17126:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1790946055.044403:0:17126:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1790946055.051848:0:17126:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790946055.052054:0:17126:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790946055.455448:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790946055.973204:0:17181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790946056.033328:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4090cc2180 going to sleep for 0 seconds 10000000:01000000:2.0:1790946056.035852:0:17144:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790946056.035862:0:17144:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d3f81bb7000 from 7 10000000:01000000:2.0:1790946056.035867:0:17144:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790946056.035919:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65600/0xd9f4181e0d27e319 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946056.035942:0:17144:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65600/0xd9f4181e0d27e319 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946056.035954:0:17144:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65600/0xd9f4181e0d27e319 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946056.035995:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638645376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790946056.036069:0:17144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946056.036125:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40af69e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790946056.036341:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638645376 00000100:00100000:3.0:1790946056.036352:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638645376 00000100:00100000:3.0:1790946056.036411:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790946056.036420:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+11:17144:x1877942638645376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790946056.036440:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946056.036460:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40baef1200/0xd9f4181e0d27e320 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27e319 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946056.036487:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40baef1200/0xd9f4181e0d27e320 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27e319 expref: 12 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946056.036499:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40baef1200/0xd9f4181e0d27e320 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27e319 expref: 12 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946056.036508:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40baef1200, rc 0) 00000100:00100000:3.0:1790946056.036565:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+12:17144:x1877942638645376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946056.036571:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790946056.036821:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638645376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790946056.036841:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65600/0xd9f4181e0d27e319 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e320 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946056.036851:0:17144:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65600/0xd9f4181e0d27e319 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e320 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946056.036908:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638645504:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790946056.036945:0:17144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946056.036975:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40baf053c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790946056.036987:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638645504 00000100:00100000:3.0:1790946056.036992:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638645504 00000100:00100000:3.0:1790946056.037024:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790946056.037032:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+12:17144:x1877942638645504:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1790946056.037045:0:17141:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790946056.037074:0:17141:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790946056.037077:0:17141:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1790946056.037193:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+12:17144:x1877942638645504:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 162us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946056.037200:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790946056.037273:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638645504:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1790946056.037318:0:17144:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790946056.037326:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65600/0xd9f4181e0d27e319 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e320 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946056.037335:0:17144:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65600/0xd9f4181e0d27e319 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e320 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946056.486689:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790946056.991832:0:17181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790946057.055827:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4090cc2180 going to sleep for 0 seconds 00010000:00010000:2.0:1790946057.515954:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946058.082459:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4090cc2180 going to sleep for 0 seconds 00010000:00010000:2.0:1790946058.527364:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946059.103239:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4090cc2180 going to sleep for 0 seconds 00010000:00010000:2.0:1790946059.551947:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790946060.108743:0:17432:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1790946060.127825:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4090cc2180 going to sleep for 0 seconds 00000100:00080000:1.0:1790946060.128231:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1790946060.128236:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1790946060.128239:0:8:0:(import.c:65:import_set_state_nolock()) ffff9d40bb1a6800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790946060.128246:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 505 00000100:00080000:1.0:1790946060.128252:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1790946060.128262:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9d40bb1a6800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1790946060.128284:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d40b4d02300 x1877942638645760/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790946060.128296:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790946060.128300:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790946060.128302:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790946060.128305:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790946060.128308:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1790946060.128311:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1790946060.128313:0:8:0:(import.c:65:import_set_state_nolock()) ffff9d40bff0f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790946060.128318:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9d40bff0f000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1790946060.128342:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d40b4d00a80 x1877942638645888/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790946060.128406:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790946060.128416:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:87d8d138-d2ce-4761-a98a-4e847b9142bd:3648:1877942638645632:0@lo:400:kworker.0 00000100:00100000:1.0:1790946060.128496:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946060.128635:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638645760:0@lo:38:kworker.0 00000100:00100000:2.0:1790946060.128732:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946060.128766:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1877942638645888:0@lo:38:kworker.0 00000100:00100000:2.0:1790946060.128791:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946060.128874:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638645632 00000100:00100000:2.0:1790946060.128882:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638645632 00000100:00100000:1.0:1790946060.129031:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638645760 00000100:00100000:1.0:1790946060.129036:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638645760 00000100:00100000:1.0:1790946060.129061:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790946060.129067:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bacece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1877942638645760:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1790946060.129085:0:17153:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790946060.130069:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790946060.130085:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+12:3648:x1877942638645632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946060.130191:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+12:3648:x1877942638645632:12345-0@lo:400:kworker.0 Request processed in 114us (1695us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946060.130199:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790946060.130246:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638645888 00000100:00100000:2.0:1790946060.130253:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638645888 00000100:00100000:2.0:1790946060.130274:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790946060.130279:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bacee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1877942638645888:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1790946060.132030:0:17149:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:2.0:1790946060.132085:0:17149:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xd9f4181e0d27e327 00000004:00100000:2.0:1790946060.132102:0:17149:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790946060.132260:0:17149:0:(import.c:65:import_set_state_nolock()) ffff9d40bff0d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790946060.132345:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bacee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1877942638645888:12345-0@lo:38:kworker.0 Request processed in 2063us (3551us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946060.132354:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790946060.132418:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d40b4d00a80 x1877942638645888/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790946070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790946060.132438:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1790946060.132445:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1790946060.132450:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790946060.132453:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40bff0f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790946060.132459:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1877942638645888:0@lo:38:kworker.0 00000100:00100000:2.0:1790946060.132532:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:87d8d138-d2ce-4761-a98a-4e847b9142bd:3648:1877942638645632:0@lo:400:kworker.0 00000100:00100000:0.0:1790946060.181625:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bacece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1877942638645760:12345-0@lo:38:kworker.0 Request processed in 52539us (52874us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790946060.181696:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1790946060.187289:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40bb1a6800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790946060.187303:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790946060.187309:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638645760:0@lo:38:kworker.0 00010000:00010000:1.0:1790946060.578259:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946061.152995:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4090cc2180 going to sleep for 0 seconds 00000020:00000004:3.0:1790946061.411836:0:17497:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790946061.412046:0:17497:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790946061.608776:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946062.177856:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4090cc2180 going to sleep for 0 seconds 00000020:00000004:3.0:1790946062.476351:0:17547:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790946062.480002:0:17547:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790946062.624543:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946063.204283:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4090cc2180 going to sleep for 0 seconds 00010000:00010000:2.0:1790946063.648380:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946064.224498:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4090cc2180 going to sleep for 0 seconds 00000100:00100000:3.0:1790946064.224675:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790946054/real 1790946054] req@ffff9d40b4d00e00 x1877942638642816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946064 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946064.224704:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d40b4d00e00 x1877942638642816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946064 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946064.224714:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790946054/real 1790946054] req@ffff9d3f8265c380 x1877942638642688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946064 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946064.224726:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d3f8265c380 x1877942638642688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946064 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790946064.224744:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40bb1a7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790946064.224774:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790946064.224778:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638642816:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1790946064.224784:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d3f81b10000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790946064.224789:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790946064.224792:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638642688:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1790946064.225460:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40baced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:87d8d138-d2ce-4761-a98a-4e847b9142bd:3648:1877942638646016:0@lo:400:kworker.0 00000100:00080000:2.0:1790946064.225772:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1790946064.225778:0:15915:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1790946064.225781:0:15915:0:(import.c:65:import_set_state_nolock()) ffff9d40bb1a6800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790946064.225787:0:15915:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 510 00000100:00080000:2.0:1790946064.225792:0:15915:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790946064.225802:0:15915:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9d40bb1a6800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1790946064.225897:0:15915:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d40baced500 x1877942638646144/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790946064.225916:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790946064.225919:0:15915:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1790946064.225921:0:15915:0:(import.c:65:import_set_state_nolock()) ffff9d3f81b10000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790946064.225925:0:15915:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 505 00000100:00080000:2.0:1790946064.225927:0:15915:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790946064.225932:0:15915:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9d3f81b10000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1790946064.225944:0:15915:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d40baceea00 x1877942638646272/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790946064.225952:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790946064.225955:0:15915:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790946064.225957:0:15915:0:(import.c:65:import_set_state_nolock()) ffff9d40bb1a7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790946064.225960:0:15915:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 505 00000100:00080000:2.0:1790946064.225971:0:15915:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790946064.225977:0:15915:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d40bb1a7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1790946064.225989:0:15915:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d40bacec700 x1877942638646400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790946064.226032:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877942638646528:0@lo:400:kworker.0 00000100:00100000:2.0:1790946064.227232:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946064.227326:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946064.227756:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638646016 00000100:00100000:3.0:1790946064.227765:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638646016 00000100:00100000:3.0:1790946064.228043:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790946064.228054:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+12:3648:x1877942638646016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946064.228118:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+12:3648:x1877942638646016:12345-0@lo:400:kworker.0 Request processed in 67us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946064.228125:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790946064.228189:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40baced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:87d8d138-d2ce-4761-a98a-4e847b9142bd:3648:1877942638646016:0@lo:400:kworker.0 00000100:00100000:2.0:1790946064.228363:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638646528 00000100:00100000:2.0:1790946064.228368:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638646528 00000100:00100000:2.0:1790946064.228402:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790946064.228409:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bacee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877942638646528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946064.228655:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bacee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877942638646528:12345-0@lo:400:kworker.0 Request processed in 168us (1346us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946064.228662:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790946064.228687:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40baced500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638646144:0@lo:38:kworker.0 00000100:00100000:2.0:1790946064.228720:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946064.228747:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40baceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638646272:0@lo:8:kworker.0 00000400:00000100:2.0:1790946064.228770:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877942638646272 offset 0 length 520: 4 00000100:00100000:2.0:1790946064.228782:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638646400:0@lo:8:kworker.0 00000400:00000100:2.0:1790946064.228799:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877942638646400 offset 0 length 520: 4 00000100:00100000:2.0:1790946064.229048:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638646144 00000100:00100000:2.0:1790946064.229053:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638646144 00000100:00100000:2.0:1790946064.229119:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790946064.229124:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40baceca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1877942638646144:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1790946064.229141:0:17152:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1790946064.237757:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d40bacef480 x1877942638646528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946064.237774:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877942638646528:0@lo:400:kworker.0 00000100:00100000:2.0:1790946064.253022:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40baceca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1877942638646144:12345-0@lo:38:kworker.0 Request processed in 23888us (24293us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790946064.253048:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1790946064.253237:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40bb1a6800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790946064.253244:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790946064.253249:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40baced500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638646144:0@lo:38:kworker.0 00010000:00010000:3.0:1790946064.673837:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946065.247355:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4090cc2180 going to sleep for 0 seconds 00010000:00010000:1.0:1790946065.702944:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790946066.208812:0:17181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790946066.271359:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4090cc2180 going to sleep for 0 seconds 00010000:00010000:2.0:1790946066.726323:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946067.296311:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4090cc2180 going to sleep for 0 seconds 00010000:00010000:1.0:1790946067.743574:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946068.322744:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4090cc2180 going to sleep for 0 seconds 00010000:00010000:2.0:1790946068.767504:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790946069.315733:0:17892:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790946069.315738:0:17892:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1790946069.315739:0:17892:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1790946069.315854:0:17892:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9d40871f9800 00000020:01000004:2.0:1790946069.315873:0:17892:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1790946069.315888:0:17892:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1790946069.315902:0:17892:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9d3f836cb380) 00000020:00000080:2.0:1790946069.315918:0:17892:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00000100:00100000:2.0:1790946069.345271:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4090cc2180 going to sleep for 0 seconds 00000100:00080000:1.0:1790946069.345610:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1790946069.345615:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1790946069.345619:0:36:0:(import.c:65:import_set_state_nolock()) ffff9d40bb1a6800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790946069.345626:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 515 00000100:00080000:1.0:1790946069.345632:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1790946069.345644:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9d40bb1a6800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1790946069.345647:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:87d8d138-d2ce-4761-a98a-4e847b9142bd:3650:1877942638646656:0@lo:400:kworker.0 00000100:00100000:1.0:1790946069.345665:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d40b4d01180 x1877942638646784/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790946069.345686:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790946069.345690:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790946069.345692:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790946069.345695:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790946069.345720:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946069.345751:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638646784:0@lo:38:kworker.0 00000100:00100000:1.0:1790946069.345786:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946069.345839:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638646912:0@lo:400:kworker.0 00000100:00100000:1.0:1790946069.345867:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946069.345900:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638646912 00000100:00100000:1.0:1790946069.345908:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638646912 00000100:00100000:1.0:1790946069.345954:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790946069.345962:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638646912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946069.345973:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638646784 00000100:00100000:2.0:1790946069.345977:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638646784 00000100:00100000:2.0:1790946069.345996:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790946069.346001:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1877942638646784:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1790946069.346009:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638646912:12345-0@lo:400:kworker.0 Request processed in 49us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946069.346015:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00020000:2.0:1790946069.346018:0:17153:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1790946069.346051:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d40b4d00e00 x1877942638646912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946069.346254:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638646656 00000100:00100000:0.0:1790946069.346259:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638646656 00000100:00100000:0.0:1790946069.346290:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790946069.346296:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+12:3650:x1877942638646656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946069.346335:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+12:3650:x1877942638646656:12345-0@lo:400:kworker.0 Request processed in 39us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946069.346351:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790946069.346393:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:87d8d138-d2ce-4761-a98a-4e847b9142bd:3650:1877942638646656:0@lo:400:kworker.0 00000100:00100000:1.0:1790946069.346481:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638646912:0@lo:400:kworker.0 00000100:00100000:0.0:1790946069.378277:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1877942638646784:12345-0@lo:38:kworker.0 Request processed in 32267us (32483us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790946069.378293:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1790946069.381025:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40bb1a6800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790946069.381035:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790946069.381040:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638646784:0@lo:38:kworker.0 00100000:10000000:3.0:1790946069.394037:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1790946069.394842:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1790946069.396781:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1790946069.397080:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1790946069.397600:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:0.0:1790946069.398228:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1790946069.398676:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1790946069.398852:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1790946069.399022:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:0.0:1790946069.399363:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1790946069.399548:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1790946069.399715:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1790946069.399886:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1790946069.400055:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1790946069.400316:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1790946069.400478:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:0.0:1790946069.400658:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1790946069.400823:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1790946069.406763:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1790946069.407992:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:0.0:1790946069.408883:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1790946069.409292:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1790946069.409522:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:0.0:1790946069.409744:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1790946069.410078:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1790946069.413571:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:0.0:1790946069.413997:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:0.0:1790946069.414252:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1790946069.416874:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1790946069.417262:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1790946069.417469:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:0.0:1790946069.417701:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1790946069.417981:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1790946069.418234:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1790946069.420602:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1790946069.420957:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1790946069.421395:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1790946069.421604:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1790946069.421791:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1790946069.421970:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1790946069.422186:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1790946069.422553:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1790946069.422827:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1790946069.423066:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1790946069.423453:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1790946069.423720:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:01000000:1.0:1790946069.424729:0:17892:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1790946069.424936:0:17892:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1790946069.424956:0:17892:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:1.0:1790946069.424967:0:17892:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd9f4181e0d27e335 00000020:01000004:1.0:1790946069.424974:0:17892:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1790946069.424994:0:17892:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.120@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1790946069.424997:0:17892:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1790946069.425002:0:17892:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1790946069.425029:0:17892:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1790946069.425033:0:17892:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.120@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1790946069.430619:0:17892:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.120@tcp ctxt 0 is initialized 00000020:01000004:1.0:1790946069.430663:0:17892:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.120@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1790946069.430668:0:17892:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1790946069.430670:0:17892:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1790946069.430671:0:17892:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790946069.430672:0:17892:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790946069.430673:0:17892:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790946069.430675:0:17892:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790946069.430676:0:17892:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790946069.430678:0:17892:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790946069.430679:0:17892:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790946069.430683:0:17892:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1790946069.430685:0:17892:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790946069.430686:0:17892:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1790946069.430688:0:17892:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790946069.430689:0:17892:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790946069.430690:0:17892:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790946069.430691:0:17892:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790946069.430692:0:17892:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790946069.430693:0:17892:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790946069.430694:0:17892:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790946069.430730:0:17892:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1790946069.430750:0:17892:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638647040:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790946069.430826:0:17892:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946069.430950:0:17892:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4092bb3540 going to sleep for 11 seconds 00000100:00100000:2.0:1790946069.431040:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638647040 00000100:00100000:2.0:1790946069.431051:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638647040 00000100:00100000:2.0:1790946069.431157:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790946069.431200:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+12:17892:x1877942638647040:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790946069.431235:0:17142:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1790946069.431239:0:17142:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1790946069.431259:0:17142:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1790946069.431721:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+12:17892:x1877942638647040:12345-0@lo:253:mount.lustre.0 Request processed in 555us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946069.431730:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790946069.431800:0:17892:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638647040:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790946069.431809:0:17892:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1790946069.431818:0:17892:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790946069.431819:0:17892:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1790946069.431820:0:17892:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790946069.431821:0:17892:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790946069.431822:0:17892:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790946069.431823:0:17892:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790946069.431824:0:17892:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790946069.431825:0:17892:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790946069.431826:0:17892:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1790946069.431843:0:17892:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d40871f9800 from lustre-MDT0001 10000000:01000000:1.0:1790946069.431868:0:17892:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1790946069.431871:0:17892:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1790946069.431877:0:17892:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d40bc9e4d40 local copy 00010000:00010000:1.0:1790946069.431886:0:17892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4092afd400/0xd9f4181e0d27e22b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e232 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946069.431968:0:17892:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638647168:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790946069.431998:0:17892:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946069.432103:0:17892:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4092bb3540 going to sleep for 11 seconds 00000100:00100000:0.0:1790946069.432216:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638647168 00000100:00100000:0.0:1790946069.432222:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638647168 00000100:00100000:0.0:1790946069.432262:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790946069.432271:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+12:17892:x1877942638647168:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790946069.432344:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+12:17892:x1877942638647168:12345-0@lo:501:mount.lustre.0 Request processed in 75us (345us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790946069.432351:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790946069.432445:0:17892:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638647168:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1790946069.432459:0:17892:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1790946069.432476:0:17892:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1790946069.432482:0:17892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4092afd400/0xd9f4181e0d27e22b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e232 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946069.432491:0:17892:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d4092afd400/0xd9f4181e0d27e22b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e232 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790946069.432531:0:17892:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d40871f9800 10000000:01000000:1.0:1790946069.432537:0:17892:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790946069.432541:0:17892:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9d40bc9e4d40 10000000:01000000:1.0:1790946069.432550:0:17892:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1790946069.432554:0:17892:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9d40bc9e4d40 from 1 10000000:01000000:1.0:1790946069.432556:0:17892:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1790946069.432578:0:17892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4092afcc00/0xd9f4181e0d27e33c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946069.432586:0:17892:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d4092afcc00/0xd9f4181e0d27e33c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946069.432594:0:17892:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d4092afcc00/0xd9f4181e0d27e33c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946069.432605:0:17892:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638647296:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790946069.432627:0:17892:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946069.432643:0:17892:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4092bb3540 going to sleep for 11 seconds 00000100:00100000:0.0:1790946069.432820:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638647296 00000100:00100000:0.0:1790946069.432824:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638647296 00000100:00100000:0.0:1790946069.432841:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790946069.432847:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+12:17892:x1877942638647296:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790946069.432856:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946069.432870:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40bcbe1600/0xd9f4181e0d27e343 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27e33c expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946069.432889:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40bcbe1600/0xd9f4181e0d27e343 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27e33c expref: 13 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946069.432911:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40bcbe1600/0xd9f4181e0d27e343 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27e33c expref: 13 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946069.432919:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe1600, rc 0) 00000100:00100000:0.0:1790946069.432957:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+13:17892:x1877942638647296:12345-0@lo:101:mount.lustre.0 Request processed in 109us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946069.432963:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790946069.433027:0:17892:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638647296:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790946069.433040:0:17892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d4092afcc00/0xd9f4181e0d27e33c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e343 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946069.433049:0:17892:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d4092afcc00/0xd9f4181e0d27e33c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e343 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790946069.433063:0:17892:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1790946069.433083:0:17892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4092afcc00/0xd9f4181e0d27e33c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e343 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946069.433090:0:17892:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d4092afcc00/0xd9f4181e0d27e33c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e343 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790946069.433097:0:17892:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9d40871f9800 10000000:01000000:1.0:1790946069.433106:0:17892:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1790946069.433110:0:17892:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9d40871f9800 from 1 10000000:01000000:1.0:1790946069.433112:0:17892:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1790946069.433127:0:17892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4092afc200/0xd9f4181e0d27e34a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946069.433134:0:17892:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d4092afc200/0xd9f4181e0d27e34a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946069.433153:0:17892:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d4092afc200/0xd9f4181e0d27e34a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946069.433187:0:17892:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638647424:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790946069.433212:0:17892:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946069.433227:0:17892:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4092bb3540 going to sleep for 11 seconds 00000100:00100000:0.0:1790946069.433454:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638647424 00000100:00100000:0.0:1790946069.433459:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638647424 00000100:00100000:0.0:1790946069.433479:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790946069.433485:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+13:17892:x1877942638647424:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790946069.433492:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946069.433500:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40bcbe1a00/0xd9f4181e0d27e351 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27e34a expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946069.433526:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40bcbe1a00/0xd9f4181e0d27e351 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27e34a expref: 14 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946069.433534:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40bcbe1a00/0xd9f4181e0d27e351 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27e34a expref: 14 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946069.433540:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe1a00, rc 0) 00000100:00100000:0.0:1790946069.433579:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+14:17892:x1877942638647424:12345-0@lo:101:mount.lustre.0 Request processed in 94us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946069.433585:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790946069.433660:0:17892:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638647424:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790946069.433671:0:17892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d4092afc200/0xd9f4181e0d27e34a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e351 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946069.433678:0:17892:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d4092afc200/0xd9f4181e0d27e34a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e351 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790946069.433688:0:17892:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1790946069.433702:0:17892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4092afc200/0xd9f4181e0d27e34a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e351 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946069.433709:0:17892:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d4092afc200/0xd9f4181e0d27e34a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e351 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790946069.433714:0:17892:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1790946069.433723:0:17892:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790946069.433728:0:17892:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9d40871f9800 10000000:01000000:1.0:1790946069.433731:0:17892:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1790946069.433734:0:17892:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1790946069.433736:0:17892:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1790946069.433750:0:17892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4092afd600/0xd9f4181e0d27e358 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946069.433757:0:17892:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d4092afd600/0xd9f4181e0d27e358 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946069.433764:0:17892:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d4092afd600/0xd9f4181e0d27e358 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946069.433775:0:17892:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638647552:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790946069.433799:0:17892:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946069.433810:0:17892:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4092bb3540 going to sleep for 11 seconds 00000100:00100000:0.0:1790946069.433861:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638647552 00000100:00100000:0.0:1790946069.433866:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638647552 00000100:00100000:0.0:1790946069.433888:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790946069.433894:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+14:17892:x1877942638647552:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790946069.433900:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946069.433908:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40bcbe0e00/0xd9f4181e0d27e35f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27e358 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946069.433921:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40bcbe0e00/0xd9f4181e0d27e35f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27e358 expref: 15 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946069.433929:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40bcbe0e00/0xd9f4181e0d27e35f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27e358 expref: 15 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946069.433935:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe0e00, rc 0) 00000100:00100000:0.0:1790946069.433968:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+15:17892:x1877942638647552:12345-0@lo:101:mount.lustre.0 Request processed in 74us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946069.433974:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790946069.434035:0:17892:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638647552:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790946069.434046:0:17892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d4092afd600/0xd9f4181e0d27e358 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e35f expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946069.434053:0:17892:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d4092afd600/0xd9f4181e0d27e358 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e35f expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790946069.435590:0:17892:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:1.0:1790946069.436106:0:17892:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790946069.447127:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1790946069.447416:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1790946069.447435:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1790946069.447450:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1790946069.447477:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:1.0:1790946069.447493:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:1.0:1790946069.447520:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:1.0:1790946069.447537:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1790946069.447621:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1790946069.447648:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:1.0:1790946069.447663:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:1.0:1790946069.447751:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:1.0:1790946069.447778:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:1.0:1790946069.447798:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1790946069.447812:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1790946069.447826:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:1.0:1790946069.447838:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1790946069.447851:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1790946069.447866:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:1.0:1790946069.447878:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1790946069.447891:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1790946069.447904:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1790946069.447917:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1790946069.447945:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:1.0:1790946069.447951:0:17892:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:1.0:1790946069.448343:0:17892:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638647680:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790946069.448414:0:17892:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946069.448501:0:17892:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4092bb36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790946069.448619:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638647680 00000100:00100000:0.0:1790946069.448627:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638647680 00000100:00100000:0.0:1790946069.448842:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790946069.448853:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+15:17892:x1877942638647680:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790946069.449187:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+15:17892:x1877942638647680:12345-0@lo:501:mount.lustre.0 Request processed in 316us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946069.449196:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790946069.449393:0:17892:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638647680:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790946069.449433:0:17892:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638647808:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790946069.449479:0:17892:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946069.449519:0:17892:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4092bb36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790946069.449546:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638647808 00000100:00100000:3.0:1790946069.449553:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638647808 00000100:00100000:3.0:1790946069.449590:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790946069.449598:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+15:17892:x1877942638647808:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790946069.450627:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+15:17892:x1877942638647808:12345-0@lo:503:mount.lustre.0 Request processed in 1026us (1143us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946069.450638:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790946069.451473:0:17892:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638647808:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790946069.452354:0:17892:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790946069.452456:0:17892:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638647936:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790946069.452540:0:17892:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946069.452650:0:17892:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40917c1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790946069.452876:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638647936 00000100:00100000:0.0:1790946069.452885:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638647936 00000100:00100000:0.0:1790946069.452999:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790946069.453010:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8238b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+15:17892:x1877942638647936:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790946069.454305:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8238b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+15:17892:x1877942638647936:12345-0@lo:502:mount.lustre.0 Request processed in 1291us (1759us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946069.454326:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790946069.454422:0:17892:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638647936:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790946069.454819:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1790946069.454851:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:1.0:1790946069.454868:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:1.0:1790946069.454883:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:1.0:1790946069.454896:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:1.0:1790946069.454910:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:1.0:1790946069.454923:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:1.0:1790946069.454937:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:1.0:1790946069.454950:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:1.0:1790946069.454982:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:1.0:1790946069.455085:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:1.0:1790946069.455106:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:1.0:1790946069.455121:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:1.0:1790946069.455134:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:1.0:1790946069.455148:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:1.0:1790946069.455162:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:1.0:1790946069.455212:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:1.0:1790946069.455227:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:1.0:1790946069.455240:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:1.0:1790946069.455254:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:1.0:1790946069.455265:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:1.0:1790946069.455279:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:1.0:1790946069.455292:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:1.0:1790946069.455308:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:1.0:1790946069.455328:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:1.0:1790946069.455356:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:1.0:1790946069.455371:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:1.0:1790946069.455384:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:1.0:1790946069.455398:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:1.0:1790946069.455411:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:1.0:1790946069.455424:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:1.0:1790946069.455437:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:1.0:1790946069.455452:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:1.0:1790946069.455467:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:1.0:1790946069.455483:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:1.0:1790946069.455495:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:1.0:1790946069.455955:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:1.0:1790946069.455978:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:1.0:1790946069.456072:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:1.0:1790946069.456097:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:1.0:1790946069.456112:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:1.0:1790946069.456128:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:1.0:1790946069.456154:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:1.0:1790946069.456201:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:1.0:1790946069.456259:0:17892:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638648064:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790946069.456686:0:17892:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946069.456737:0:17892:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40917c1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790946069.456878:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638648064 00000100:00100000:3.0:1790946069.456886:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638648064 00000100:00100000:3.0:1790946069.456928:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790946069.456937:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f82388c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+15:17892:x1877942638648064:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790946069.457125:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f82388c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+15:17892:x1877942638648064:12345-0@lo:502:mount.lustre.0 Request processed in 187us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946069.457132:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790946069.457272:0:17892:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638648064:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790946069.457369:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:1.0:1790946069.457381:0:17892:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1790946069.458517:0:17896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790946069.458532:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946069.458534:0:17896:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1790946069.458540:0:17896:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1790946069.458543:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790946069.458559:0:17896:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9d40af68cd40) 00000020:00000080:2.0:1790946069.458581:0:17896:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1790946069.458587:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1790946069.458745:0:17896:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790946069.458753:0:17896:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd9f4181e0d27e36d 00000020:00000080:2.0:1790946069.459085:0:17896:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1790946069.459090:0:17896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790946069.459093:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946069.459095:0:17896:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1790946069.459098:0:17896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790946069.459101:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946069.459103:0:17896:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1790946069.459106:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790946069.459114:0:17896:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9d40af6899c0) 00000020:00000080:2.0:1790946069.459125:0:17896:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1790946069.459129:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1790946069.459131:0:17896:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1790946069.459133:0:17896:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1790946069.459155:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790946069.459220:0:17896:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d40871f9800 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1790946069.459231:0:17896:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9d40af68b380) 00000020:00000080:2.0:1790946069.459238:0:17896:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1790946069.459307:0:17896:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1790946069.459313:0:17896:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd9f4181e0d27e382 00000020:00000080:2.0:1790946069.459403:0:17896:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1790946069.459411:0:17896:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1790946069.459415:0:17896:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xd9f4181e0d27e389 00080000:01000000:2.0:1790946069.459421:0:17896:0:(osd_handler.c:8931:osd_obd_connect()) connect #2 00000020:00000080:2.0:1790946069.459424:0:17896:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd9f4181e0d27e390 00010000:00010000:0.0:1790946069.540057:0:17896:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:0.0:1790946069.540826:0:17896:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:0.0:1790946069.541269:0:17896:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1790946069.543308:0:17896:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1790946069.543323:0:17896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790946069.543353:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946069.543356:0:17896:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1790946069.543380:0:17896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790946069.543387:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946069.543396:0:17896:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1790946069.543400:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790946069.543425:0:17896:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.120@tcp to nid 0x20000c0a8cc78 (192.168.204.120@tcp) 00000020:00000080:1.0:1790946069.543452:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790946069.543468:0:17896:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9d40bfe919c0) 00000020:00000080:1.0:1790946069.543489:0:17896:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1790946069.543494:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790946069.543576:0:17896:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1790946069.543583:0:17896:0:(osd_handler.c:8931:osd_obd_connect()) connect #3 00000020:00000080:1.0:1790946069.543590:0:17896:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd9f4181e0d27e39e 00010000:00080000:1.0:1790946069.543637:0:17896:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d40914e4000@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.120@tcp at head 00010000:00010000:1.0:1790946069.547031:0:17896:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1790946069.550030:0:17896:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1790946069.550048:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1790946069.550089:0:17896:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1790946069.550113:0:17896:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd9f4181e0d27e3a5 00000100:00080000:2.0:1790946069.550123:0:17896:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790946069.550136:0:17896:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9d40914e4000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1790946069.550250:0:17896:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d40baced880 x1877942638648192/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790946069.550318:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40baced880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638648192:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790946069.550391:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790946069.550459:0:17896:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1790946069.550526:0:17896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790946069.550531:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946069.550533:0:17896:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1790946069.550536:0:17896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790946069.550538:0:17896:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1790946069.550540:0:17896:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790946069.550542:0:17896:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790946069.550543:0:17896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790946069.550545:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946069.550547:0:17896:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790946069.550550:0:17896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790946069.550554:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946069.550561:0:17896:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1790946069.550566:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1790946069.550598:0:17896:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1790946069.550610:0:17896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790946069.550613:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946069.550614:0:17896:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1790946069.550617:0:17896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790946069.550618:0:17896:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1790946069.550619:0:17896:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790946069.550621:0:17896:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790946069.550623:0:17896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790946069.550625:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946069.550627:0:17896:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790946069.550629:0:17896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790946069.550632:0:17896:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1790946069.550634:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946069.550636:0:17896:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1790946069.550638:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790946069.550642:0:17896:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.120@tcp to nid 0x20000c0a8cc78 (192.168.204.120@tcp) 00000020:01000000:2.0:1790946069.550660:0:17896:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1790946069.550663:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000100:00100000:0.0:1790946069.550685:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638648192 00000020:00000080:2.0:1790946069.550688:0:17896:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9d40af688000) 00000100:00100000:0.0:1790946069.550694:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638648192 00000020:00000080:2.0:1790946069.550702:0:17896:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1790946069.550709:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1790946069.550730:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790946069.550739:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1877942638648192:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1790946069.550764:0:17152:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 520 last 0 00000004:00080000:2.0:1790946069.550774:0:17896:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1790946069.550783:0:17896:0:(osd_handler.c:8931:osd_obd_connect()) connect #4 00000020:00000080:2.0:1790946069.550792:0:17896:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd9f4181e0d27e3ba 00000020:00000080:0.0:1790946069.550796:0:17152:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd9f4181e0d27e3b3 00000004:00100000:0.0:1790946069.550813:0:17152:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1790946069.550819:0:17152:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00080000:2.0:1790946069.550821:0:17896:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d4099032000@lustre-OST0000-osc-MDT0001: add connection 192.168.204.120@tcp at head 00010000:00010000:2.0:1790946069.551014:0:17896:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:0.0:1790946069.551254:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790946069.551260:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790946069.551263:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790946069.551266:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:01000000:2.0:1790946069.552104:0:17896:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1790946069.552470:0:17896:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1790946069.554289:0:17896:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790946069.554556:0:17896:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1790946069.555586:0:17896:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:0.0:1790946069.556831:0:17901:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1790946069.556837:0:17901:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00080000:1.0:1790946069.558002:0:17152:0:(import.c:65:import_set_state_nolock()) ffff9d40bfee1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790946069.558105:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1877942638648192:12345-0@lo:38:llog_process_th.0 Request processed in 7364us (7713us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946069.558116:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790946069.558294:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790946069.558304:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1790946069.558312:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1790946069.558317:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790946069.558320:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40914e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790946069.558338:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40baced880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638648192:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790946069.558478:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790946069.558491:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638648320:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790946069.558552:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946069.558638:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638648320 00000100:00100000:1.0:1790946069.558644:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638648320 00000100:00100000:1.0:1790946069.558695:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790946069.558704:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40baced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1877942638648320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790946069.558732:0:17153:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1790946069.558785:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40baced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1877942638648320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946069.558792:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790946069.558824:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638648320:0@lo:41:osp-pre-0-1.0 00000020:00000080:2.0:1790946069.559590:0:17896:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1790946069.559608:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790946069.559659:0:17896:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1790946069.559750:0:17896:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd9f4181e0d27e3c1 00000100:00080000:2.0:1790946069.559758:0:17896:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790946069.559834:0:17896:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9d4099032000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1790946069.559863:0:17896:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d40baced500 x1877942638648448/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790946069.559916:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40baced500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638648448:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1790946069.559967:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877942638648448 offset 0 length 520: 4 00000100:00080000:2.0:1790946069.560015:0:17896:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1790946069.560076:0:17896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790946069.560080:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946069.560082:0:17896:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1790946069.560086:0:17896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790946069.560088:0:17896:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1790946069.560090:0:17896:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790946069.560091:0:17896:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790946069.560092:0:17896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790946069.560095:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946069.560096:0:17896:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790946069.560098:0:17896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790946069.560102:0:17896:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1790946069.560105:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946069.560107:0:17896:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1790946069.560109:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790946069.560113:0:17896:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.120@tcp to nid 0x20000c0a8cc78 (192.168.204.120@tcp) 00000020:01000000:2.0:1790946069.560136:0:17896:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1790946069.560155:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790946069.560190:0:17896:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9d40bca80000) 00000020:00000080:2.0:1790946069.560204:0:17896:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1790946069.560210:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790946069.560276:0:17896:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1790946069.560301:0:17896:0:(osd_handler.c:8931:osd_obd_connect()) connect #5 00000020:00000080:2.0:1790946069.560388:0:17896:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd9f4181e0d27e3cf 00010000:00080000:2.0:1790946069.560416:0:17896:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d40914e2800@lustre-OST0001-osc-MDT0001: add connection 192.168.204.120@tcp at head 00010000:00010000:2.0:1790946069.560655:0:17896:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000100:00080000:1.0:1790946069.560944:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790946069.560954:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790946069.560957:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790946069.560960:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:01000000:2.0:1790946069.561068:0:17896:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1790946069.561084:0:17896:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1790946069.563975:0:17896:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790946069.564258:0:17896:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1790946069.564392:0:17896:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1790946069.565205:0:17903:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1790946069.565210:0:17903:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1790946069.565771:0:17896:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1790946069.565783:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1790946069.565831:0:17896:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1790946069.565858:0:17896:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd9f4181e0d27e3d6 00000100:00080000:3.0:1790946069.565874:0:17896:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790946069.565885:0:17896:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9d40914e2800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1790946069.565918:0:17896:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f84417100 x1877942638648576/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790946069.565946:0:17896:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1790946069.566014:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790946069.566019:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790946069.566021:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790946069.566024:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790946069.566198:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84417100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638648576:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1790946069.566256:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877942638648576 offset 0 length 520: 4 00000020:01000000:3.0:1790946069.566317:0:17896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790946069.566322:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946069.566324:0:17896:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1790946069.566328:0:17896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790946069.566331:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946069.566332:0:17896:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790946069.566335:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790946069.566337:0:17896:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1790946069.566339:0:17896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790946069.566342:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946069.566343:0:17896:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1790946069.566346:0:17896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790946069.566348:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946069.566349:0:17896:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1790946069.566353:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1790946069.566376:0:17896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790946069.566379:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946069.566380:0:17896:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1790946069.566383:0:17896:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:1.0:1790946069.566564:0:17892:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1790946069.566598:0:17892:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1790946069.566620:0:17892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4092afd600/0xd9f4181e0d27e358 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e35f expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946069.566632:0:17892:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d4092afd600/0xd9f4181e0d27e358 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e35f expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790946069.566640:0:17892:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d40871f9800 from 1 10000000:01000000:1.0:1790946069.566643:0:17892:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790946069.566671:0:17892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4092afce00/0xd9f4181e0d27e3dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946069.566685:0:17892:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d4092afce00/0xd9f4181e0d27e3dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946069.566695:0:17892:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d4092afce00/0xd9f4181e0d27e3dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946069.566711:0:17892:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d00a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638648704:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790946069.566756:0:17892:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946069.566772:0:17892:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40917c1840 going to sleep for 11 seconds 00000100:00100000:0.0:1790946069.566910:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638648704 00000100:00100000:0.0:1790946069.566918:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638648704 00000100:00100000:0.0:1790946069.567019:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790946069.567032:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f82388850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+15:17892:x1877942638648704:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790946069.567047:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946069.567058:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40bcbe0200/0xd9f4181e0d27e3e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27e3dd expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946069.567082:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40bcbe0200/0xd9f4181e0d27e3e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27e3dd expref: 16 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946069.567092:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40bcbe0200/0xd9f4181e0d27e3e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27e3dd expref: 16 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946069.567100:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe0200, rc 0) 00000100:00100000:0.0:1790946069.567145:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f82388850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+16:17892:x1877942638648704:12345-0@lo:101:mount.lustre.0 Request processed in 114us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946069.567152:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790946069.567264:0:17892:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d00a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638648704:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790946069.567280:0:17892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d4092afce00/0xd9f4181e0d27e3dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e3e4 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946069.567289:0:17892:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d4092afce00/0xd9f4181e0d27e3dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e3e4 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946069.568004:0:17892:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d00a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638648832:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1790946069.568051:0:17892:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946069.568135:0:17892:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40917c1840 going to sleep for 11 seconds 00000100:00100000:3.0:1790946069.568215:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638648832 00000100:00100000:3.0:1790946069.568221:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638648832 00000100:00100000:3.0:1790946069.568265:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790946069.568273:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f82388050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+16:17892:x1877942638648832:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1790946069.568294:0:17140:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1790946069.568312:0:17140:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1790946069.568315:0:17140:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1790946069.568757:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f82388050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+16:17892:x1877942638648832:12345-0@lo:256:mount.lustre.0 Request processed in 484us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946069.568767:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790946069.568841:0:17892:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d00a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638648832:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1790946069.570476:0:17892:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790946069.570497:0:17892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4092afce00/0xd9f4181e0d27e3dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e3e4 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946069.570524:0:17892:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d4092afce00/0xd9f4181e0d27e3dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e3e4 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790946069.570533:0:17892:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d40871f9800 from 1 10000000:01000000:1.0:1790946069.570536:0:17892:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790946069.570571:0:17892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4092afde00/0xd9f4181e0d27e3eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946069.570579:0:17892:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d4092afde00/0xd9f4181e0d27e3eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946069.570605:0:17892:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d4092afde00/0xd9f4181e0d27e3eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946069.570625:0:17892:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d00a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638648960:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790946069.570682:0:17892:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946069.570733:0:17892:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40917c1840 going to sleep for 11 seconds 00000100:00100000:2.0:1790946069.571055:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638648960 00000100:00100000:2.0:1790946069.571062:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638648960 00000100:00100000:2.0:1790946069.571112:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790946069.571120:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8238a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+16:17892:x1877942638648960:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790946069.571132:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946069.571146:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3f83c64e00/0xd9f4181e0d27e3f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27e3eb expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946069.571277:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3f83c64e00/0xd9f4181e0d27e3f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27e3eb expref: 17 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946069.571288:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3f83c64e00/0xd9f4181e0d27e3f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27e3eb expref: 17 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946069.571296:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c64e00, rc 0) 00000100:00100000:2.0:1790946069.571455:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8238a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+17:17892:x1877942638648960:12345-0@lo:101:mount.lustre.0 Request processed in 336us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946069.571473:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790946069.571811:0:17892:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d00a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638648960:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790946069.571895:0:17892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d4092afde00/0xd9f4181e0d27e3eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e3f2 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946069.571905:0:17892:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d4092afde00/0xd9f4181e0d27e3eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e3f2 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790946069.572034:0:17892:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790946069.572069:0:17892:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84417800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638649088:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790946069.572101:0:17892:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946069.572267:0:17892:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096c2b840 going to sleep for 11 seconds 00000100:00100000:0.0:1790946069.572364:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638649088 00000100:00100000:0.0:1790946069.572370:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638649088 00000100:00100000:0.0:1790946069.572437:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790946069.572444:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8238a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+17:17892:x1877942638649088:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790946069.572540:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8238a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+17:17892:x1877942638649088:12345-0@lo:501:mount.lustre.0 Request processed in 96us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946069.572556:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790946069.572613:0:17892:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84417800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638649088:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790946069.572641:0:17892:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84417800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638649216:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790946069.572678:0:17892:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946069.572741:0:17892:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096c2b840 going to sleep for 11 seconds 00000100:00100000:1.0:1790946069.572800:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638649216 00000100:00100000:1.0:1790946069.572805:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638649216 00000100:00100000:1.0:1790946069.572836:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790946069.572843:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8238a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+17:17892:x1877942638649216:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790946069.572918:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8238a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+17:17892:x1877942638649216:12345-0@lo:503:mount.lustre.0 Request processed in 75us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946069.572924:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790946069.572992:0:17892:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84417800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638649216:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790946069.573338:0:17892:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790946069.573394:0:17892:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84417800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638649344:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790946069.573427:0:17892:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946069.573456:0:17892:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096c2be40 going to sleep for 11 seconds 00000100:00100000:1.0:1790946069.573513:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638649344 00000100:00100000:1.0:1790946069.573518:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638649344 00000100:00100000:1.0:1790946069.573537:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790946069.573543:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8238b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+17:17892:x1877942638649344:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790946069.573625:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8238b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+17:17892:x1877942638649344:12345-0@lo:502:mount.lustre.0 Request processed in 81us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946069.573631:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790946069.573704:0:17892:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84417800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638649344:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790946069.573910:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1790946069.573947:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:3.0:1790946069.573963:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:3.0:1790946069.573977:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:3.0:1790946069.573991:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:3.0:1790946069.574006:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:3.0:1790946069.574020:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:3.0:1790946069.574033:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:3.0:1790946069.574047:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1790946069.574077:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:3.0:1790946069.574093:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:3.0:1790946069.574113:0:17892:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84417800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638649472:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790946069.574147:0:17892:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946069.574201:0:17892:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096c2be40 going to sleep for 11 seconds 00000100:00100000:1.0:1790946069.574252:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638649472 00000100:00100000:1.0:1790946069.574257:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638649472 00000100:00100000:1.0:1790946069.574277:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790946069.574284:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f82389050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+17:17892:x1877942638649472:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790946069.574358:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f82389050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+17:17892:x1877942638649472:12345-0@lo:502:mount.lustre.0 Request processed in 74us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946069.574371:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790946069.574531:0:17892:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84417800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638649472:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790946069.574570:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:3.0:1790946069.574577:0:17892:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1790946069.575015:0:17905:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790946069.575025:0:17905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946069.575028:0:17905:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790946069.575035:0:17905:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d40871f9800 00000020:00000080:1.0:1790946069.575037:0:17905:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790946069.575045:0:17905:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790946069.575047:0:17905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946069.575048:0:17905:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1790946069.575050:0:17905:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790946069.575052:0:17905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946069.575054:0:17905:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790946069.575057:0:17905:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d40871f9800 00000020:00000080:1.0:1790946069.575059:0:17905:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790946069.575119:0:17905:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790946069.575124:0:17905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946069.575125:0:17905:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1790946069.575127:0:17905:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790946069.575129:0:17905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946069.575131:0:17905:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790946069.575134:0:17905:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d40871f9800 00000020:00000080:1.0:1790946069.575136:0:17905:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790946069.575154:0:17905:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790946069.575157:0:17905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946069.575159:0:17905:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790946069.575161:0:17905:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790946069.575163:0:17905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946069.575164:0:17905:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1790946069.575198:0:17905:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d40871f9800 00000020:00000080:1.0:1790946069.575200:0:17905:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790946069.575223:0:17905:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790946069.575226:0:17905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946069.575232:0:17905:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1790946069.575236:0:17905:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:2.0:1790946069.579532:0:17892:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1790946069.579751:0:17892:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790946069.579940:0:17892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4092afde00/0xd9f4181e0d27e3eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e3f2 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946069.579954:0:17892:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d4092afde00/0xd9f4181e0d27e3eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e3f2 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946069.580362:0:17892:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790946069.580366:0:17892:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d40871f9800 10000000:01000000:2.0:1790946069.580369:0:17892:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d40871f9800 10000000:01000000:2.0:1790946069.580374:0:17892:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790946069.580380:0:17892:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d40871f9800 from 1 10000000:01000000:2.0:1790946069.580382:0:17892:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790946069.580418:0:17892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64400/0xd9f4181e0d27e3f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946069.580428:0:17892:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64400/0xd9f4181e0d27e3f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946069.580488:0:17892:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64400/0xd9f4181e0d27e3f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946069.580525:0:17892:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638649600:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790946069.580610:0:17892:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946069.580649:0:17892:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4084a4acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790946069.581039:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638649600 00000100:00100000:1.0:1790946069.581046:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638649600 00000100:00100000:1.0:1790946069.581102:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790946069.581112:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8238b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+17:17892:x1877942638649600:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790946069.581125:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946069.581138:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d4092afda00/0xd9f4181e0d27e400 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27e3f9 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946069.581161:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d4092afda00/0xd9f4181e0d27e400 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27e3f9 expref: 18 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946069.581189:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d4092afda00/0xd9f4181e0d27e400 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27e3f9 expref: 18 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946069.581197:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4092afda00, rc 0) 00000100:00100000:1.0:1790946069.581240:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8238b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+18:17892:x1877942638649600:12345-0@lo:101:mount.lustre.0 Request processed in 130us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946069.581247:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790946069.581311:0:17892:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638649600:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790946069.581327:0:17892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64400/0xd9f4181e0d27e3f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e400 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946069.581335:0:17892:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64400/0xd9f4181e0d27e3f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e400 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790946069.588814:0:17892:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1790946069.589120:0:17892:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790946069.589386:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1790946069.589413:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:1.0:1790946069.589427:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:1.0:1790946069.589441:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:1.0:1790946069.589455:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:1.0:1790946069.589483:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:1.0:1790946069.589498:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:1.0:1790946069.589525:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:1.0:1790946069.589540:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:1.0:1790946069.589552:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:1.0:1790946069.589579:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:1.0:1790946069.589596:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:1.0:1790946069.589610:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:1.0:1790946069.589623:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:1.0:1790946069.589637:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:1.0:1790946069.589650:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:1.0:1790946069.589663:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:1.0:1790946069.589677:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:1.0:1790946069.589691:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:1.0:1790946069.589705:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:1.0:1790946069.589718:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:1.0:1790946069.589732:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:1.0:1790946069.589745:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:1.0:1790946069.589761:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:1.0:1790946069.589776:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:1.0:1790946069.589792:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:1.0:1790946069.589819:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:1.0:1790946069.589835:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:1.0:1790946069.589856:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:1.0:1790946069.589862:0:17892:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1790946069.589947:0:17892:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d02680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638649728:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790946069.590015:0:17892:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946069.590074:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638649728 00000100:00100000:1.0:1790946069.590082:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638649728 00000100:00100000:1.0:1790946069.590123:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790946069.590132:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f82389c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+18:17892:x1877942638649728:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790946069.590265:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f82389c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+18:17892:x1877942638649728:12345-0@lo:501:mount.lustre.0 Request processed in 133us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946069.590273:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790946069.590318:0:17892:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bad110c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790946069.590341:0:17892:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d02680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638649728:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790946069.590371:0:17892:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d02680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638649856:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790946069.590406:0:17892:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946069.590428:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638649856 00000100:00100000:1.0:1790946069.590431:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638649856 00000100:00100000:1.0:1790946069.590453:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790946069.590459:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f82389450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+18:17892:x1877942638649856:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790946069.590537:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f82389450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+18:17892:x1877942638649856:12345-0@lo:503:mount.lustre.0 Request processed in 78us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946069.590544:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790946069.590575:0:17892:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bad110c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790946069.590586:0:17892:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d02680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638649856:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790946069.590923:0:17892:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790946069.590979:0:17892:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d02680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638649984:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790946069.591016:0:17892:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946069.591042:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638649984 00000100:00100000:1.0:1790946069.591047:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638649984 00000100:00100000:1.0:1790946069.591073:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790946069.591086:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8238bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+18:17892:x1877942638649984:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790946069.591156:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8238bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+18:17892:x1877942638649984:12345-0@lo:502:mount.lustre.0 Request processed in 70us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946069.591164:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790946069.591246:0:17892:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bad11540 going to sleep for 11 seconds 00000100:00100000:1.0:1790946069.591259:0:17892:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d02680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638649984:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790946069.591406:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1790946069.591429:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:1.0:1790946069.591442:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:1.0:1790946069.591454:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:1.0:1790946069.591468:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:1.0:1790946069.591482:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:1.0:1790946069.591494:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:1.0:1790946069.591526:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:1.0:1790946069.591543:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:1.0:1790946069.591558:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:1.0:1790946069.591573:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:1.0:1790946069.591600:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:1.0:1790946069.591614:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:1.0:1790946069.593241:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:1.0:1790946069.594280:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:1.0:1790946069.594384:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:1.0:1790946069.594405:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:1.0:1790946069.594421:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:1.0:1790946069.594436:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:1.0:1790946069.594451:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:1.0:1790946069.594467:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:1.0:1790946069.594483:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:1.0:1790946069.594498:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:1.0:1790946069.594530:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:1.0:1790946069.594559:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:1.0:1790946069.594576:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:1.0:1790946069.594591:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:1.0:1790946069.594622:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:1.0:1790946069.594640:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:1.0:1790946069.594653:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:1.0:1790946069.594665:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:1.0:1790946069.594679:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:1.0:1790946069.594691:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:1.0:1790946069.594704:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:1.0:1790946069.594717:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:1.0:1790946069.594732:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:1.0:1790946069.594745:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:1.0:1790946069.594758:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:1.0:1790946069.594773:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:1.0:1790946069.594787:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:1.0:1790946069.594800:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:1.0:1790946069.594812:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:1.0:1790946069.595277:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:1.0:1790946069.595916:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:1.0:1790946069.595938:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:1.0:1790946069.595952:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:1.0:1790946069.595965:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:1.0:1790946069.595979:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:1.0:1790946069.596039:0:17892:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d02680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638650112:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790946069.596118:0:17892:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946069.596269:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638650112 00000100:00100000:1.0:1790946069.596269:0:17892:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bad11540 going to sleep for 11 seconds 00000100:00100000:3.0:1790946069.596279:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638650112 00000100:00100000:3.0:1790946069.596335:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790946069.596345:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f82388450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+18:17892:x1877942638650112:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790946069.596468:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f82388450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+18:17892:x1877942638650112:12345-0@lo:502:mount.lustre.0 Request processed in 125us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946069.596476:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790946069.596934:0:17892:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d02680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638650112:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790946069.597118:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:1.0:1790946069.597520:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:1.0:1790946069.597554:0:17892:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d02680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638650240:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790946069.597609:0:17892:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946069.597634:0:17892:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bad11540 going to sleep for 11 seconds 00000100:00100000:3.0:1790946069.599218:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638650240 00000100:00100000:3.0:1790946069.599231:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638650240 00000100:00100000:3.0:1790946069.599290:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790946069.599301:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8238ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+18:17892:x1877942638650240:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790946069.599458:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8238ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+18:17892:x1877942638650240:12345-0@lo:502:mount.lustre.0 Request processed in 159us (1848us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946069.599474:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790946069.599554:0:17892:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d02680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638650240:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790946069.599626:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:1.0:1790946069.599639:0:17892:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1790946069.605598:0:17910:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1790946069.605618:0:17910:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9d40848019c0) 00000020:00000080:3.0:1790946069.605646:0:17910:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1790946069.605733:0:17910:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d40871f9800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1790946069.605738:0:17910:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d40871f9800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1790946069.605741:0:17910:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d40871f9800 3 00010000:00080000:3.0:1790946069.605776:0:17910:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d40871fd800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.120@tcp at head 00010000:00010000:3.0:1790946069.607330:0:17910:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1790946069.609478:0:17910:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1790946069.609550:0:17910:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790946069.609565:0:17910:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xd9f4181e0d27e40e 00000100:00080000:2.0:1790946069.609577:0:17910:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790946069.609589:0:17910:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9d40871fd800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1790946069.609627:0:17910:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d40baced180 x1877942638650368/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790946069.609650:0:17910:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1790946069.609923:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790946069.609929:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790946069.609932:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790946069.609934:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1790946069.610281:0:17910:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:1.0:1790946069.610616:0:17892:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1790946069.610648:0:17892:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00100000:0.0:1790946069.610663:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40baced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1877942638650368:0@lo:38:llog_process_th.0 00010000:00010000:1.0:1790946069.610670:0:17892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64400/0xd9f4181e0d27e3f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e400 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946069.610681:0:17892:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64400/0xd9f4181e0d27e3f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e400 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790946069.610725:0:17892:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000100:00100000:0.0:1790946069.610948:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1790946069.610992:0:17892:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1790946069.610994:0:17892:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790946069.610996:0:17892:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790946069.610998:0:17892:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790946069.611000:0:17892:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790946069.611002:0:17892:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790946069.611004:0:17892:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790946069.611005:0:17892:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790946069.611010:0:17892:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1790946069.611013:0:17892:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790946069.611014:0:17892:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1790946069.611016:0:17892:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000100:00100000:3.0:1790946069.611019:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638650368 00000020:01000004:1.0:1790946069.611025:0:17892:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790946069.611027:0:17892:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790946069.611028:0:17892:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790946069.611029:0:17892:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000100:00100000:3.0:1790946069.611030:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638650368 00000020:01000004:1.0:1790946069.611030:0:17892:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790946069.611031:0:17892:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790946069.611055:0:17892:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1790946069.611069:0:17892:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d02680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638650496:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790946069.611085:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790946069.611095:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1877942638650368:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790946069.611106:0:17892:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1790946069.611121:0:17149:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 520 last 0 00000020:00000080:3.0:1790946069.611158:0:17149:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xd9f4181e0d27e415 00000004:00100000:3.0:1790946069.611188:0:17149:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790946069.611217:0:17149:0:(import.c:65:import_set_state_nolock()) ffff9d40871fd000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790946069.611268:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1877942638650368:12345-0@lo:38:llog_process_th.0 Request processed in 174us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946069.611277:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790946069.611291:0:17892:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bad11540 going to sleep for 11 seconds 00000100:00100000:3.0:1790946069.611309:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638650496 00010000:00080000:0.0:1790946069.611311:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d40baced180 x1877942638650368/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790946079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946069.611316:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638650496 00000100:00100000:0.0:1790946069.611325:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790946069.611332:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1790946069.611340:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1790946069.611345:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790946069.611348:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40871fd800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790946069.611355:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40baced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1877942638650368:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790946069.611360:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790946069.611372:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f82389850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+18:17892:x1877942638650496:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790946069.611395:0:17141:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1790946069.611409:0:17141:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1790946069.615292:0:17127:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1790946069.615497:0:17141:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1790946069.615526:0:17141:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1790946069.615589:0:17163:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790946069.615594:0:17163:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790946069.615627:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d40baef0e00/0xd9f4181e0d27e41c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946069.615646:0:17163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40baef1200/0xd9f4181e0d27e320 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27e319 expref: 18 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946069.615654:0:17163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40bcbe0200/0xd9f4181e0d27e3e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27e3dd expref: 18 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946069.615662:0:17163:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d40baef0e00/0xd9f4181e0d27e41c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946069.615700:0:17163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40bcbe0200/0xd9f4181e0d27e3e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27e3dd expref: 18 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946069.615716:0:17163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40bcbe0200/0xd9f4181e0d27e3e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27e3dd expref: 18 pid: 17141 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946069.615730:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84417800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17163:1877942638650624:0@lo:104: 00000100:00100000:3.0:1790946069.615795:0:17163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790946069.615920:0:17163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40baef1200/0xd9f4181e0d27e320 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27e319 expref: 18 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946069.615929:0:17163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40baef1200/0xd9f4181e0d27e320 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27e319 expref: 18 pid: 17140 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946069.615937:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84415180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17163:1877942638650752:0@lo:104: 00000100:00100000:3.0:1790946069.615960:0:17163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946069.615984:0:17163:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bcac0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790946069.616003:0:17130:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638650624 00000100:00100000:3.0:1790946069.616010:0:17130:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638650624 00000100:00100000:3.0:1790946069.616061:0:17130:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638650752 00000100:00100000:3.0:1790946069.616064:0:17130:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638650752 00000100:00100000:3.0:1790946069.616080:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790946069.616087:0:17130:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84415500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:87d8d138-d2ce-4761-a98a-4e847b9142bd+4:17163:x1877942638650624:12345-0@lo:104: 00010000:00010000:3.0:1790946069.616098:0:17130:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d4092afce00/0xd9f4181e0d27e3dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27e3e4 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946069.616148:0:17130:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790946069.616154:0:17130:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84415500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:87d8d138-d2ce-4761-a98a-4e847b9142bd+4:17163:x1877942638650624:12345-0@lo:104: Request processed in 68us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946069.616161:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790946069.616204:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790946069.616211:0:17130:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84416680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:87d8d138-d2ce-4761-a98a-4e847b9142bd+3:17163:x1877942638650752:12345-0@lo:104: 00010000:00010000:3.0:1790946069.616219:0:17130:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65600/0xd9f4181e0d27e319 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27e320 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946069.616251:0:17130:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790946069.616255:0:17130:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84416680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:87d8d138-d2ce-4761-a98a-4e847b9142bd+3:17163:x1877942638650752:12345-0@lo:104: Request processed in 47us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946069.616261:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1790946069.616276:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790946069.616282:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d4092afce00/0xd9f4181e0d27e3dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27e3e4 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946069.616289:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afce00 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:3.0:1790946069.616292:0:17135:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d4092afce00/0xd9f4181e0d27e3dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27e3e4 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946069.616488:0:17135:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d4092afce00/0xd9f4181e0d27e3dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27e3e4 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790946069.616497:0:17135:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d4092afce00/0xd9f4181e0d27e3dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27e3e4 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946069.616512:0:17135:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790946069.616576:0:17135:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d4092afce00/0xd9f4181e0d27e3dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27e3e4 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946069.616584:0:17135:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790946069.616604:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d4092afce00/0xd9f4181e0d27e3dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27e3e4 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946069.616612:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d4092afce00/0xd9f4181e0d27e3dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27e3e4 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946069.616622:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790946069.616625:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65600/0xd9f4181e0d27e319 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27e320 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946069.616631:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65600 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:3.0:1790946069.616634:0:17135:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65600/0xd9f4181e0d27e319 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27e320 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946069.616640:0:17135:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65600/0xd9f4181e0d27e319 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27e320 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790946069.616647:0:17135:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65600/0xd9f4181e0d27e319 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27e320 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946069.616660:0:17135:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790946069.619791:0:17135:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65600/0xd9f4181e0d27e319 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27e320 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946069.619805:0:17135:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790946069.619927:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65600/0xd9f4181e0d27e319 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27e320 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946069.619937:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65600/0xd9f4181e0d27e319 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27e320 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946069.619958:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946069.619960:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946069.619962:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946069.619970:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946069.619987:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84416d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:87d8d138-d2ce-4761-a98a-4e847b9142bd:3649:1877942638650880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790946069.620048:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946069.620089:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790946069.620096:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:87d8d138-d2ce-4761-a98a-4e847b9142bd:3649:1877942638651008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790946069.620118:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946069.620148:0:17132:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638650880 00000100:00100000:3.0:1790946069.620156:0:17132:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638650880 00010000:00010000:3.0:1790946069.620577:0:17132:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40bcbe0200/0xd9f4181e0d27e3e4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27e3dd expref: 19 pid: 17141 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946069.620604:0:17132:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638651008 00000100:00100000:3.0:1790946069.620607:0:17132:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638651008 00010000:00010000:3.0:1790946069.620620:0:17132:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40baef1200/0xd9f4181e0d27e320 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27e319 expref: 20 pid: 17140 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946069.620648:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790946069.620657:0:17132:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84414a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87d8d138-d2ce-4761-a98a-4e847b9142bd+20:3649:x1877942638650880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790946069.620671:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946069.620676:0:17132:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40bcbe0200/0xd9f4181e0d27e3e4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27e3dd expref: 20 pid: 17141 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946069.620687:0:17132:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40bcbe0200/0xd9f4181e0d27e3e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27e3dd expref: 20 pid: 17141 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946069.620703:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790946069.620740:0:17132:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84414a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87d8d138-d2ce-4761-a98a-4e847b9142bd+20:3649:x1877942638650880:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946069.620746:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790946069.620763:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790946069.620771:0:17132:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84414700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87d8d138-d2ce-4761-a98a-4e847b9142bd+19:3649:x1877942638651008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790946069.620778:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946069.620782:0:17132:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40baef1200/0xd9f4181e0d27e320 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27e319 expref: 19 pid: 17140 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946069.620790:0:17132:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40baef1200/0xd9f4181e0d27e320 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27e319 expref: 19 pid: 17140 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946069.620801:0:17132:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d40baef0e00/0xd9f4181e0d27e41c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946069.620809:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40baef0e00/0xd9f4181e0d27e41c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790946069.620901:0:17132:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005307552s 00010000:00010000:3.0:1790946069.620906:0:17132:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d40baef0e00/0xd9f4181e0d27e41c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946069.620914:0:17132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d40baef0e00/0xd9f4181e0d27e41c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946069.620920:0:17132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d40baef0e00/0xd9f4181e0d27e41c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946069.620927:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d40baef0e00/0xd9f4181e0d27e41c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946069.620933:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef0e00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:3.0:1790946069.620937:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d40baef0e00/0xd9f4181e0d27e41c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946069.620945:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d40baef0e00/0xd9f4181e0d27e41c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946069.620953:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d40baef0e00/0xd9f4181e0d27e41c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946069.620967:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790946069.620992:0:17132:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84414700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87d8d138-d2ce-4761-a98a-4e847b9142bd+19:3649:x1877942638651008:12345-0@lo:103:ldlm_bl.0 Request processed in 223us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946069.620998:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790946069.621038:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:87d8d138-d2ce-4761-a98a-4e847b9142bd:3649:1877942638651008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790946069.621047:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84416d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:87d8d138-d2ce-4761-a98a-4e847b9142bd:3649:1877942638650880:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790946069.621090:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40bcbe0200/0xd9f4181e0d27e3e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27e3dd expref: 18 pid: 17141 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946069.621101:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84417800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17163:1877942638650624:0@lo:104: 00010000:00010000:3.0:1790946069.621112:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40baef1200/0xd9f4181e0d27e320 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27e319 expref: 17 pid: 17140 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946069.621119:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84415180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17163:1877942638650752:0@lo:104: 00010000:00010000:3.0:1790946069.621137:0:17163:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d40baef0e00/0xd9f4181e0d27e41c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946069.621146:0:17163:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d40baef0e00/0xd9f4181e0d27e41c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946069.621152:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d40baef0e00/0xd9f4181e0d27e41c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946069.621158:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40baef0e00/0xd9f4181e0d27e41c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946069.621423:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f82389850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+16:17892:x1877942638650496:12345-0@lo:253:mount.lustre.0 Request processed in 10054us (10316us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946069.621432:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790946069.622162:0:17892:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d02680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:17892:1877942638650496:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790946069.622276:0:17892:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1790946069.622280:0:17892:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790946069.622282:0:17892:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1790946069.622283:0:17892:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790946069.622284:0:17892:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790946069.622286:0:17892:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790946069.622287:0:17892:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790946069.622288:0:17892:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790946069.622290:0:17892:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790946069.622291:0:17892:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790946069.622428:0:17892:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000040:01000000:0.0:1790946069.645374:0:17892:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1790946069.645442:0:17916:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1790946069.645447:0:17916:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1790946069.645660:0:17917:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1790946069.645961:0:17892:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:1.0:1790946069.646617:0:17917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790946069.650662:0:17918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265f800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17918:1877942638651136:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1790946069.650731:0:17918:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946069.650764:0:17918:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f825a9480 going to sleep for 11 seconds 00000040:01000000:2.0:1790946069.650939:0:17892:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1790946069.650980:0:17892:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1790946069.651402:0:17892:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1790946069.651410:0:17892:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1790946069.651445:0:17892:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790946069.652410:0:17892:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1790946069.652422:0:17917:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1790946069.652468:0:17917:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1790946069.652593:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638651136 00000100:00100000:1.0:1790946069.652602:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638651136 00000100:00100000:1.0:1790946069.652646:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790946069.652655:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17918:x1877942638651136:12345-0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1790946069.652944:0:17892:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000100:00100000:1.0:1790946069.652947:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17918:x1877942638651136:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 294us (2215us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946069.652965:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:01000000:2.0:1790946069.652972:0:17892:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1790946069.653061:0:17892:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1790946069.653607:0:17892:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000100:00100000:0.0:1790946069.653980:0:17918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265f800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17918:1877942638651136:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1790946069.654024:0:17918:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1790946069.654071:0:17918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265f800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17918:1877942638651264:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1790946069.654125:0:17918:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946069.654161:0:17918:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f825a9480 going to sleep for 11 seconds 00000100:00100000:1.0:1790946069.654404:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638651264 00000100:00100000:1.0:1790946069.654410:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638651264 00000100:00100000:1.0:1790946069.654443:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790946069.654452:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17918:x1877942638651264:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1790946069.654577:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17918:x1877942638651264:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 126us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946069.654586:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790946069.654617:0:17918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265f800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17918:1877942638651264:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1790946069.654675:0:17918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d02680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17918:1877942638651392:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1790946069.654707:0:17918:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946069.654723:0:17918:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bc9019c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790946069.657324:0:17158:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638651392 00000100:00100000:0.0:1790946069.657335:0:17158:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638651392 00000100:00100000:0.0:1790946069.657391:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790946069.657401:0:17158:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17918:x1877942638651392:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1790946069.657498:0:17158:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17918:x1877942638651392:12345-0@lo:900:lod0001_rec0000.0 Request processed in 99us (2789us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946069.657516:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1790946069.657592:0:17918:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d40b4d02680 x1877942638651392/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790946085 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946069.657606:0:17918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d02680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17918:1877942638651392:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1790946069.657672:0:17918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d02680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17918:1877942638651520:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1790946069.657711:0:17918:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946069.657740:0:17918:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bc901c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790946069.658212:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638651520 00000100:00100000:0.0:1790946069.658218:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638651520 00000100:00100000:0.0:1790946069.658247:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790946069.658255:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17918:x1877942638651520:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1790946069.658341:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17918:x1877942638651520:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 86us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946069.658347:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790946069.658563:0:17918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d02680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17918:1877942638651520:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1790946069.658611:0:17918:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00000004:0.0:1790946069.660576:0:17892:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000040:00080000:2.0:1790946069.662118:0:17918:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1790946069.662212:0:17918:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1790946069.662217:0:17918:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:3.0:1790946069.669294:0:17892:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1790946069.669338:0:17892:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb827c1c73988 00100000:10000000:3.0:1790946069.669346:0:17892:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1790946069.671382:0:17892:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790946069.671417:0:17892:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.120@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790946069.671435:0:17892:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1790946069.671463:0:17892:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1790946069.674602:0:17892:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790946069.675222:0:17892:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790946069.792348:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946070.367275:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4090cc2180 going to sleep for 0 seconds 00000040:00080000:3.0:1790946070.689316:0:17919:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790946070.815472:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946071.392367:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4090cc2180 going to sleep for 0 seconds 10000000:01000000:2.0:1790946071.519256:0:17144:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790946071.519264:0:17144:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d40871f9800 from 8 10000000:01000000:2.0:1790946071.519282:0:17144:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790946071.519335:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64c00/0xd9f4181e0d27e423 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946071.519348:0:17144:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64c00/0xd9f4181e0d27e423 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946071.519359:0:17144:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64c00/0xd9f4181e0d27e423 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946071.519383:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638651648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790946071.519453:0:17144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946071.519572:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408704fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1790946071.520187:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638651648 00000100:00100000:3.0:1790946071.520197:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638651648 00000100:00100000:3.0:1790946071.520261:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790946071.520280:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4a35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+16:17144:x1877942638651648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790946071.520294:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946071.520309:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40baef0e00/0xd9f4181e0d27e42a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27e423 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946071.520334:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40baef0e00/0xd9f4181e0d27e42a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27e423 expref: 17 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946071.520344:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40baef0e00/0xd9f4181e0d27e42a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27e423 expref: 17 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946071.520353:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40baef0e00, rc 0) 00000100:00100000:3.0:1790946071.520508:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4a35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+17:17144:x1877942638651648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 238us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946071.520515:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790946071.522243:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638651648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790946071.522281:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64c00/0xd9f4181e0d27e423 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e42a expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946071.522292:0:17144:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64c00/0xd9f4181e0d27e423 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e42a expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946071.522366:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638651776:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1790946071.522427:0:17144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946071.524077:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638651776 00000100:00100000:3.0:1790946071.524093:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638651776 00000100:00100000:3.0:1790946071.524151:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790946071.524163:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4a37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+17:17144:x1877942638651776:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1790946071.524211:0:17141:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790946071.524241:0:17141:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790946071.524244:0:17141:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1790946071.524371:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4a37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+17:17144:x1877942638651776:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 210us (1942us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946071.524380:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790946071.528552:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408704fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1790946071.528637:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638651776:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1790946071.528729:0:17144:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790946071.528742:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64c00/0xd9f4181e0d27e423 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e42a expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946071.528753:0:17144:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64c00/0xd9f4181e0d27e423 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e42a expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946071.528773:0:17144:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790946071.528777:0:17144:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d3f81bb7000 from 8 10000000:01000000:2.0:1790946071.528779:0:17144:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790946071.528817:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65000/0xd9f4181e0d27e431 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946071.528825:0:17144:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65000/0xd9f4181e0d27e431 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946071.528834:0:17144:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65000/0xd9f4181e0d27e431 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946071.528854:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638651904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790946071.528951:0:17144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946071.530474:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408704fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1790946071.532378:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638651904 00000100:00100000:3.0:1790946071.532392:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638651904 00000100:00100000:3.0:1790946071.532534:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790946071.532545:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4a36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+17:17144:x1877942638651904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790946071.532563:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946071.532581:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40baef1200/0xd9f4181e0d27e438 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27e431 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946071.532609:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40baef1200/0xd9f4181e0d27e438 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27e431 expref: 18 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946071.532621:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40baef1200/0xd9f4181e0d27e438 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27e431 expref: 18 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946071.532630:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40baef1200, rc 0) 00000100:00100000:3.0:1790946071.532717:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4a36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+18:17144:x1877942638651904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (3765us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946071.532724:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790946071.532816:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638651904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790946071.532835:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65000/0xd9f4181e0d27e431 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e438 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946071.532844:0:17144:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65000/0xd9f4181e0d27e431 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e438 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946071.532919:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d03480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638652032:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1790946071.532958:0:17144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946071.534082:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638652032 00000100:00100000:2.0:1790946071.534092:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638652032 00000100:00100000:1.0:1790946071.534115:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4088c76540 going to sleep for 11 seconds 00000100:00100000:2.0:1790946071.534137:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790946071.534146:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4a37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+18:17144:x1877942638652032:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790946071.534187:0:17140:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790946071.534209:0:17140:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790946071.534213:0:17140:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1790946071.534327:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d03480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638652032:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1790946071.534334:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4a37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+18:17144:x1877942638652032:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 186us (1372us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946071.534344:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 10000000:01000000:1.0:1790946071.534384:0:17144:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790946071.534394:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65000/0xd9f4181e0d27e431 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e438 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946071.534403:0:17144:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65000/0xd9f4181e0d27e431 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e438 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790946071.714056:0:17919:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790946071.841159:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946072.417133:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4090cc2180 going to sleep for 0 seconds 00010000:00010000:1.0:1790946072.874840:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946073.441755:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4090cc2180 going to sleep for 0 seconds 00000001:02000400:0.0:1790946073.868936:0:18162:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1790946073.887643:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946074.463493:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4090cc2180 going to sleep for 0 seconds 00000020:00000004:1.0:1790946074.895983:0:18214:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790946074.896458:0:18214:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790946074.923594:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946074.977326:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790946074.977348:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84415180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638652160:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790946074.977442:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946074.977851:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638652160 00000100:00100000:0.0:1790946074.977860:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638652160 00000100:00100000:0.0:1790946074.977904:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790946074.977912:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638652160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790946074.977942:0:17153:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1790946074.977991:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638652160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946074.977999:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790946074.978619:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84415180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638652160:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1790946074.978957:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1790946074.978963:0:15915:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1790946074.978967:0:15915:0:(import.c:65:import_set_state_nolock()) ffff9d40bb1a6800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790946074.978971:0:15915:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 520 00000100:00080000:1.0:1790946074.978975:0:15915:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1790946074.978984:0:15915:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9d40bb1a6800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1790946074.979005:0:15915:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d40b4d00000 x1877942638652416/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790946074.979021:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790946074.979024:0:15915:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790946074.979199:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638652416:0@lo:38:kworker.0 00000100:00100000:0.0:1790946074.979393:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790946074.979412:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:87d8d138-d2ce-4761-a98a-4e847b9142bd:3647:1877942638652288:0@lo:400:kworker.0 00000100:00100000:0.0:1790946074.979461:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946074.979508:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638652288 00000100:00100000:3.0:1790946074.979510:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946074.979514:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638652288 00000100:00100000:3.0:1790946074.979545:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638652416 00000100:00100000:3.0:1790946074.979550:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638652416 00000100:00100000:0.0:1790946074.979557:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790946074.979563:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4a36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+18:3647:x1877942638652288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946074.979609:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4a36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+18:3647:x1877942638652288:12345-0@lo:400:kworker.0 Request processed in 45us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946074.979616:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790946074.979679:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790946074.979685:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84415180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1877942638652416:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1790946074.979712:0:17153:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 525 last 0 00000100:00100000:0.0:1790946074.979738:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:87d8d138-d2ce-4761-a98a-4e847b9142bd:3647:1877942638652288:0@lo:400:kworker.0 00000020:00000080:3.0:1790946074.979748:0:17153:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd9f4181e0d27e43f 00000004:00100000:3.0:1790946074.979765:0:17153:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1790946074.979771:0:17153:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1790946074.979808:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790946074.979811:0:15915:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790946074.979849:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:3.0:1790946074.979851:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:1.0:1790946074.979853:0:15915:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790946074.979856:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790946074.979858:0:15915:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790946074.979860:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877942638652544:0@lo:400:kworker.0 00000100:00100000:3.0:1790946074.979893:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946074.979921:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790946074.979929:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638652672:0@lo:400:kworker.0 00000100:00100000:0.0:1790946074.979956:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946074.980013:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638652544 00000100:00100000:1.0:1790946074.980018:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638652544 00000100:00100000:1.0:1790946074.980136:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638652672 00000100:00100000:1.0:1790946074.980141:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638652672 00000100:00100000:0.0:1790946074.980795:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790946074.980805:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877942638652544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946074.980903:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877942638652544:12345-0@lo:400:kworker.0 Request processed in 99us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946074.980909:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790946074.980925:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790946074.980931:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638652672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946074.980962:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638652672:12345-0@lo:400:kworker.0 Request processed in 32us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946074.980968:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790946074.980997:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d40b4d00700 x1877942638652672/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946074.981010:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638652672:0@lo:400:kworker.0 00010000:00080000:2.0:1790946074.983582:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d40b4d02d80 x1877942638652544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946074.983778:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877942638652544:0@lo:400:kworker.0 00000100:00080000:3.0:1790946074.996829:0:17153:0:(import.c:65:import_set_state_nolock()) ffff9d4099036800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790946074.996939:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84415180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1877942638652416:12345-0@lo:38:kworker.0 Request processed in 17251us (17427us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946074.996950:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790946074.997234:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790946074.997244:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1790946074.997253:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1790946074.997272:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1790946074.997276:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40bb1a6800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1790946074.997301:0:3646:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000000d8621fb): req@ffff9d3f84414e00 x1877942638645248/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946074.997321:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638652416:0@lo:38:kworker.0 00000100:00100000:1.0:1790946074.997526:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790946074.997539:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638652800:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790946074.997566:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946074.997589:0:17189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946074.997609:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4090cc2180 going to sleep for 11 seconds 00000100:00100000:3.0:1790946074.997618:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638645248 00000100:00100000:1.0:1790946074.997618:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638652800 00000100:00100000:3.0:1790946074.997624:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638645248 00000100:00100000:1.0:1790946074.997624:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638652800 00000100:00100000:3.0:1790946074.997652:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790946074.997660:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17189:x1877942638645248:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1790946074.997748:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17189:x1877942638645248:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 89us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946074.997794:0:17189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84414e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17189:1877942638645248:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1790946074.997831:0:17189:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1790946074.997866:0:17189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265f480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17189:1877942638652928:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1790946074.997903:0:17189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946074.997919:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f83421540 going to sleep for 11 seconds 00000100:00100000:3.0:1790946074.999973:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790946075.000009:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638652928 00000100:00100000:3.0:1790946075.000017:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638652928 00000100:00100000:1.0:1790946075.000191:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790946075.000205:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3648:x1877942638652800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790946075.000240:0:17152:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790946075.000330:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3648:x1877942638652800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 130us (2764us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946075.000337:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790946075.000500:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790946075.000507:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17189:x1877942638652928:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1790946075.000808:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17189:x1877942638652928:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 301us (2903us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946075.000816:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790946075.000860:0:17189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265f480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17189:1877942638652928:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1790946075.000954:0:17189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84414000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17189:1877942638653056:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1790946075.000988:0:17189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946075.001010:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f81b86780 going to sleep for 11 seconds 00000100:00100000:3.0:1790946075.001024:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638653056 00000100:00100000:3.0:1790946075.001028:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638653056 00000100:00100000:0.0:1790946075.001247:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638652800:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790946075.001299:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790946075.001316:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17189:x1877942638653056:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1790946075.001387:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17189:x1877942638653056:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 72us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946075.001393:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790946075.001506:0:17189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84414000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17189:1877942638653056:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1790946075.001552:0:17189:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790946075.005617:0:17189:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1790946075.005692:0:17189:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:0.0:1790946075.005696:0:17189:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:2.0:1790946075.856664:0:18265:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790946075.856896:0:18265:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790946075.935719:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790946076.448708:0:17181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:2.0:1790946076.891637:0:18313:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe80ef1f20 20000000:00000080:2.0:1790946076.891657:0:18313:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d4086268c00 uarg=0000000000000000 20000000:01000000:2.0:1790946076.891702:0:18313:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1790946076.891709:0:18313:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1790946076.891714:0:18313:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1790946076.892676:0:18314:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1790946076.892986:0:18313:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1790946076.905861:0:18313:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790946076.906440:0:18313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d3f83c64000/0xd9f4181e0d27e446 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946076.906462:0:18313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d4092afc000/0xd9f4181e0d27e2ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27e2e8 expref: 17 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946076.906483:0:18313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3f83c64e00/0xd9f4181e0d27e3f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27e3eb expref: 17 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946076.906493:0:18313:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d3f83c64000/0xd9f4181e0d27e446 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946076.906542:0:18313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3f83c64e00/0xd9f4181e0d27e3f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27e3eb expref: 17 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946076.906559:0:18313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d3f83c64e00/0xd9f4181e0d27e3f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27e3eb expref: 17 pid: 17141 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946076.906575:0:18313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacef100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18313:1877942638653184:0@lo:104: 00000100:00100000:2.0:1790946076.906751:0:18313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790946076.906824:0:18313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d4092afc000/0xd9f4181e0d27e2ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27e2e8 expref: 17 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946076.906848:0:18313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d4092afc000/0xd9f4181e0d27e2ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27e2e8 expref: 17 pid: 17140 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946076.906857:0:18313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40baceed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18313:1877942638653312:0@lo:104: 00000100:00100000:2.0:1790946076.906884:0:18313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946076.906913:0:18313:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f81b86780 going to sleep for 11 seconds 00000100:00100000:0.0:1790946076.907016:0:17131:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638653184 00000100:00100000:0.0:1790946076.907025:0:17131:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638653184 00000100:00100000:1.0:1790946076.907042:0:17130:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638653312 00000100:00100000:1.0:1790946076.907048:0:17130:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638653312 00000100:00100000:0.0:1790946076.907084:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790946076.907095:0:17131:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bacefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:87d8d138-d2ce-4761-a98a-4e847b9142bd+4:18313:x1877942638653184:12345-0@lo:104: 00010000:00010000:0.0:1790946076.907110:0:17131:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d4092afde00/0xd9f4181e0d27e3eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27e3f2 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946076.907194:0:17131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790946076.907208:0:17131:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bacefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:87d8d138-d2ce-4761-a98a-4e847b9142bd+4:18313:x1877942638653184:12345-0@lo:104: Request processed in 115us (457us total) trans 0 rc 0/0 00010000:00010000:3.0:1790946076.907212:0:17136:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1790946076.907218:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1790946076.907221:0:17136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d4092afde00/0xd9f4181e0d27e3eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27e3f2 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946076.907232:0:17136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afde00 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:3.0:1790946076.907237:0:17136:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d4092afde00/0xd9f4181e0d27e3eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27e3f2 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946076.907249:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790946076.907262:0:17131:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bacec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:87d8d138-d2ce-4761-a98a-4e847b9142bd+3:18313:x1877942638653312:12345-0@lo:104: 00010000:00010000:3.0:1790946076.907263:0:17136:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d4092afde00/0xd9f4181e0d27e3eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27e3f2 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946076.907275:0:17131:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d40814a2e00/0xd9f4181e0d27e2e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27e2ef expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790946076.907276:0:17136:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d4092afde00/0xd9f4181e0d27e3eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27e3f2 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946076.907296:0:17136:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790946076.907330:0:17131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790946076.907336:0:17131:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bacec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:87d8d138-d2ce-4761-a98a-4e847b9142bd+3:18313:x1877942638653312:12345-0@lo:104: Request processed in 78us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946076.907343:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1790946076.907373:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790946076.907740:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946076.907743:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946076.907745:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946076.907792:0:18313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacef100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18313:1877942638653184:0@lo:104: 00000100:00100000:2.0:1790946076.907803:0:18313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40baceed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18313:1877942638653312:0@lo:104: 00010000:00010000:2.0:1790946076.907825:0:18313:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d3f83c64000/0xd9f4181e0d27e446 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946076.907881:0:17136:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d4092afde00/0xd9f4181e0d27e3eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27e3f2 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946076.907889:0:17136:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790946076.907926:0:17136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d4092afde00/0xd9f4181e0d27e3eb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27e3f2 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946076.907934:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d4092afde00/0xd9f4181e0d27e3eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27e3f2 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946076.907948:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946076.907950:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946076.907951:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946076.908482:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790946076.908499:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:87d8d138-d2ce-4761-a98a-4e847b9142bd:3647:1877942638653440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790946076.908543:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946076.911089:0:17133:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638653440 00000100:00100000:3.0:1790946076.911104:0:17133:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638653440 00010000:00010000:3.0:1790946076.911142:0:17133:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3f83c64e00/0xd9f4181e0d27e3f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27e3eb expref: 18 pid: 17141 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946076.911436:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790946076.911447:0:17133:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40baceed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87d8d138-d2ce-4761-a98a-4e847b9142bd+18:3647:x1877942638653440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790946076.911464:0:17133:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946076.911470:0:17133:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3f83c64e00/0xd9f4181e0d27e3f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27e3eb expref: 18 pid: 17141 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946076.911495:0:17133:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3f83c64e00/0xd9f4181e0d27e3f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27e3eb expref: 18 pid: 17141 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946076.911514:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3f83c64e00/0xd9f4181e0d27e3f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27e3eb expref: 18 pid: 17141 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946076.911531:0:17133:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790946076.911604:0:17133:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40baceed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87d8d138-d2ce-4761-a98a-4e847b9142bd+17:3647:x1877942638653440:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (3061us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946076.911613:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790946076.911870:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:87d8d138-d2ce-4761-a98a-4e847b9142bd:3647:1877942638653440:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790946076.912459:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40814a2e00/0xd9f4181e0d27e2e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27e2ef expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946076.912471:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40814a2e00 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:0.0:1790946076.912475:0:17135:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40814a2e00/0xd9f4181e0d27e2e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27e2ef expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946076.912485:0:17135:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40814a2e00/0xd9f4181e0d27e2e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27e2ef expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790946076.912491:0:17135:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40814a2e00/0xd9f4181e0d27e2e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27e2ef expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790946076.912497:0:17135:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790946076.912558:0:17135:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40814a2e00/0xd9f4181e0d27e2e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27e2ef expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946076.912566:0:17135:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790946076.912603:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40814a2e00/0xd9f4181e0d27e2e8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27e2ef expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946076.912611:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40814a2e00/0xd9f4181e0d27e2e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27e2ef expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946076.912617:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:87d8d138-d2ce-4761-a98a-4e847b9142bd:3649:1877942638653568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790946076.912672:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946076.912734:0:17132:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638653568 00000100:00100000:2.0:1790946076.912739:0:17132:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638653568 00010000:00010000:2.0:1790946076.912762:0:17132:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d4092afc000/0xd9f4181e0d27e2ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27e2e8 expref: 17 pid: 17140 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946076.912786:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790946076.912793:0:17132:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bacef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87d8d138-d2ce-4761-a98a-4e847b9142bd+17:3649:x1877942638653568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790946076.912802:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946076.912807:0:17132:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d4092afc000/0xd9f4181e0d27e2ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27e2e8 expref: 17 pid: 17140 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946076.912829:0:17132:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d4092afc000/0xd9f4181e0d27e2ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27e2e8 expref: 17 pid: 17140 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946076.912842:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d4092afc000/0xd9f4181e0d27e2ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27e2e8 expref: 17 pid: 17140 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946076.912860:0:17132:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d3f83c64000/0xd9f4181e0d27e446 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946076.912868:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3f83c64000/0xd9f4181e0d27e446 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946076.912882:0:17132:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d3f83c64000/0xd9f4181e0d27e446 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946076.912889:0:17132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d3f83c64000/0xd9f4181e0d27e446 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946076.912896:0:17132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d3f83c64000/0xd9f4181e0d27e446 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946076.912902:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d3f83c64000/0xd9f4181e0d27e446 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946076.912908:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c64000 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946076.912912:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d3f83c64000/0xd9f4181e0d27e446 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946076.912920:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d3f83c64000/0xd9f4181e0d27e446 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946076.913070:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d3f83c64000/0xd9f4181e0d27e446 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946076.913081:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790946076.913112:0:17132:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bacef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87d8d138-d2ce-4761-a98a-4e847b9142bd+16:3649:x1877942638653568:12345-0@lo:103:ldlm_bl.0 Request processed in 320us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946076.913124:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1790946076.913144:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946076.913147:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946076.913150:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946076.913236:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:87d8d138-d2ce-4761-a98a-4e847b9142bd:3649:1877942638653568:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790946076.913259:0:18313:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d3f83c64000/0xd9f4181e0d27e446 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946076.913266:0:18313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d3f83c64000/0xd9f4181e0d27e446 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946076.913271:0:18313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3f83c64000/0xd9f4181e0d27e446 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946076.959736:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946077.983377:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790946078.239327:0:17144:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790946078.239345:0:17144:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d40871f9800 from 13 10000000:01000000:0.0:1790946078.239350:0:17144:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790946078.239394:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe0200/0xd9f4181e0d27e44d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946078.239405:0:17144:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe0200/0xd9f4181e0d27e44d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946078.239417:0:17144:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe0200/0xd9f4181e0d27e44d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946078.239441:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638653696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790946078.239508:0:17144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946078.239553:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f83421540 going to sleep for 11 seconds 00000100:00100000:3.0:1790946078.239691:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638653696 00000100:00100000:3.0:1790946078.239699:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638653696 00000100:00100000:3.0:1790946078.239756:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790946078.239766:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4a35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+16:17144:x1877942638653696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790946078.239780:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946078.239793:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40baef0c00/0xd9f4181e0d27e454 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27e44d expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946078.239818:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40baef0c00/0xd9f4181e0d27e454 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27e44d expref: 17 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946078.239827:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40baef0c00/0xd9f4181e0d27e454 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27e44d expref: 17 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946078.239836:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40baef0c00, rc 0) 00000100:00100000:3.0:1790946078.239885:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4a35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+17:17144:x1877942638653696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946078.239902:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790946078.240068:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638653696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790946078.240084:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe0200/0xd9f4181e0d27e44d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e454 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946078.240093:0:17144:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe0200/0xd9f4181e0d27e44d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e454 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946078.240157:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638653824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790946078.240209:0:17144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946078.240237:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40871a9600 going to sleep for 11 seconds 00000100:00100000:3.0:1790946078.240258:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638653824 00000100:00100000:3.0:1790946078.240263:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638653824 00000100:00100000:3.0:1790946078.240314:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790946078.240322:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4a36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+17:17144:x1877942638653824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790946078.240749:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4a36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+17:17144:x1877942638653824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 427us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946078.240757:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790946078.241253:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638653824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790946078.241296:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638653952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790946078.241366:0:17144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946078.241401:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40871a9600 going to sleep for 11 seconds 00000100:00100000:0.0:1790946078.243731:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638653952 00000100:00100000:0.0:1790946078.243747:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638653952 00000100:00100000:0.0:1790946078.243830:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790946078.243839:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4a37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+17:17144:x1877942638653952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790946078.244004:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4a37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+17:17144:x1877942638653952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 166us (2638us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946078.244013:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790946078.245951:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638653952:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790946078.248916:0:18382:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1790946078.253260:0:17144:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1790946078.253317:0:17144:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790946078.253328:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe0200/0xd9f4181e0d27e44d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e454 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946078.253351:0:17144:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe0200/0xd9f4181e0d27e44d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e454 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946078.253361:0:17144:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790946078.253364:0:17144:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d3f81bb7000 from 13 10000000:01000000:3.0:1790946078.253367:0:17144:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790946078.253419:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef0600/0xd9f4181e0d27e45b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946078.253428:0:17144:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40baef0600/0xd9f4181e0d27e45b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946078.253440:0:17144:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40baef0600/0xd9f4181e0d27e45b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946078.253479:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84417480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638654080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790946078.253753:0:17144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946078.253814:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40af6603c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790946078.253938:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638654080 00000100:00100000:0.0:1790946078.253946:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638654080 00000100:00100000:0.0:1790946078.254016:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790946078.254026:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4a34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+17:17144:x1877942638654080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790946078.254040:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946078.254053:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40bcbe0000/0xd9f4181e0d27e462 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27e45b expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946078.254077:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40bcbe0000/0xd9f4181e0d27e462 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27e45b expref: 18 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946078.254088:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40bcbe0000/0xd9f4181e0d27e462 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27e45b expref: 18 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946078.254096:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe0000, rc 0) 00000100:00100000:0.0:1790946078.254148:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4a34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+18:17144:x1877942638654080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946078.254155:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790946078.255148:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84417480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638654080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790946078.255226:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40baef0600/0xd9f4181e0d27e45b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e462 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946078.255239:0:17144:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40baef0600/0xd9f4181e0d27e45b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e462 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946078.255351:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84417480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638654208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790946078.255396:0:17144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946078.255456:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40af6603c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790946078.257278:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638654208 00000100:00100000:0.0:1790946078.257291:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638654208 00000100:00100000:0.0:1790946078.257357:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790946078.257370:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4a35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+18:17144:x1877942638654208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790946078.257536:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4a35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+18:17144:x1877942638654208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 169us (2138us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946078.257553:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790946078.257575:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84417480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638654208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790946078.257647:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84417480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638654336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790946078.257691:0:17144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946078.257734:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40af6603c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790946078.257779:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638654336 00000100:00100000:1.0:1790946078.257790:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638654336 00000100:00100000:1.0:1790946078.257826:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790946078.257833:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4a34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+18:17144:x1877942638654336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790946078.257932:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4a34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+18:17144:x1877942638654336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946078.257939:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790946078.260820:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84417480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638654336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790946078.262143:0:18384:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1790946078.262451:0:17144:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1790946078.262478:0:17144:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790946078.262489:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef0600/0xd9f4181e0d27e45b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e462 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946078.262509:0:17144:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40baef0600/0xd9f4181e0d27e45b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e462 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946079.009284:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946079.071838:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790946069/real 1790946069] req@ffff9d3f84417100 x1877942638648576/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946079 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946079.071872:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d3f84417100 x1877942638648576/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946079 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946079.071883:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790946069/real 1790946069] req@ffff9d40baced500 x1877942638648448/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946079 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946079.071894:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d40baced500 x1877942638648448/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946079 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946079.071903:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790946064/real 1790946064] req@ffff9d40baceea00 x1877942638646272/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946079 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946079.071914:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d40baceea00 x1877942638646272/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946079 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946079.071923:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790946064/real 1790946064] req@ffff9d40bacec700 x1877942638646400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946079 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946079.071932:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d40bacec700 x1877942638646400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946079 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790946079.071949:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40914e2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790946079.072024:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790946079.072029:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84417100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638648576:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1790946079.072034:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d4099032000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1790946079.074907:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:2.0:1790946079.075041:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790946079.075046:0:15915:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790946079.075048:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790946079.075051:0:15915:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790946079.075089:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790946079.075092:0:15915:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1790946079.075096:0:15915:0:(import.c:65:import_set_state_nolock()) ffff9d4099032000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790946079.075103:0:15915:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 520 00000100:00080000:2.0:1790946079.075108:0:15915:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790946079.075119:0:15915:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9d4099032000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1790946079.075140:0:15915:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d40baced180 x1877942638654848/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790946079.075151:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790946079.075154:0:15915:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790946079.075156:0:15915:0:(import.c:65:import_set_state_nolock()) ffff9d40914e2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790946079.075159:0:15915:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 520 00000100:00080000:2.0:1790946079.075203:0:15915:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790946079.075209:0:15915:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9d40914e2800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1790946079.075222:0:15915:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d40bacef480 x1877942638654976/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790946079.075281:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638654592:0@lo:400:kworker.0 00000100:00100000:0.0:1790946079.075362:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946079.075407:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790946079.075413:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638654720:0@lo:400:kworker.0 00000100:00100000:0.0:1790946079.075506:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790946079.078748:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790946079.078848:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40baced500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638648448:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1790946079.078882:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638654592 00000100:00100000:3.0:1790946079.078892:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638654592 00000100:00100000:3.0:1790946079.078947:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790946079.078956:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638654592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946079.079121:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638654592:12345-0@lo:400:kworker.0 Request processed in 165us (3758us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946079.079130:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1790946079.079161:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d3f81b10000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00010000:00080000:0.0:1790946079.079163:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d40bacec000 x1877942638654592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790946079.079207:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790946079.079214:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40baceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638646272:0@lo:8:kworker.0 00000100:00100000:0.0:1790946079.079221:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638654592:0@lo:400:kworker.0 00000100:00080000:3.0:1790946079.079222:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40bb1a7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790946079.079234:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790946079.079238:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638646400:0@lo:8:kworker.0 00000100:00100000:3.0:1790946079.079275:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40baced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638654848:0@lo:8:kworker.0 00000400:00000100:3.0:1790946079.079308:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877942638654848 offset 0 length 520: 4 00000100:00100000:3.0:1790946079.079349:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638654976:0@lo:8:kworker.0 00000400:00000100:3.0:1790946079.079369:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877942638654976 offset 0 length 520: 4 00000100:00100000:1.0:1790946079.079401:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638655104:0@lo:400:kworker.0 00000100:00100000:1.0:1790946079.079438:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946079.079470:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638654464:0@lo:400:kworker.0 00000100:00100000:1.0:1790946079.079501:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790946079.079524:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790946079.079529:0:15915:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1790946079.079532:0:15915:0:(import.c:65:import_set_state_nolock()) ffff9d3f81b10000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790946079.079538:0:15915:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 515 00000100:00080000:2.0:1790946079.079542:0:15915:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790946079.079550:0:15915:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9d3f81b10000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1790946079.079576:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638654720 00000100:00100000:3.0:1790946079.079582:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638654720 00000100:00100000:3.0:1790946079.079603:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638654464 00000100:00100000:3.0:1790946079.079606:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638654464 00000100:00100000:3.0:1790946079.079621:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790946079.079628:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638654720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946079.079671:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638654720:12345-0@lo:400:kworker.0 Request processed in 43us (4164us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946079.079686:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790946079.079699:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790946079.079705:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1877942638654464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946079.079879:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638655104 00000100:00100000:0.0:1790946079.079883:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638655104 00000100:00100000:0.0:1790946079.079909:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790946079.079916:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638655104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946079.080028:0:15915:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f825a4e00 x1877942638655232/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790946079.080046:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790946079.080050:0:15915:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790946079.080052:0:15915:0:(import.c:65:import_set_state_nolock()) ffff9d40bb1a7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790946079.080055:0:15915:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 515 00000100:00080000:2.0:1790946079.080058:0:15915:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790946079.080063:0:15915:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d40bb1a7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1790946079.080077:0:15915:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f825a6300 x1877942638655360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790946079.082627:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1877942638654464:12345-0@lo:400:kworker.0 Request processed in 2912us (3115us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946079.082641:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790946079.082686:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638655232:0@lo:8:kworker.0 00000100:00100000:1.0:1790946079.082749:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638654720:0@lo:400:kworker.0 00000100:00100000:0.0:1790946079.083689:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638655104:12345-0@lo:400:kworker.0 Request processed in 3769us (4247us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946079.083702:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000400:00000100:3.0:1790946079.083739:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877942638655232 offset 0 length 520: 4 00000100:00100000:3.0:1790946079.084088:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638655360:0@lo:8:kworker.0 00000400:00000100:3.0:1790946079.084118:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877942638655360 offset 0 length 520: 4 00010000:00080000:2.0:1790946079.084476:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3f825a4700 x1877942638655104/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946079.084491:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638655104:0@lo:400:kworker.0 00000100:00100000:2.0:1790946079.084505:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638654464:0@lo:400:kworker.0 00010000:00010000:2.0:1790946080.035616:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946080.095706:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790946080.095730:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638655488:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790946080.095810:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946080.096055:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638655488 00000100:00100000:1.0:1790946080.096064:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638655488 00000100:00100000:1.0:1790946080.096108:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790946080.096116:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638655488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790946080.096150:0:17152:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1790946080.097070:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638655488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 951us (1256us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946080.097081:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790946080.097329:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790946080.097340:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638655616:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790946080.097378:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946080.097407:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638655616 00000100:00100000:2.0:1790946080.097412:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638655616 00000100:00100000:2.0:1790946080.097437:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790946080.097443:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1877942638655616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790946080.097464:0:17153:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790946080.097510:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1877942638655616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 66us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946080.097515:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790946080.097545:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638655616:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790946080.098660:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638655488:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1790946081.056352:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790946081.121196:0:17893:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:0.0:1790946081.951837:0:17919:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790946082.089739:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946083.103664:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790946083.220561:0:18662:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790946083.220565:0:18662:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1790946083.220566:0:18662:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1790946083.220672:0:18662:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9d4099fbe800 00000020:01000004:3.0:1790946083.220690:0:18662:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1790946083.220705:0:18662:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1790946083.220720:0:18662:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9d4084800000) 00000020:00000080:3.0:1790946083.220737:0:18662:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1790946083.272594:0:18662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1790946083.274554:0:18662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1790946083.275149:0:18662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1790946083.275606:0:18662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1790946083.276649:0:18662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1790946083.277070:0:18662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1790946083.277443:0:18662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:1.0:1790946083.281030:0:18662:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1790946083.281537:0:18662:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1790946083.281549:0:18662:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:1.0:1790946083.281560:0:18662:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd9f4181e0d27e470 00000020:01000004:1.0:1790946083.281566:0:18662:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1790946083.281585:0:18662:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.120@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1790946083.281588:0:18662:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1790946083.281594:0:18662:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1790946083.281599:0:18662:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1790946083.281609:0:18662:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9d40bfe94d40) 00000020:00000080:1.0:1790946083.281619:0:18662:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:1.0:1790946083.282754:0:18662:0:(service.c:173:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790946083.282903:0:18662:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1790946083.282910:0:18662:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1790946083.284426:0:18662:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1790946083.284437:0:18662:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1790946083.286095:0:18662:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1790946083.286107:0:18662:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1790946083.290987:0:18662:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790946083.292689:0:18662:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1790946083.292702:0:18662:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1790946083.297493:0:18662:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1790946083.297509:0:18662:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1790946083.318498:0:18662:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790946083.318807:0:18662:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1790946083.318816:0:18662:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1790946083.320634:0:18662:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790946083.320648:0:18662:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1790946083.321600:0:18662:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790946083.321609:0:18662:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1790946083.323874:0:18662:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790946083.324098:0:18662:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1790946083.324105:0:18662:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1790946083.324920:0:18662:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1790946083.324928:0:18662:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1790946083.357530:0:18662:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790946083.357741:0:18662:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1790946083.357747:0:18662:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1790946083.358861:0:18662:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1790946083.358870:0:18662:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1790946083.360454:0:18662:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1790946083.360495:0:18662:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1790946083.360502:0:18662:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.120@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1790946083.372749:0:18662:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.120@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790946083.372805:0:18662:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.120@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1790946083.372809:0:18662:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790946083.372811:0:18662:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790946083.372813:0:18662:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790946083.372814:0:18662:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790946083.372815:0:18662:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790946083.372821:0:18662:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790946083.372822:0:18662:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790946083.372824:0:18662:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790946083.372825:0:18662:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790946083.372828:0:18662:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1790946083.372830:0:18662:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790946083.372831:0:18662:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790946083.372832:0:18662:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790946083.372834:0:18662:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790946083.372835:0:18662:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790946083.372836:0:18662:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790946083.372837:0:18662:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790946083.372838:0:18662:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790946083.372839:0:18662:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790946083.372882:0:18662:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1790946083.372902:0:18662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:18662:1877942638655744:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790946083.372972:0:18662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946083.373024:0:18662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4099624300 going to sleep for 11 seconds 00000100:00100000:0.0:1790946083.373139:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638655744 00000100:00100000:0.0:1790946083.373148:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638655744 00000100:00100000:0.0:1790946083.373303:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790946083.373314:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4a35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+18:18662:x1877942638655744:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790946083.373343:0:17141:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1790946083.373346:0:17141:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1790946083.373356:0:17141:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1790946083.373795:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4a35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+18:18662:x1877942638655744:12345-0@lo:253:mount.lustre.0 Request processed in 482us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946083.373803:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790946083.373940:0:18662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:18662:1877942638655744:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790946083.373952:0:18662:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1790946083.373955:0:18662:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790946083.373956:0:18662:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790946083.373958:0:18662:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790946083.373959:0:18662:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790946083.373960:0:18662:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790946083.373961:0:18662:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790946083.373963:0:18662:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790946083.373964:0:18662:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790946083.373965:0:18662:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790946083.373981:0:18662:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d4099fbe800 from lustre-OST0000 10000000:01000000:3.0:1790946083.374017:0:18662:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1790946083.374021:0:18662:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1790946083.374029:0:18662:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d40bc9e4d40 local copy 00010000:00010000:3.0:1790946083.374039:0:18662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4092afd400/0xd9f4181e0d27e22b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e232 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946083.374132:0:18662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84415f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:18662:1877942638655872:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790946083.374162:0:18662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946083.374431:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638655872 00000100:00100000:1.0:1790946083.374437:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638655872 00000100:00100000:3.0:1790946083.374450:0:18662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bacc5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790946083.374495:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790946083.374503:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4daf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+18:18662:x1877942638655872:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790946083.374568:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4daf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+18:18662:x1877942638655872:12345-0@lo:501:mount.lustre.0 Request processed in 65us (404us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790946083.374574:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790946083.374646:0:18662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84415f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:18662:1877942638655872:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1790946083.374668:0:18662:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1790946083.374686:0:18662:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1790946083.374692:0:18662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4092afd400/0xd9f4181e0d27e22b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e232 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946083.374706:0:18662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d4092afd400/0xd9f4181e0d27e22b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e232 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946083.374731:0:18662:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d4099fbe800 10000000:01000000:3.0:1790946083.374736:0:18662:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790946083.374741:0:18662:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1790946083.374744:0:18662:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790946083.374748:0:18662:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1790946083.374751:0:18662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1790946083.374771:0:18662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef1a00/0xd9f4181e0d27e47e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946083.374778:0:18662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40baef1a00/0xd9f4181e0d27e47e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946083.374786:0:18662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40baef1a00/0xd9f4181e0d27e47e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946083.374798:0:18662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84415f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:18662:1877942638656000:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790946083.374825:0:18662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946083.374885:0:18662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bacc5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790946083.374907:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638656000 00000100:00100000:2.0:1790946083.374912:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638656000 00000100:00100000:2.0:1790946083.374946:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790946083.374953:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4dad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+18:18662:x1877942638656000:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790946083.374962:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946083.374979:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3f83c64600/0xd9f4181e0d27e485 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27e47e expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946083.375005:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3f83c64600/0xd9f4181e0d27e485 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27e47e expref: 19 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946083.375015:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3f83c64600/0xd9f4181e0d27e485 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27e47e expref: 19 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946083.375025:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c64600, rc 0) 00000100:00100000:2.0:1790946083.375066:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4dad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+19:18662:x1877942638656000:12345-0@lo:101:mount.lustre.0 Request processed in 114us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946083.375079:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790946083.375214:0:18662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84415f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:18662:1877942638656000:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790946083.375225:0:18662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40baef1a00/0xd9f4181e0d27e47e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e485 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946083.375252:0:18662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40baef1a00/0xd9f4181e0d27e47e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e485 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790946083.376087:0:18662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1790946083.376777:0:18662:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790946083.381514:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1790946083.381569:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1790946083.381584:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1790946083.381598:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1790946083.381628:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1790946083.381643:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1790946083.381680:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1790946083.381687:0:18662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1790946083.381792:0:18662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84415f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:18662:1877942638656128:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790946083.381862:0:18662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946083.381911:0:18662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bacc5600 going to sleep for 11 seconds 00000100:00100000:0.0:1790946083.381997:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638656128 00000100:00100000:0.0:1790946083.382006:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638656128 00000100:00100000:0.0:1790946083.382205:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790946083.382215:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4daf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+19:18662:x1877942638656128:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790946083.386827:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4daf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+19:18662:x1877942638656128:12345-0@lo:501:mount.lustre.0 Request processed in 4600us (4952us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946083.386846:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790946083.390932:0:18662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84415f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:18662:1877942638656128:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790946083.391013:0:18662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84415f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:18662:1877942638656256:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790946083.391106:0:18662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946083.391154:0:18662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bacc5600 going to sleep for 11 seconds 00000100:00100000:2.0:1790946083.391588:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638656256 00000100:00100000:2.0:1790946083.391596:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638656256 00000100:00100000:2.0:1790946083.391658:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790946083.391667:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+19:18662:x1877942638656256:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790946083.393212:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+19:18662:x1877942638656256:12345-0@lo:503:mount.lustre.0 Request processed in 1537us (2098us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946083.393227:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790946083.393371:0:18662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84415f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:18662:1877942638656256:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790946083.393978:0:18662:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790946083.394065:0:18662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84415f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:18662:1877942638656384:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790946083.394125:0:18662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946083.394299:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638656384 00000100:00100000:1.0:1790946083.394306:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638656384 00000100:00100000:1.0:1790946083.394403:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790946083.394413:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+19:18662:x1877942638656384:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790946083.394661:0:18662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bc8ac240 going to sleep for 11 seconds 00000100:00100000:1.0:1790946083.395274:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+19:18662:x1877942638656384:12345-0@lo:502:mount.lustre.0 Request processed in 861us (1147us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946083.395283:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790946083.395382:0:18662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84415f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:18662:1877942638656384:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790946083.395596:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1790946083.395627:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1790946083.395642:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1790946083.395653:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1790946083.395667:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1790946083.395680:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1790946083.395694:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1790946083.395707:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1790946083.395720:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1790946083.395732:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1790946083.395775:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1790946083.395795:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1790946083.395825:0:18662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84415f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:18662:1877942638656512:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790946083.395871:0:18662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946083.404304:0:18662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bacc5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790946083.406583:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638656512 00000100:00100000:0.0:1790946083.406601:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638656512 00000100:00100000:0.0:1790946083.406843:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790946083.406855:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+19:18662:x1877942638656512:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790946083.407067:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+19:18662:x1877942638656512:12345-0@lo:502:mount.lustre.0 Request processed in 215us (11196us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946083.407075:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790946083.407197:0:18662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84415f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:18662:1877942638656512:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790946083.407298:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1790946083.407313:0:18662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1790946083.409496:0:18679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790946083.409508:0:18679:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1790946083.409515:0:18679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946083.409517:0:18679:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1790946083.409523:0:18679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790946083.409539:0:18679:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9d40accf3380) 00000020:00000080:1.0:1790946083.409564:0:18679:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1790946083.409571:0:18679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790946083.409651:0:18679:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d4099fbe800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1790946083.409661:0:18679:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790946083.409669:0:18679:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd9f4181e0d27e493 00010000:00010000:1.0:1790946083.417491:0:18679:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1790946083.419923:0:18679:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:1.0:1790946083.427367:0:18679:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1790946083.432099:0:18679:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1790946083.432112:0:18679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790946083.432119:0:18679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946083.432121:0:18679:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1790946083.432126:0:18679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1790946083.432128:0:18679:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1790946083.432130:0:18679:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790946083.432132:0:18679:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790946083.432133:0:18679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1790946083.432135:0:18679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946083.432137:0:18679:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1790946083.432139:0:18679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790946083.432142:0:18679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946083.432153:0:18679:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790946083.432157:0:18679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790946083.432160:0:18679:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1790946083.432162:0:18679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790946083.432165:0:18679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946083.432186:0:18679:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1790946083.432190:0:18679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790946083.432193:0:18679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946083.432194:0:18679:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1790946083.432198:0:18679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1790946083.432225:0:18679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790946083.432228:0:18679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946083.432239:0:18679:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1790946083.432244:0:18679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1790946083.432463:0:18662:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1790946083.432502:0:18662:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1790946083.432523:0:18662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef1a00/0xd9f4181e0d27e47e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e485 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946083.432543:0:18662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40baef1a00/0xd9f4181e0d27e47e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e485 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790946083.432552:0:18662:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d4099fbe800 from 1 10000000:01000000:0.0:1790946083.432555:0:18662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790946083.432592:0:18662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe1c00/0xd9f4181e0d27e49a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946083.432600:0:18662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe1c00/0xd9f4181e0d27e49a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946083.432611:0:18662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe1c00/0xd9f4181e0d27e49a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946083.432635:0:18662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:18662:1877942638656640:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790946083.432711:0:18662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946083.432753:0:18662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40baf05480 going to sleep for 11 seconds 00000100:00100000:1.0:1790946083.433390:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638656640 00000100:00100000:1.0:1790946083.433401:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638656640 00000100:00100000:1.0:1790946083.433469:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790946083.433480:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+19:18662:x1877942638656640:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790946083.433494:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946083.433509:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d4092afd800/0xd9f4181e0d27e4a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27e49a expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946083.433534:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d4092afd800/0xd9f4181e0d27e4a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27e49a expref: 20 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946083.433545:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d4092afd800/0xd9f4181e0d27e4a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27e49a expref: 20 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946083.433554:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4092afd800, rc 0) 00000100:00100000:1.0:1790946083.433615:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+20:18662:x1877942638656640:12345-0@lo:101:mount.lustre.0 Request processed in 138us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946083.433634:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790946083.433658:0:18662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:18662:1877942638656640:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790946083.433681:0:18662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe1c00/0xd9f4181e0d27e49a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e4a1 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946083.433690:0:18662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe1c00/0xd9f4181e0d27e49a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e4a1 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790946083.438948:0:18662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1790946083.439375:0:18662:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790946083.439806:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1790946083.439835:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1790946083.439855:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1790946083.439861:0:18662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1790946083.440008:0:18662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:18662:1877942638656768:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790946083.440083:0:18662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946083.440143:0:18662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bb00a840 going to sleep for 11 seconds 00000100:00100000:1.0:1790946083.441337:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638656768 00000100:00100000:1.0:1790946083.441348:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638656768 00000100:00100000:1.0:1790946083.441406:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790946083.441417:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+20:18662:x1877942638656768:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790946083.441594:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+20:18662:x1877942638656768:12345-0@lo:501:mount.lustre.0 Request processed in 178us (1509us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946083.441602:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790946083.441936:0:18662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:18662:1877942638656768:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790946083.441987:0:18662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:18662:1877942638656896:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790946083.442044:0:18662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946083.442081:0:18662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40baf053c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790946083.444553:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638656896 00000100:00100000:1.0:1790946083.444572:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638656896 00000100:00100000:1.0:1790946083.444648:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790946083.444658:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+20:18662:x1877942638656896:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790946083.444845:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+20:18662:x1877942638656896:12345-0@lo:503:mount.lustre.0 Request processed in 188us (2800us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946083.444854:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790946083.445555:0:18662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:18662:1877942638656896:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790946083.446043:0:18662:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790946083.446141:0:18662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:18662:1877942638657024:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790946083.447730:0:18662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946083.447829:0:18662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40baf05480 going to sleep for 11 seconds 00000100:00100000:1.0:1790946083.447882:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638657024 00000100:00100000:1.0:1790946083.447890:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638657024 00000100:00100000:1.0:1790946083.447950:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790946083.447960:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+20:18662:x1877942638657024:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790946083.448148:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+20:18662:x1877942638657024:12345-0@lo:502:mount.lustre.0 Request processed in 188us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946083.448156:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790946083.448643:0:18662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:18662:1877942638657024:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790946083.448915:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1790946083.448948:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1790946083.448964:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1790946083.448980:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1790946083.448996:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1790946083.449012:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1790946083.449026:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1790946083.449040:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1790946083.449055:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1790946083.449069:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1790946083.449083:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1790946083.449619:0:18662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:18662:1877942638657152:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790946083.449681:0:18662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946083.449724:0:18662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40baf05480 going to sleep for 11 seconds 00000100:00100000:3.0:1790946083.449775:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638657152 00000100:00100000:3.0:1790946083.449784:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638657152 00000100:00100000:3.0:1790946083.449834:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790946083.449843:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+20:18662:x1877942638657152:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790946083.449974:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+20:18662:x1877942638657152:12345-0@lo:502:mount.lustre.0 Request processed in 132us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946083.449983:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790946083.450397:0:18662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:18662:1877942638657152:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790946083.450646:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1790946083.450659:0:18662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1790946083.452626:0:18683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790946083.452639:0:18683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946083.452641:0:18683:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1790946083.452649:0:18683:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d4099fbe800 00000020:00000080:2.0:1790946083.452652:0:18683:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790946083.452658:0:18683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790946083.452660:0:18683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946083.452662:0:18683:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1790946083.452664:0:18683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790946083.452666:0:18683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946083.452668:0:18683:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1790946083.452671:0:18683:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d4099fbe800 00000020:00000080:2.0:1790946083.452687:0:18683:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790946083.452788:0:18683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790946083.452792:0:18683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946083.452794:0:18683:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1790946083.452796:0:18683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790946083.452799:0:18683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946083.452800:0:18683:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790946083.452803:0:18683:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d4099fbe800 00000020:00000080:2.0:1790946083.452805:0:18683:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790946083.455050:0:18683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790946083.455481:0:18683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946083.455483:0:18683:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790946083.455488:0:18683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790946083.455492:0:18683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946083.455494:0:18683:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1790946083.455500:0:18683:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d4099fbe800 00000020:00000080:2.0:1790946083.455503:0:18683:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790946083.455584:0:18683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790946083.455589:0:18683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946083.455590:0:18683:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1790946083.455594:0:18683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1790946083.455725:0:18662:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1790946083.455760:0:18662:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790946083.455789:0:18662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe1c00/0xd9f4181e0d27e49a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e4a1 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946083.455802:0:18662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe1c00/0xd9f4181e0d27e49a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e4a1 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946083.455856:0:18662:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790946083.455859:0:18662:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d4099fbe800 10000000:01000000:3.0:1790946083.455869:0:18662:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d4099fbe800 10000000:01000000:3.0:1790946083.455872:0:18662:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790946083.455878:0:18662:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d4099fbe800 from 1 10000000:01000000:3.0:1790946083.455881:0:18662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790946083.455920:0:18662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef1e00/0xd9f4181e0d27e4a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946083.455929:0:18662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40baef1e00/0xd9f4181e0d27e4a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946083.455955:0:18662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40baef1e00/0xd9f4181e0d27e4a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946083.455979:0:18662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84415f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:18662:1877942638657280:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790946083.456051:0:18662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946083.456089:0:18662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bacc5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790946083.456401:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638657280 00000100:00100000:2.0:1790946083.456410:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638657280 00000100:00100000:2.0:1790946083.456597:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790946083.456608:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+20:18662:x1877942638657280:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790946083.456709:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946083.456725:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3f83c64200/0xd9f4181e0d27e4af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27e4a8 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946083.456808:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3f83c64200/0xd9f4181e0d27e4af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27e4a8 expref: 21 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946083.456840:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3f83c64200/0xd9f4181e0d27e4af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27e4a8 expref: 21 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946083.456850:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c64200, rc 0) 00000100:00100000:2.0:1790946083.456988:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+21:18662:x1877942638657280:12345-0@lo:101:mount.lustre.0 Request processed in 382us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946083.456996:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790946083.457140:0:18662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84415f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:18662:1877942638657280:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790946083.457161:0:18662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40baef1e00/0xd9f4181e0d27e4a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e4af expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946083.457197:0:18662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40baef1e00/0xd9f4181e0d27e4a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e4af expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790946083.462810:0:18662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1790946083.464786:0:18662:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790946083.468679:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1790946083.468748:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1790946083.468766:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1790946083.468782:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1790946083.468798:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1790946083.468810:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1790946083.468823:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1790946083.468836:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1790946083.468851:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1790946083.468867:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1790946083.468906:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1790946083.468925:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1790946083.468952:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1790946083.468969:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1790946083.468985:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1790946083.469001:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1790946083.469017:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1790946083.469031:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1790946083.469044:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1790946083.469059:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1790946083.469074:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1790946083.469087:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1790946083.469100:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1790946083.470949:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1790946083.470983:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1790946083.470995:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1790946083.471021:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1790946083.471033:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1790946083.471045:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1790946083.471057:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1790946083.471071:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1790946083.471083:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1790946083.472215:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1790946083.472795:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1790946083.472825:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1790946083.472840:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1790946083.472856:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1790946083.473033:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1790946083.473041:0:18662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1790946083.473161:0:18662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:18662:1877942638657408:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790946083.473267:0:18662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946083.473327:0:18662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bb00a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790946083.473411:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638657408 00000100:00100000:1.0:1790946083.473418:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638657408 00000100:00100000:1.0:1790946083.473799:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790946083.473810:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+21:18662:x1877942638657408:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790946083.474037:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+21:18662:x1877942638657408:12345-0@lo:501:mount.lustre.0 Request processed in 229us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946083.474046:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1790946083.474569:0:18662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:18662:1877942638657408:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790946083.474620:0:18662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84415880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:18662:1877942638657536:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790946083.474672:0:18662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946083.474705:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638657536 00000100:00100000:3.0:1790946083.474711:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638657536 00000100:00100000:3.0:1790946083.474753:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1790946083.474761:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+21:18662:x1877942638657536:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790946083.476434:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+21:18662:x1877942638657536:12345-0@lo:503:mount.lustre.0 Request processed in 1666us (1753us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946083.476448:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1790946083.476533:0:18662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bacc5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790946083.476560:0:18662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84415880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:18662:1877942638657536:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790946083.477345:0:18662:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790946083.477489:0:18662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84415880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:18662:1877942638657664:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790946083.477546:0:18662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946083.477624:0:18662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40af69ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1790946083.477721:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638657664 00000100:00100000:2.0:1790946083.477729:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638657664 00000100:00100000:2.0:1790946083.477818:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790946083.477828:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+21:18662:x1877942638657664:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790946083.477935:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+21:18662:x1877942638657664:12345-0@lo:502:mount.lustre.0 Request processed in 108us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946083.477943:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790946083.478016:0:18662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84415880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:18662:1877942638657664:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790946083.478247:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1790946083.478275:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1790946083.478304:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1790946083.478320:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1790946083.478335:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1790946083.478350:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1790946083.478380:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1790946083.478394:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1790946083.478407:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1790946083.478420:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1790946083.478432:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1790946083.478444:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1790946083.478454:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1790946083.478467:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1790946083.478481:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1790946083.478496:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1790946083.478509:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1790946083.478522:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1790946083.478548:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1790946083.478563:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1790946083.478576:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1790946083.478588:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1790946083.478600:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1790946083.478614:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1790946083.478627:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1790946083.478655:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1790946083.478689:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1790946083.478703:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1790946083.478718:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1790946083.478735:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1790946083.478753:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1790946083.478771:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1790946083.478786:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1790946083.478801:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1790946083.478832:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1790946083.478847:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1790946083.478861:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1790946083.478875:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1790946083.478888:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1790946083.478899:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1790946083.478916:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1790946083.478930:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1790946083.478948:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1790946083.478965:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1790946083.478983:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1790946083.478995:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1790946083.479008:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1790946083.479020:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1790946083.479057:0:18662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84415880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:18662:1877942638657792:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790946083.479102:0:18662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946083.479135:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638657792 00000100:00100000:3.0:1790946083.479140:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638657792 00000100:00100000:3.0:1790946083.479194:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790946083.479201:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+21:18662:x1877942638657792:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790946083.479298:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+21:18662:x1877942638657792:12345-0@lo:502:mount.lustre.0 Request processed in 96us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946083.479313:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790946083.479351:0:18662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40af69ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1790946083.479365:0:18662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84415880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:18662:1877942638657792:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790946083.479503:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1790946083.479525:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1790946083.479545:0:18662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84415880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:18662:1877942638657920:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790946083.479579:0:18662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946083.479603:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638657920 00000100:00100000:3.0:1790946083.479607:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638657920 00000100:00100000:3.0:1790946083.479631:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790946083.479637:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+21:18662:x1877942638657920:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790946083.479692:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+21:18662:x1877942638657920:12345-0@lo:502:mount.lustre.0 Request processed in 56us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946083.479699:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790946083.479728:0:18662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40af69ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1790946083.479740:0:18662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84415880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:18662:1877942638657920:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790946083.479774:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1790946083.479783:0:18662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1790946083.481615:0:18688:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1790946083.481633:0:18688:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9d40b441b380) 00000020:00000080:0.0:1790946083.481677:0:18688:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1790946083.481753:0:18688:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d4099fbe800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1790946083.481757:0:18688:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d4099fbe800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1790946083.481760:0:18688:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d4099fbe800 3 00010000:00080000:0.0:1790946083.481788:0:18688:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d40bae3a800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.120@tcp at head 00010000:00010000:0.0:1790946083.489859:0:18688:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1790946083.495290:0:18688:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1790946083.495344:0:18688:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790946083.495359:0:18688:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xd9f4181e0d27e4bd 00000100:00080000:0.0:1790946083.495371:0:18688:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790946083.495384:0:18688:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9d40bae3a800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1790946083.495420:0:18688:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f8265fb80 x1877942638658048/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790946083.495448:0:18688:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1790946083.495498:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790946083.495502:0:15915:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790946083.495505:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790946083.495508:0:15915:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790946083.495548:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790946083.495552:0:15915:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790946083.495554:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790946083.495557:0:15915:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790946083.495592:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638658176:0@lo:400:kworker.0 00000100:00100000:0.0:1790946083.495656:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946083.495717:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790946083.495724:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1877942638658560:0@lo:400:kworker.0 00000100:00100000:0.0:1790946083.495752:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946083.495782:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877942638658304:0@lo:400:kworker.0 00000100:00100000:0.0:1790946083.495803:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946083.495822:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790946083.495827:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638658432:0@lo:400:kworker.0 00000100:00100000:0.0:1790946083.495850:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946083.495882:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638658176 00000100:00100000:0.0:1790946083.495888:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638658176 00000100:00100000:0.0:1790946083.495917:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638658432 00000100:00100000:0.0:1790946083.495919:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638658432 00000100:00100000:0.0:1790946083.495933:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790946083.495941:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638658176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946083.495995:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638658176:12345-0@lo:400:kworker.0 Request processed in 54us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946083.496002:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790946083.496016:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790946083.496022:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638658432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946083.496050:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638658432:12345-0@lo:400:kworker.0 Request processed in 28us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946083.496055:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790946083.496073:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638658560 00000100:00100000:0.0:1790946083.496076:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638658560 00000100:00100000:0.0:1790946083.496094:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638658304 00000100:00100000:0.0:1790946083.496096:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638658304 00000100:00100000:0.0:1790946083.496106:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790946083.496111:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1877942638658560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946083.496148:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1877942638658560:12345-0@lo:400:kworker.0 Request processed in 36us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946083.496154:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790946083.496197:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790946083.496204:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877942638658304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946083.496244:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877942638658304:12345-0@lo:400:kworker.0 Request processed in 40us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946083.496250:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790946083.496290:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638658432:0@lo:400:kworker.0 00010000:00080000:0.0:1790946083.496302:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3f8265ed80 x1877942638658304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946083.496311:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877942638658304:0@lo:400:kworker.0 00010000:00080000:0.0:1790946083.496336:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3f8265d180 x1877942638658560/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946083.496345:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1877942638658560:0@lo:400:kworker.0 00000100:00100000:0.0:1790946083.496354:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638658176:0@lo:400:kworker.0 00000100:00100000:1.0:1790946083.496923:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1877942638658048:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790946083.496965:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946083.497490:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638658048 00000100:00100000:0.0:1790946083.497498:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638658048 00000100:00100000:0.0:1790946083.497526:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790946083.497531:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1877942638658048:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1790946083.497555:0:17149:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 534 last 0 00000020:00000080:0.0:1790946083.497590:0:17149:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xd9f4181e0d27e4c4 00000004:00100000:0.0:1790946083.497607:0:17149:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:01000004:1.0:1790946083.497853:0:18688:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1790946083.497867:0:18688:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9d40accf0000) 00000020:00000080:1.0:1790946083.497886:0:18688:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:1.0:1790946083.497978:0:18688:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d4099fbe800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1790946083.497983:0:18688:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d4099fbe800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1790946083.497985:0:18688:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d4099fbe800 3 00010000:00080000:1.0:1790946083.498009:0:18688:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d40bae3a000@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.120@tcp at head 00000100:00080000:0.0:1790946083.498766:0:17149:0:(import.c:65:import_set_state_nolock()) ffff9d40baebd800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790946083.498866:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1877942638658048:12345-0@lo:38:llog_process_th.0 Request processed in 1332us (1899us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946083.498875:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790946083.498936:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3f8265fb80 x1877942638658048/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790946093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946083.498947:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790946083.498955:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1790946083.498962:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1790946083.498967:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790946083.498970:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40bae3a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790946083.498976:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1877942638658048:0@lo:38:llog_process_th.0 00010000:00010000:2.0:1790946083.512830:0:18688:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1790946083.513059:0:18688:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1790946083.513107:0:18688:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790946083.513120:0:18688:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xd9f4181e0d27e4d2 00000100:00080000:2.0:1790946083.513130:0:18688:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790946083.513142:0:18688:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9d40bae3a000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1790946083.513298:0:18688:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f825a6d80 x1877942638658688/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790946083.513320:0:18688:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1790946083.513879:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1877942638658688:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790946083.513951:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946083.514022:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638658688 00000100:00100000:0.0:1790946083.514030:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638658688 00000100:00100000:0.0:1790946083.514061:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790946083.514069:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1877942638658688:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1790946083.514094:0:17147:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 534 last 0 00000020:00000080:0.0:1790946083.514138:0:17147:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xd9f4181e0d27e4d9 00000004:00100000:0.0:1790946083.514154:0:17147:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790946083.514237:0:17147:0:(import.c:65:import_set_state_nolock()) ffff9d40bff13000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790946083.514295:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1877942638658688:12345-0@lo:38:llog_process_th.0 Request processed in 224us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946083.514303:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1790946083.514337:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790946083.514342:0:15915:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790946083.514345:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790946083.514347:0:15915:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790946083.514351:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790946083.514354:0:15915:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790946083.514357:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790946083.514361:0:15915:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:0.0:1790946083.514511:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3f825a6d80 x1877942638658688/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790946093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946083.514520:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790946083.514527:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1790946083.514535:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1790946083.514539:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1790946083.514541:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40bae3a000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790946083.514546:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1877942638658688:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1790946083.520643:0:18688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:3.0:1790946083.520804:0:18662:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1790946083.520832:0:18662:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790946083.520852:0:18662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef1e00/0xd9f4181e0d27e4a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e4af expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946083.520864:0:18662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40baef1e00/0xd9f4181e0d27e4a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e4af expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1790946083.520929:0:18662:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790946083.520931:0:18662:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790946083.520933:0:18662:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790946083.520934:0:18662:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790946083.520935:0:18662:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790946083.520937:0:18662:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790946083.520939:0:18662:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790946083.520941:0:18662:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790946083.520942:0:18662:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790946083.520946:0:18662:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1790946083.520948:0:18662:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790946083.520949:0:18662:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790946083.520950:0:18662:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790946083.520951:0:18662:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790946083.520952:0:18662:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790946083.520953:0:18662:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790946083.520954:0:18662:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790946083.520955:0:18662:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790946083.520956:0:18662:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790946083.520983:0:18662:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1790946083.521002:0:18662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84415880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:18662:1877942638658816:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790946083.521067:0:18662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946083.521114:0:18662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4088a17780 going to sleep for 11 seconds 00000100:00100000:0.0:1790946083.521193:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638658816 00000100:00100000:0.0:1790946083.521201:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638658816 00000100:00100000:0.0:1790946083.521255:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1790946083.521264:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+21:18662:x1877942638658816:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790946083.521293:0:17140:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1790946083.521308:0:17140:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1790946083.528891:0:17140:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790946083.528909:0:17140:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1790946083.529015:0:17163:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1790946083.529020:0:17163:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1790946083.529041:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d4092afd200/0xd9f4181e0d27e4e0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946083.529059:0:17163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40baef0e00/0xd9f4181e0d27e42a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27e423 expref: 21 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946083.529067:0:17163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40baef1200/0xd9f4181e0d27e438 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27e431 expref: 21 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946083.529074:0:17163:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d4092afd200/0xd9f4181e0d27e4e0 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946083.529109:0:17163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40baef1200/0xd9f4181e0d27e438 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27e431 expref: 21 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946083.529139:0:17163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40baef1200/0xd9f4181e0d27e438 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27e431 expref: 21 pid: 17141 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946083.529154:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d02d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17163:1877942638658944:0@lo:104: 00000100:00100000:1.0:1790946083.529243:0:17163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790946083.529289:0:17163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40baef0e00/0xd9f4181e0d27e42a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27e423 expref: 21 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946083.529297:0:17163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40baef0e00/0xd9f4181e0d27e42a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27e423 expref: 21 pid: 17140 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946083.529305:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d03480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17163:1877942638659072:0@lo:104: 00000100:00100000:1.0:1790946083.529329:0:17163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946083.529344:0:17163:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40baeab9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790946083.529371:0:17131:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1790946083.529386:0:17131:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638658944 00000100:00100000:1.0:1790946083.529392:0:17131:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638658944 00000100:00100000:1.0:1790946083.529425:0:17131:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638659072 00000100:00100000:1.0:1790946083.529427:0:17131:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638659072 00000100:00100000:1.0:1790946083.529440:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790946083.529447:0:17131:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:87d8d138-d2ce-4761-a98a-4e847b9142bd+4:17163:x1877942638658944:12345-0@lo:104: 00010000:00010000:1.0:1790946083.529460:0:17131:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65000/0xd9f4181e0d27e431 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27e438 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946083.529512:0:17131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790946083.529518:0:17131:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:87d8d138-d2ce-4761-a98a-4e847b9142bd+4:17163:x1877942638658944:12345-0@lo:104: Request processed in 71us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946083.529525:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790946083.529549:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790946083.529583:0:17131:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8447a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:87d8d138-d2ce-4761-a98a-4e847b9142bd+3:17163:x1877942638659072:12345-0@lo:104: 00010000:00010000:1.0:1790946083.529591:0:17131:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64c00/0xd9f4181e0d27e423 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27e42a expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946083.529623:0:17131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790946083.529628:0:17131:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8447a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:87d8d138-d2ce-4761-a98a-4e847b9142bd+3:17163:x1877942638659072:12345-0@lo:104: Request processed in 48us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946083.529633:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1790946083.529676:0:17136:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790946083.529682:0:17136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65000/0xd9f4181e0d27e431 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27e438 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946083.529689:0:17136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65000 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:1.0:1790946083.529692:0:17136:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65000/0xd9f4181e0d27e431 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27e438 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946083.529700:0:17136:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65000/0xd9f4181e0d27e431 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27e438 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790946083.529707:0:17136:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65000/0xd9f4181e0d27e431 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27e438 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790946083.529713:0:17136:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790946083.529743:0:17136:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65000/0xd9f4181e0d27e431 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27e438 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946083.529749:0:17136:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790946083.529768:0:17136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65000/0xd9f4181e0d27e431 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27e438 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946083.529783:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65000/0xd9f4181e0d27e431 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27e438 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946083.529796:0:17136:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946083.529799:0:17136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64c00/0xd9f4181e0d27e423 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27e42a expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946083.529805:0:17136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c64c00 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:1.0:1790946083.529808:0:17136:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64c00/0xd9f4181e0d27e423 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27e42a expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946083.529815:0:17136:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64c00/0xd9f4181e0d27e423 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27e42a expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790946083.529820:0:17136:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64c00/0xd9f4181e0d27e423 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27e42a expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790946083.529825:0:17136:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790946083.529836:0:17136:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64c00/0xd9f4181e0d27e423 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27e42a expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946083.529841:0:17136:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790946083.529855:0:17136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64c00/0xd9f4181e0d27e423 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27e42a expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946083.529861:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64c00/0xd9f4181e0d27e423 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27e42a expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946083.529872:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946083.529879:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946083.529881:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946083.529887:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946083.529912:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790946083.529923:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:87d8d138-d2ce-4761-a98a-4e847b9142bd:3647:1877942638659200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790946083.529948:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946083.529968:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790946083.529975:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:87d8d138-d2ce-4761-a98a-4e847b9142bd:3650:1877942638659328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790946083.529994:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946083.530021:0:17132:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638659200 00000100:00100000:1.0:1790946083.530025:0:17132:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638659200 00010000:00010000:1.0:1790946083.530041:0:17132:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40baef1200/0xd9f4181e0d27e438 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27e431 expref: 22 pid: 17141 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946083.530057:0:17132:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638659328 00000100:00100000:1.0:1790946083.530060:0:17132:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638659328 00010000:00010000:1.0:1790946083.530067:0:17132:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40baef0e00/0xd9f4181e0d27e42a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27e423 expref: 23 pid: 17140 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946083.530077:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790946083.530081:0:17132:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87d8d138-d2ce-4761-a98a-4e847b9142bd+23:3647:x1877942638659200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790946083.530091:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946083.530095:0:17132:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40baef1200/0xd9f4181e0d27e438 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27e431 expref: 23 pid: 17141 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946083.530104:0:17132:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40baef1200/0xd9f4181e0d27e438 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27e431 expref: 23 pid: 17141 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946083.530117:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946083.530142:0:17132:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87d8d138-d2ce-4761-a98a-4e847b9142bd+23:3647:x1877942638659200:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946083.530155:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790946083.530190:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790946083.530196:0:17132:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83d40450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87d8d138-d2ce-4761-a98a-4e847b9142bd+22:3650:x1877942638659328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790946083.530204:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946083.530209:0:17132:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40baef0e00/0xd9f4181e0d27e42a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27e423 expref: 22 pid: 17140 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946083.530217:0:17132:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40baef0e00/0xd9f4181e0d27e42a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27e423 expref: 22 pid: 17140 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946083.530240:0:17132:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d4092afd200/0xd9f4181e0d27e4e0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946083.530248:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d4092afd200/0xd9f4181e0d27e4e0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790946083.530260:0:17132:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005307552s 00010000:00010000:1.0:1790946083.530265:0:17132:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d4092afd200/0xd9f4181e0d27e4e0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946083.530273:0:17132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d4092afd200/0xd9f4181e0d27e4e0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946083.530279:0:17132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d4092afd200/0xd9f4181e0d27e4e0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946083.530286:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d4092afd200/0xd9f4181e0d27e4e0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946083.530291:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afd200 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:1.0:1790946083.530301:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d4092afd200/0xd9f4181e0d27e4e0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946083.530308:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d4092afd200/0xd9f4181e0d27e4e0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946083.530317:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d4092afd200/0xd9f4181e0d27e4e0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946083.530325:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946083.530352:0:17132:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83d40450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87d8d138-d2ce-4761-a98a-4e847b9142bd+22:3650:x1877942638659328:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946083.530358:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790946083.530413:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:87d8d138-d2ce-4761-a98a-4e847b9142bd:3650:1877942638659328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790946083.530450:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:87d8d138-d2ce-4761-a98a-4e847b9142bd:3647:1877942638659200:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790946083.530472:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40baef1200/0xd9f4181e0d27e438 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27e431 expref: 21 pid: 17141 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946083.530482:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d02d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17163:1877942638658944:0@lo:104: 00010000:00010000:1.0:1790946083.530491:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40baef0e00/0xd9f4181e0d27e42a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27e423 expref: 20 pid: 17140 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946083.530497:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d03480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17163:1877942638659072:0@lo:104: 00010000:00010000:1.0:1790946083.530508:0:17163:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d4092afd200/0xd9f4181e0d27e4e0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946083.530517:0:17163:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d4092afd200/0xd9f4181e0d27e4e0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946083.530534:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d4092afd200/0xd9f4181e0d27e4e0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946083.530541:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d4092afd200/0xd9f4181e0d27e4e0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946083.530607:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+19:18662:x1877942638658816:12345-0@lo:253:mount.lustre.0 Request processed in 9344us (9539us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946083.530615:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1790946083.532141:0:18662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84415880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:18662:1877942638658816:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790946083.532157:0:18662:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1790946083.532160:0:18662:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790946083.532162:0:18662:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790946083.532163:0:18662:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790946083.532164:0:18662:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790946083.532223:0:18662:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790946083.532226:0:18662:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790946083.532239:0:18662:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790946083.532241:0:18662:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790946083.532242:0:18662:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790946083.532258:0:18662:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:2.0:1790946083.535264:0:18662:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1790946083.539252:0:18662:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1790946083.539265:0:18662:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1790946083.539321:0:18662:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790946083.539371:0:18662:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.120@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790946083.539394:0:18662:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1790946083.539414:0:18662:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1790946083.540054:0:18662:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790946083.540297:0:18662:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1790946084.127480:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1790946084.395525:0:18741:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790946084.395754:0:18741:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790946085.156817:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946085.215825:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638659456:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790946085.215909:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946085.216269:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638659456 00000100:00100000:0.0:1790946085.216289:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638659456 00000100:00100000:0.0:1790946085.216337:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790946085.216346:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84415880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638659456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790946085.216391:0:17153:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1790946085.216439:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84415880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638659456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946085.216446:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790946085.216503:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638659456:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790946085.219811:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638659584:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790946085.219958:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946085.220338:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638659584 00000100:00100000:0.0:1790946085.220346:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638659584 00000100:00100000:0.0:1790946085.220399:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790946085.220409:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638659584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790946085.220444:0:17153:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790946085.221301:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638659584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 890us (1339us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946085.221311:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790946085.227394:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638659584:0@lo:41:osp-pre-1-0.0 10000000:01000000:1.0:1790946085.280420:0:17144:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790946085.280427:0:17144:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d40871f9800 from 9 10000000:01000000:1.0:1790946085.280432:0:17144:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790946085.280490:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4092afde00/0xd9f4181e0d27e4e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946085.280501:0:17144:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d4092afde00/0xd9f4181e0d27e4e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946085.280511:0:17144:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d4092afde00/0xd9f4181e0d27e4e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946085.280535:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d03480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638659712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790946085.280603:0:17144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946085.280656:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40baeab000 going to sleep for 11 seconds 00000100:00100000:2.0:1790946085.280848:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638659712 00000100:00100000:2.0:1790946085.280857:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638659712 00000100:00100000:2.0:1790946085.280918:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790946085.280927:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+19:17144:x1877942638659712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790946085.280941:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946085.280955:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3f83c64e00/0xd9f4181e0d27e4ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27e4e7 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946085.280977:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3f83c64e00/0xd9f4181e0d27e4ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27e4e7 expref: 20 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946085.280988:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3f83c64e00/0xd9f4181e0d27e4ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27e4e7 expref: 20 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946085.280997:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c64e00, rc 0) 00000100:00100000:2.0:1790946085.281044:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+20:17144:x1877942638659712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946085.281051:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790946085.281094:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d03480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638659712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790946085.281110:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d4092afde00/0xd9f4181e0d27e4e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e4ee expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946085.281133:0:17144:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d4092afde00/0xd9f4181e0d27e4e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e4ee expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946085.281221:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638659840:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1790946085.281252:0:17144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946085.281274:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408aaf0180 going to sleep for 11 seconds 00000100:00100000:2.0:1790946085.281290:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638659840 00000100:00100000:2.0:1790946085.281294:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638659840 00000100:00100000:2.0:1790946085.281317:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1790946085.281323:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+20:17144:x1877942638659840:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790946085.281336:0:17140:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790946085.281353:0:17140:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790946085.281357:0:17140:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1790946085.281429:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+20:17144:x1877942638659840:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 106us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946085.281436:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1790946085.281710:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638659840:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1790946085.281765:0:17144:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790946085.281772:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4092afde00/0xd9f4181e0d27e4e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e4ee expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946085.281780:0:17144:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d4092afde00/0xd9f4181e0d27e4e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e4ee expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946085.281790:0:17144:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790946085.281792:0:17144:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d3f81bb7000 from 9 10000000:01000000:2.0:1790946085.281799:0:17144:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790946085.281816:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64a00/0xd9f4181e0d27e4f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946085.281824:0:17144:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64a00/0xd9f4181e0d27e4f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946085.281832:0:17144:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64a00/0xd9f4181e0d27e4f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946085.281845:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638659968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790946085.281872:0:17144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946085.281887:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408aaf0180 going to sleep for 11 seconds 00000100:00100000:2.0:1790946085.281903:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638659968 00000100:00100000:2.0:1790946085.281908:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638659968 00000100:00100000:2.0:1790946085.281929:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790946085.281934:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+20:17144:x1877942638659968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790946085.281942:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946085.281950:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3f83c65600/0xd9f4181e0d27e4fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27e4f5 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946085.281966:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3f83c65600/0xd9f4181e0d27e4fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27e4f5 expref: 21 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946085.281974:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3f83c65600/0xd9f4181e0d27e4fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27e4f5 expref: 21 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946085.281980:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c65600, rc 0) 00000100:00100000:2.0:1790946085.282007:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+21:17144:x1877942638659968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 73us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946085.282021:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790946085.282051:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638659968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790946085.282062:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64a00/0xd9f4181e0d27e4f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e4fc expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946085.282070:0:17144:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64a00/0xd9f4181e0d27e4f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e4fc expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946085.282105:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638660096:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1790946085.282133:0:17144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946085.282147:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408aaf0180 going to sleep for 11 seconds 00000100:00100000:2.0:1790946085.282160:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638660096 00000100:00100000:2.0:1790946085.282163:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638660096 00000100:00100000:2.0:1790946085.282232:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790946085.282238:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+21:17144:x1877942638660096:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790946085.282249:0:17140:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790946085.282261:0:17140:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790946085.282263:0:17140:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1790946085.282325:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+21:17144:x1877942638660096:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 86us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946085.282332:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790946085.282359:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638660096:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1790946085.282397:0:17144:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790946085.282402:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64a00/0xd9f4181e0d27e4f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e4fc expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946085.282417:0:17144:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64a00/0xd9f4181e0d27e4f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e4fc expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946086.177434:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790946086.687783:0:17181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790946087.205725:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946088.224335:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790946088.799509:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790946088.799517:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790946088.799519:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790946088.799523:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790946088.799538:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790946088.799542:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790946088.799552:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790946088.799555:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790946088.799603:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:87d8d138-d2ce-4761-a98a-4e847b9142bd:3648:1877942638660224:0@lo:400:kworker.0 00000100:00100000:0.0:1790946088.799682:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946088.799724:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1877942638660736:0@lo:400:kworker.0 00000100:00100000:0.0:1790946088.799750:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946088.799777:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790946088.799783:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638660608:0@lo:400:kworker.0 00000100:00100000:0.0:1790946088.799807:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946088.799843:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638660352:0@lo:400:kworker.0 00000100:00100000:0.0:1790946088.799868:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946088.799883:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40baceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1877942638660864:0@lo:400:kworker.0 00000100:00100000:0.0:1790946088.801418:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946088.801462:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1790946088.802359:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877942638660480:0@lo:400:kworker.0 00000100:00100000:0.0:1790946088.802408:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946088.802434:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1877942638660992:0@lo:400:kworker.0 00000100:00100000:0.0:1790946088.802454:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946088.802503:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638660224 00000100:00100000:0.0:1790946088.802513:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638660224 00000100:00100000:0.0:1790946088.802565:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790946088.802574:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+21:3648:x1877942638660224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946088.803084:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+21:3648:x1877942638660224:12345-0@lo:400:kworker.0 Request processed in 509us (3399us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946088.803104:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790946088.804069:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638660736 00000100:00100000:0.0:1790946088.804080:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638660736 00000100:00100000:0.0:1790946088.804341:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638660864 00000100:00100000:0.0:1790946088.804346:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638660864 00000100:00100000:0.0:1790946088.804382:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638660480 00000100:00100000:0.0:1790946088.804386:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638660480 00000100:00100000:0.0:1790946088.804396:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638660992 00000100:00100000:0.0:1790946088.804399:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638660992 00000100:00100000:0.0:1790946088.804415:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790946088.804422:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bacefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1877942638660736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946088.804502:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bacefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1877942638660736:12345-0@lo:400:kworker.0 Request processed in 79us (4750us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946088.804509:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790946088.804525:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790946088.804532:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bacedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877942638660864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946088.804567:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bacedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877942638660864:12345-0@lo:400:kworker.0 Request processed in 35us (3150us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946088.804573:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790946088.804585:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790946088.804591:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bacec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877942638660480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946088.804617:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bacec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877942638660480:12345-0@lo:400:kworker.0 Request processed in 27us (2209us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946088.804623:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790946088.804633:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790946088.804639:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40baceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877942638660992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946088.804680:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40baceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877942638660992:12345-0@lo:400:kworker.0 Request processed in 42us (2225us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946088.804686:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790946088.804709:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638660608 00000100:00100000:0.0:1790946088.804712:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638660608 00000100:00100000:0.0:1790946088.804726:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638660352 00000100:00100000:0.0:1790946088.804728:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638660352 00000100:00100000:0.0:1790946088.804740:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790946088.804745:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bacec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638660608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946088.804777:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bacec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638660608:12345-0@lo:400:kworker.0 Request processed in 31us (4968us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946088.804783:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790946088.804794:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790946088.804800:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bacedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638660352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946088.804826:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bacedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638660352:12345-0@lo:400:kworker.0 Request processed in 26us (4957us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946088.804831:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790946088.804883:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638660608:0@lo:400:kworker.0 00000100:00100000:0.0:1790946088.804894:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:87d8d138-d2ce-4761-a98a-4e847b9142bd:3648:1877942638660224:0@lo:400:kworker.0 00010000:00080000:0.0:1790946088.804908:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f8265f480 x1877942638660736/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946088.804919:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1877942638660736:0@lo:400:kworker.0 00010000:00080000:0.0:1790946088.804955:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f8265c000 x1877942638660480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946088.804964:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877942638660480:0@lo:400:kworker.0 00010000:00080000:0.0:1790946088.804983:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d40bacef100 x1877942638660992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946088.804991:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1877942638660992:0@lo:400:kworker.0 00000100:00100000:0.0:1790946088.805001:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638660352:0@lo:400:kworker.0 00010000:00080000:0.0:1790946088.805010:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d40baceed80 x1877942638660864/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946088.805018:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40baceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1877942638660864:0@lo:400:kworker.0 00000100:00080000:2.0:1790946088.813422:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790946088.813433:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790946089.252043:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790946089.915125:0:19031:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1790946090.282204:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946090.340490:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638661120:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790946090.340575:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946090.340688:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638661120 00000100:00100000:2.0:1790946090.340696:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638661120 00000100:00100000:2.0:1790946090.340838:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790946090.340850:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40baceed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638661120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790946090.340885:0:17152:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790946090.340938:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40baceed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638661120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946090.340945:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790946090.341907:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638661248:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790946090.341954:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946090.346989:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638661248 00000100:00100000:0.0:1790946090.347004:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638661248 00000100:00100000:0.0:1790946090.347059:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790946090.347069:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84414a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638661248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790946090.347148:0:17153:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1790946090.347413:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84414a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638661248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 345us (5457us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946090.347422:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790946090.347482:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638661120:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790946090.347575:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638661248:0@lo:41:osp-pre-0-1.0 00000020:00000004:1.0:1790946091.103525:0:19083:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790946091.105964:0:19083:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:0.0:1790946091.170715:0:17919:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790946091.307344:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1790946092.070696:0:19133:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790946092.074681:0:19133:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1790946092.320589:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946093.343507:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790946093.923314:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790946093.923320:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790946093.923323:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790946093.923340:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790946093.923375:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790946093.923378:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790946093.923380:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790946093.923383:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790946093.923419:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:87d8d138-d2ce-4761-a98a-4e847b9142bd:3649:1877942638661376:0@lo:400:kworker.0 00000100:00100000:0.0:1790946093.923491:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946093.923542:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638661888:0@lo:400:kworker.0 00000100:00100000:0.0:1790946093.923573:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946093.923599:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1790946093.923604:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40baced500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638661504:0@lo:400:kworker.0 00000100:00100000:0.0:1790946093.923626:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946093.923640:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1877942638662016:0@lo:400:kworker.0 00000100:00100000:0.0:1790946093.923658:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946093.923684:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638661632:0@lo:400:kworker.0 00000100:00100000:0.0:1790946093.923705:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946093.923735:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1877942638662144:0@lo:400:kworker.0 00000100:00100000:0.0:1790946093.923755:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946093.923768:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790946093.923773:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638661760:0@lo:400:kworker.0 00000100:00100000:0.0:1790946093.923791:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946093.923822:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638661888 00000100:00100000:0.0:1790946093.923833:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638661888 00000100:00100000:0.0:1790946093.923879:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638662016 00000100:00100000:0.0:1790946093.923882:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638662016 00000100:00100000:0.0:1790946093.923907:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638661632 00000100:00100000:0.0:1790946093.923909:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638661632 00000100:00100000:0.0:1790946093.923919:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638662144 00000100:00100000:0.0:1790946093.923921:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638662144 00000100:00100000:0.0:1790946093.923936:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790946093.923944:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638661888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946093.923999:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638661888:12345-0@lo:400:kworker.0 Request processed in 55us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946093.924006:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790946093.924038:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790946093.924045:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f845ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877942638662016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946093.924075:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f845ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877942638662016:12345-0@lo:400:kworker.0 Request processed in 31us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946093.924081:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790946093.924092:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790946093.924097:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f845ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638661632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946093.924127:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f845ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638661632:12345-0@lo:400:kworker.0 Request processed in 29us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946093.924133:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790946093.924144:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790946093.924150:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f845edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1877942638662144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946093.924201:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f845edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1877942638662144:12345-0@lo:400:kworker.0 Request processed in 52us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946093.924207:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790946093.924225:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638661504 00000100:00100000:0.0:1790946093.924235:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638661504 00000100:00100000:0.0:1790946093.924254:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638661760 00000100:00100000:0.0:1790946093.924257:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638661760 00000100:00100000:0.0:1790946093.924267:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790946093.924272:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f845eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638661504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946093.924305:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f845eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638661504:12345-0@lo:400:kworker.0 Request processed in 34us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946093.924311:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790946093.924322:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790946093.924327:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f845ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638661760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946093.924352:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f845ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638661760:12345-0@lo:400:kworker.0 Request processed in 24us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946093.924357:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790946093.924402:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638661760:0@lo:400:kworker.0 00010000:00080000:0.0:1790946093.924418:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d40bacec000 x1877942638661632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946093.924428:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638661632:0@lo:400:kworker.0 00010000:00080000:0.0:1790946093.924437:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f8265d180 x1877942638662144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946093.924444:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1877942638662144:0@lo:400:kworker.0 00000100:00100000:0.0:1790946093.924476:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40baced500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638661504:0@lo:400:kworker.0 00010000:00080000:0.0:1790946093.924485:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f8265f480 x1877942638662016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946093.924493:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1877942638662016:0@lo:400:kworker.0 00010000:00080000:0.0:1790946093.924511:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f8265c000 x1877942638661888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946093.924520:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638661888:0@lo:400:kworker.0 00000100:00100000:1.0:1790946093.924709:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638661376 00000100:00100000:1.0:1790946093.924715:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638661376 00000100:00100000:1.0:1790946093.924745:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1790946093.924753:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+21:3649:x1877942638661376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946093.924796:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+21:3649:x1877942638661376:12345-0@lo:400:kworker.0 Request processed in 44us (1305us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946093.924803:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1790946093.924839:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:87d8d138-d2ce-4761-a98a-4e847b9142bd:3649:1877942638661376:0@lo:400:kworker.0 00000100:00080000:3.0:1790946093.928688:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790946093.928698:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790946094.367919:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946094.815298:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790946079/real 1790946079] req@ffff9d40baced180 x1877942638654848/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946094 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946094.815335:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d40baced180 x1877942638654848/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946094 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946094.815345:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790946079/real 1790946079] req@ffff9d40bacef480 x1877942638654976/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946094 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946094.815355:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d40bacef480 x1877942638654976/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946094 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790946094.815397:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d4099032000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790946094.815432:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790946094.815437:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40baced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638654848:0@lo:8:kworker.0 00000100:00080000:2.0:1790946094.815442:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40914e2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790946094.815447:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790946094.815450:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638654976:0@lo:8:kworker.0 00000100:00080000:3.0:1790946094.815584:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790946094.815590:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790946094.815594:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790946094.815597:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790946094.815614:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1790946094.815619:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638662400:0@lo:400:kworker.0 00000100:00080000:3.0:1790946094.815620:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1790946094.815625:0:36:0:(import.c:65:import_set_state_nolock()) ffff9d4099032000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790946094.815632:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 529 00000100:00080000:3.0:1790946094.815638:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1790946094.815648:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9d4099032000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1790946094.815669:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f84415f80 x1877942638662784/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790946094.815686:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790946094.815689:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790946094.815691:0:36:0:(import.c:65:import_set_state_nolock()) ffff9d40914e2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790946094.815695:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 529 00000100:00080000:3.0:1790946094.815704:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00100000:2.0:1790946094.815705:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790946094.815711:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9d40914e2800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1790946094.815727:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f84417480 x1877942638662912/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790946094.815742:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790946094.815751:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877942638662528:0@lo:400:kworker.0 00000100:00100000:3.0:1790946094.815778:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1877942638663296:0@lo:400:kworker.0 00000100:00100000:2.0:1790946094.815785:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946094.815809:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84414e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1877942638663168:0@lo:400:kworker.0 00000100:00100000:3.0:1790946094.815824:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946094.815875:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946094.815935:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:87d8d138-d2ce-4761-a98a-4e847b9142bd:3648:1877942638662272:0@lo:400:kworker.0 00000100:00100000:1.0:1790946094.816492:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84416680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638662656:0@lo:400:kworker.0 00000100:00100000:0.0:1790946094.819598:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946094.819625:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946094.819670:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1877942638663040:0@lo:400:kworker.0 00000100:00100000:0.0:1790946094.819711:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946094.819775:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638662272 00000100:00100000:2.0:1790946094.819785:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638662272 00000100:00100000:2.0:1790946094.819847:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1790946094.819857:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+21:3648:x1877942638662272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946094.819867:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638662400 00000100:00100000:0.0:1790946094.819874:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638662400 00000100:00100000:0.0:1790946094.819896:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638662656 00000100:00100000:0.0:1790946094.819899:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638662656 00000100:00100000:0.0:1790946094.819915:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790946094.819923:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638662400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946094.819928:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+21:3648:x1877942638662272:12345-0@lo:400:kworker.0 Request processed in 71us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946094.819937:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790946094.819993:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638662400:12345-0@lo:400:kworker.0 Request processed in 70us (4289us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946094.820000:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790946094.820029:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790946094.820036:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638662656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946094.820081:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638662656:12345-0@lo:400:kworker.0 Request processed in 45us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946094.820087:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790946094.820299:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638662528 00000100:00100000:3.0:1790946094.820304:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638662528 00000100:00100000:3.0:1790946094.820326:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638662784:0@lo:8:kworker.0 00000100:00100000:3.0:1790946094.820359:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946094.820382:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638662912:0@lo:8:kworker.0 00000100:00100000:3.0:1790946094.820404:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946094.820576:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638663296 00000100:00100000:0.0:1790946094.820581:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638663296 00000100:00100000:0.0:1790946094.820606:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638663168 00000100:00100000:0.0:1790946094.820609:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638663168 00000100:00100000:0.0:1790946094.820618:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638663040 00000100:00100000:0.0:1790946094.820632:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638663040 00000100:00100000:0.0:1790946094.820648:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790946094.820654:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83def480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1877942638663296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946094.820704:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83def480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1877942638663296:12345-0@lo:400:kworker.0 Request processed in 50us (4880us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946094.820710:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790946094.820722:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790946094.820727:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877942638663168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946094.820754:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877942638663168:12345-0@lo:400:kworker.0 Request processed in 27us (4881us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946094.820760:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790946094.820770:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790946094.820775:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f845ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1877942638663040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946094.820799:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f845ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1877942638663040:12345-0@lo:400:kworker.0 Request processed in 24us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946094.820803:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790946094.820842:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84416680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638662656:0@lo:400:kworker.0 00010000:00080000:0.0:1790946094.820879:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f84414e00 x1877942638663168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946094.820889:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84414e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1877942638663168:0@lo:400:kworker.0 00000100:00100000:0.0:1790946094.820900:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638662400:0@lo:400:kworker.0 00000100:00100000:0.0:1790946094.820924:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:87d8d138-d2ce-4761-a98a-4e847b9142bd:3648:1877942638662272:0@lo:400:kworker.0 00010000:00080000:0.0:1790946094.820934:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f84414000 x1877942638663040/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946094.820955:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1877942638663040:0@lo:400:kworker.0 00010000:00080000:2.0:1790946094.821446:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f84415c00 x1877942638663296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946094.821458:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1877942638663296:0@lo:400:kworker.0 00000100:00100000:1.0:1790946094.821621:0:18666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638662784 00000100:00100000:1.0:1790946094.821627:0:18666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638662784 00000100:00100000:1.0:1790946094.821657:0:18666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638662912 00000100:00100000:1.0:1790946094.821660:0:18666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638662912 00000100:00100000:1.0:1790946094.821672:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790946094.821679:0:18666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83dee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1877942638662784:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1790946094.821710:0:18666:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 545 last 0 00000020:00000080:1.0:1790946094.821740:0:18666:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd9f4181e0d27e503 00002000:00100000:1.0:1790946094.821757:0:18666:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9d40bae3e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1790946094.821762:0:18666:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1790946094.821765:0:18666:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1790946094.821963:0:18666:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1790946094.822277:0:18666:0:(import.c:65:import_set_state_nolock()) ffff9d40bae3c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790946094.822348:0:18666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83dee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1877942638662784:12345-0@lo:8:kworker.0 Request processed in 668us (1987us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946094.822355:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790946094.822373:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790946094.822378:0:18666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83def800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1877942638662912:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1790946094.822395:0:18666:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1790946094.822837:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f84415f80 x1877942638662784/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790946114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946094.822848:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790946094.822855:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1790946094.822863:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1790946094.822869:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1790946094.822872:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d4099032000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1790946094.822888:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1790946094.822893:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638662784:0@lo:8:kworker.0 00000004:00080000:0.0:1790946094.822921:0:17901:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1790946094.823023:0:17901:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 545638853858ns, next at 0ns, rc = 0 00080000:00080000:0.0:1790946094.823030:0:17901:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:3.0:1790946094.826485:0:17902:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1790946094.826518:0:17902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83dec380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17902:1877942638663552:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1790946094.826590:0:17902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946094.826623:0:17902:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40baf8fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1790946094.826652:0:18669:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1790946094.826660:0:18669:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1790946094.826782:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790946094.826797:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83dece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638663424:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790946094.826827:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946094.826868:0:18669:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638663552 00000100:00100000:3.0:1790946094.826875:0:18669:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638663552 00000100:00080000:3.0:1790946094.826926:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790946094.827024:0:19252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790946094.827035:0:19252:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ded880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17902:x1877942638663552:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1790946094.829188:0:18670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638663424 00000100:00100000:0.0:1790946094.829200:0:18670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638663424 00000100:00100000:0.0:1790946094.829260:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790946094.829270:0:18670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83deca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3648:x1877942638663424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790946094.829295:0:18670:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1790946094.829379:0:18670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83deca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3648:x1877942638663424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (2551us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946094.829387:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1790946094.829487:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f83dece00 x1877942638663424/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946110 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946094.829507:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83dece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638663424:0@lo:13:osp-pre-0-1.0 00000004:00080000:0.0:1790946094.830366:0:17893:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1790946094.830429:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790946094.830439:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877942638662528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946094.830506:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877942638662528:12345-0@lo:400:kworker.0 Request processed in 69us (14723us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946094.830512:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1790946094.830745:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f84415500 x1877942638662528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946094.830759:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877942638662528:0@lo:400:kworker.0 00002000:00080000:3.0:1790946094.835029:0:19252:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1790946094.835042:0:19252:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1790946094.835247:0:19252:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ded880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17902:x1877942638663552:12345-0@lo:7:osp-pre-0-1.0 Request processed in 8208us (8651us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946094.835258:0:19252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1790946094.835501:0:17902:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f83dec380 x1877942638663552/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790946110 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946094.835516:0:17902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83dec380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17902:1877942638663552:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1790946094.835532:0:17902:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:0.0:1790946094.835577:0:17902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f845ed180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17902:1877942638663680:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1790946094.835615:0:17902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946094.835725:0:17902:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40a71f83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790946094.835960:0:18669:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638663680 00000100:00100000:3.0:1790946094.835968:0:18669:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638663680 00000100:00100000:3.0:1790946094.836027:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790946094.836037:0:18669:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f845ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17902:x1877942638663680:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1790946094.836075:0:18669:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1790946094.836244:0:18669:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f845ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17902:x1877942638663680:12345-0@lo:5:osp-pre-0-1.0 Request processed in 208us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946094.836251:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1790946094.836377:0:17902:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f845ed180 x1877942638663680/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790946110 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946094.836389:0:17902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f845ed180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17902:1877942638663680:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1790946094.836399:0:17902:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1790946094.836430:0:17902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17902:1877942638663808:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1790946094.836457:0:17902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946094.836516:0:17902:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40871c6840 going to sleep for 11 seconds 00000100:00100000:3.0:1790946094.838539:0:19252:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638663808 00000100:00100000:3.0:1790946094.838556:0:19252:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638663808 00000100:00100000:3.0:1790946094.838672:0:19252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790946094.838683:0:19252:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17902:x1877942638663808:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1790946094.838729:0:19252:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:1.0:1790946094.851108:0:18666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83def800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1877942638662912:12345-0@lo:8:kworker.0 Request processed in 28718us (30692us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790946094.851121:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1790946094.853135:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40914e2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790946094.853147:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790946094.853153:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638662912:0@lo:8:kworker.0 00000001:00080000:0.0:1790946094.870284:0:18663:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1790946094.870301:0:18663:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00010000:00080000:2.0:1790946094.870745:0:17902:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f825a4000 x1877942638663808/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790946110 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946094.870758:0:17902:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1790946094.870765:0:17902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17902:1877942638663808:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1790946094.870782:0:17902:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:2.0:1790946094.870834:0:17902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17902:1877942638663936:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1790946094.870867:0:17902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946094.870897:0:17902:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40871c6840 going to sleep for 11 seconds 00000100:00100000:0.0:1790946094.870965:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638663936 00000100:00100000:0.0:1790946094.870971:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638663936 00000100:00100000:0.0:1790946094.871035:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790946094.871043:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17902:x1877942638663936:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1790946094.871094:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17902:x1877942638663936:12345-0@lo:900:osp-pre-0-1.0 Request processed in 51us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946094.871100:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790946094.871266:0:17902:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f825a4000 x1877942638663936/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790946110 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946094.871276:0:17902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17902:1877942638663936:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1790946094.871346:0:19252:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17902:x1877942638663808:12345-0@lo:5:osp-pre-0-1.0 Request processed in 32665us (34887us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1790946094.871355:0:19252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1790946095.391703:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946095.455288:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790946095.455490:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83ded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638664064:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790946095.455560:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946095.455612:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638664064 00000100:00100000:3.0:1790946095.455620:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638664064 00000100:00100000:3.0:1790946095.457870:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790946095.457886:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83dedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638664064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790946095.457925:0:17153:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1790946095.458255:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83dedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638664064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 372us (2693us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946095.458263:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790946095.458325:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83ded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638664064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790946095.460130:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638664192:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790946095.460229:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946095.460262:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638664192 00000100:00100000:2.0:1790946095.460272:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638664192 00000100:00100000:2.0:1790946095.460328:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790946095.460338:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638664192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790946095.460374:0:17153:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790946095.460429:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638664192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946095.460436:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790946095.461134:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638664192:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1790946096.423070:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790946096.928789:0:17181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790946097.439576:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946098.463451:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790946099.016687:0:19479:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790946099.016691:0:19479:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1790946099.016693:0:19479:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1790946099.017006:0:19479:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9d40bff17000 00000020:01000004:0.0:1790946099.017022:0:19479:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1790946099.017037:0:19479:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1790946099.017051:0:19479:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9d40b44199c0) 00000020:00000080:0.0:1790946099.017070:0:19479:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1790946099.103218:0:19479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1790946099.105143:0:19479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1790946099.105697:0:19479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1790946099.106375:0:19479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1790946099.107081:0:19479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1790946099.107538:0:19479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1790946099.107823:0:19479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:2.0:1790946099.115067:0:19479:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1790946099.115370:0:19479:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1790946099.115401:0:19479:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790946099.115414:0:19479:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd9f4181e0d27e511 00000020:01000004:2.0:1790946099.115421:0:19479:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1790946099.115444:0:19479:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.120@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790946099.115448:0:19479:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790946099.115455:0:19479:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1790946099.115485:0:19479:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1790946099.115490:0:19479:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.120@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1790946099.133679:0:19479:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.120@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790946099.133727:0:19479:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.120@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1790946099.133733:0:19479:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790946099.133734:0:19479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790946099.133741:0:19479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790946099.133742:0:19479:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790946099.133743:0:19479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790946099.133745:0:19479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790946099.133746:0:19479:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790946099.133748:0:19479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790946099.133749:0:19479:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790946099.133753:0:19479:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1790946099.133755:0:19479:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790946099.133756:0:19479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790946099.133757:0:19479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790946099.133758:0:19479:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790946099.133759:0:19479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790946099.133760:0:19479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790946099.133761:0:19479:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790946099.133762:0:19479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790946099.133763:0:19479:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790946099.133790:0:19479:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1790946099.133811:0:19479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83ded180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:19479:1877942638664320:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790946099.133895:0:19479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946099.134029:0:19479:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40baf8f300 going to sleep for 11 seconds 00000100:00100000:0.0:1790946099.134144:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638664320 00000100:00100000:0.0:1790946099.134152:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638664320 00000100:00100000:0.0:1790946099.134361:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790946099.134384:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+21:19479:x1877942638664320:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790946099.134433:0:17140:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1790946099.134437:0:17140:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1790946099.134440:0:17140:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1790946099.134838:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+21:19479:x1877942638664320:12345-0@lo:253:mount.lustre.0 Request processed in 466us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946099.134847:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790946099.134933:0:19479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83ded180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:19479:1877942638664320:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790946099.134946:0:19479:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1790946099.134948:0:19479:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790946099.134949:0:19479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790946099.134950:0:19479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790946099.134951:0:19479:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790946099.134952:0:19479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790946099.134954:0:19479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790946099.134955:0:19479:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790946099.134956:0:19479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790946099.134957:0:19479:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790946099.134975:0:19479:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d40bff17000 from lustre-OST0001 10000000:01000000:3.0:1790946099.135003:0:19479:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1790946099.135006:0:19479:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1790946099.135014:0:19479:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d40bc9e4d40 local copy 00010000:00010000:3.0:1790946099.135025:0:19479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4092afd400/0xd9f4181e0d27e22b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e232 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946099.135129:0:19479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83ded180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:19479:1877942638664448:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790946099.135207:0:19479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946099.136092:0:19479:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40baf8f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790946099.136973:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638664448 00000100:00100000:2.0:1790946099.136985:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638664448 00000100:00100000:2.0:1790946099.137053:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1790946099.137062:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+21:19479:x1877942638664448:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790946099.137540:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+21:19479:x1877942638664448:12345-0@lo:501:mount.lustre.0 Request processed in 478us (2371us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790946099.137548:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1790946099.137803:0:19479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83ded180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:19479:1877942638664448:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1790946099.137826:0:19479:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1790946099.137855:0:19479:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1790946099.137864:0:19479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4092afd400/0xd9f4181e0d27e22b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e232 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946099.137874:0:19479:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d4092afd400/0xd9f4181e0d27e22b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e232 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946099.137903:0:19479:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d40bff17000 10000000:01000000:3.0:1790946099.137908:0:19479:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790946099.137914:0:19479:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1790946099.137918:0:19479:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790946099.138112:0:19479:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1790946099.138116:0:19479:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1790946099.138153:0:19479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef1800/0xd9f4181e0d27e518 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946099.138162:0:19479:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40baef1800/0xd9f4181e0d27e518 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946099.138319:0:19479:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40baef1800/0xd9f4181e0d27e518 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946099.138355:0:19479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83ded180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:19479:1877942638664576:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790946099.138481:0:19479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946099.138522:0:19479:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40baf8f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790946099.138594:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638664576 00000100:00100000:2.0:1790946099.138600:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638664576 00000100:00100000:2.0:1790946099.138683:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1790946099.138691:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+21:19479:x1877942638664576:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790946099.138715:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946099.138729:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3f83c64000/0xd9f4181e0d27e51f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27e518 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946099.138750:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3f83c64000/0xd9f4181e0d27e51f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27e518 expref: 22 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946099.138761:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3f83c64000/0xd9f4181e0d27e51f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27e518 expref: 22 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946099.138769:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c64000, rc 0) 00000100:00100000:2.0:1790946099.138812:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+22:19479:x1877942638664576:12345-0@lo:101:mount.lustre.0 Request processed in 121us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946099.138819:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1790946099.138878:0:19479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83ded180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:19479:1877942638664576:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790946099.138891:0:19479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40baef1800/0xd9f4181e0d27e518 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e51f expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946099.138899:0:19479:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40baef1800/0xd9f4181e0d27e518 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e51f expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790946099.140352:0:19479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1790946099.141076:0:19479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790946099.143326:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1790946099.143721:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1790946099.143748:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1790946099.143763:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1790946099.143777:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1790946099.143791:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1790946099.143820:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1790946099.143826:0:19479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1790946099.143941:0:19479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83ded180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:19479:1877942638664704:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790946099.144009:0:19479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946099.144090:0:19479:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40baf8f540 going to sleep for 11 seconds 00000100:00100000:0.0:1790946099.144132:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638664704 00000100:00100000:0.0:1790946099.144140:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638664704 00000100:00100000:0.0:1790946099.144348:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790946099.144359:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+22:19479:x1877942638664704:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790946099.144600:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+22:19479:x1877942638664704:12345-0@lo:501:mount.lustre.0 Request processed in 242us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946099.144607:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1790946099.145074:0:19479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83ded180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:19479:1877942638664704:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790946099.145119:0:19479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83ded180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:19479:1877942638664832:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790946099.145197:0:19479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946099.145241:0:19479:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40baf8f540 going to sleep for 11 seconds 00000100:00100000:1.0:1790946099.145300:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638664832 00000100:00100000:1.0:1790946099.145306:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638664832 00000100:00100000:1.0:1790946099.145346:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790946099.145354:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+22:19479:x1877942638664832:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790946099.146263:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+22:19479:x1877942638664832:12345-0@lo:503:mount.lustre.0 Request processed in 905us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946099.146274:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1790946099.146481:0:19479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83ded180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:19479:1877942638664832:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790946099.147006:0:19479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790946099.147086:0:19479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83ded180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:19479:1877942638664960:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790946099.147140:0:19479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946099.147337:0:19479:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40baf8f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790946099.147375:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638664960 00000100:00100000:2.0:1790946099.147455:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638664960 00000100:00100000:2.0:1790946099.147545:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1790946099.147555:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+22:19479:x1877942638664960:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790946099.148050:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+22:19479:x1877942638664960:12345-0@lo:502:mount.lustre.0 Request processed in 495us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946099.148065:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1790946099.148141:0:19479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83ded180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:19479:1877942638664960:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790946099.148364:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1790946099.148411:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1790946099.148425:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1790946099.148438:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1790946099.148451:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1790946099.148464:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1790946099.148478:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1790946099.148491:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1790946099.148504:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1790946099.148536:0:19479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83ded180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:19479:1877942638665088:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790946099.148740:0:19479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946099.148943:0:19479:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40baf8f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790946099.149008:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638665088 00000100:00100000:1.0:1790946099.149015:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638665088 00000100:00100000:1.0:1790946099.149053:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1790946099.149061:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+22:19479:x1877942638665088:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790946099.149185:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+22:19479:x1877942638665088:12345-0@lo:502:mount.lustre.0 Request processed in 105us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946099.149193:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1790946099.149297:0:19479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83ded180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:19479:1877942638665088:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790946099.149344:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1790946099.149355:0:19479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1790946099.150200:0:19483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790946099.150209:0:19483:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1790946099.150216:0:19483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946099.150218:0:19483:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1790946099.150223:0:19483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790946099.150239:0:19483:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9d4084804d40) 00000020:00000080:3.0:1790946099.150271:0:19483:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1790946099.150278:0:19483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790946099.150360:0:19483:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d40bff17000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1790946099.150369:0:19483:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:3.0:1790946099.150488:0:19483:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd9f4181e0d27e52d 00010000:00010000:3.0:1790946099.157860:0:19483:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1790946099.158476:0:19483:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:3.0:1790946099.159996:0:19483:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1790946099.162980:0:19483:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1790946099.162993:0:19483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790946099.163000:0:19483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946099.163002:0:19483:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1790946099.163006:0:19483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790946099.163010:0:19483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946099.163011:0:19483:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790946099.163014:0:19483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790946099.163017:0:19483:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790946099.163019:0:19483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790946099.163022:0:19483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946099.163023:0:19483:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1790946099.163025:0:19483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790946099.163027:0:19483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946099.163029:0:19483:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790946099.163032:0:19483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1790946099.163067:0:19483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790946099.163070:0:19483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946099.163072:0:19483:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790946099.163075:0:19483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1790946099.168033:0:19479:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1790946099.168085:0:19479:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1790946099.168146:0:19479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef1800/0xd9f4181e0d27e518 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e51f expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946099.168161:0:19479:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40baef1800/0xd9f4181e0d27e518 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e51f expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946099.168195:0:19479:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d40bff17000 from 1 10000000:01000000:2.0:1790946099.168198:0:19479:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790946099.168239:0:19479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64800/0xd9f4181e0d27e534 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946099.168248:0:19479:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64800/0xd9f4181e0d27e534 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946099.168260:0:19479:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64800/0xd9f4181e0d27e534 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946099.168288:0:19479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:19479:1877942638665216:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790946099.168368:0:19479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946099.168425:0:19479:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40996616c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790946099.168996:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638665216 00000100:00100000:1.0:1790946099.169005:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638665216 00000100:00100000:1.0:1790946099.169063:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1790946099.169073:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+22:19479:x1877942638665216:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790946099.169088:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946099.169101:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d4092afc000/0xd9f4181e0d27e53b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27e534 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946099.169138:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d4092afc000/0xd9f4181e0d27e53b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27e534 expref: 23 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946099.169148:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d4092afc000/0xd9f4181e0d27e53b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27e534 expref: 23 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946099.169157:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4092afc000, rc 0) 00000100:00100000:1.0:1790946099.169222:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+23:19479:x1877942638665216:12345-0@lo:101:mount.lustre.0 Request processed in 150us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946099.169228:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790946099.169586:0:19479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:19479:1877942638665216:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790946099.169602:0:19479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64800/0xd9f4181e0d27e534 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e53b expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946099.169611:0:19479:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64800/0xd9f4181e0d27e534 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e53b expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790946099.174109:0:19479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1790946099.174783:0:19479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790946099.175317:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1790946099.175347:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1790946099.175367:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1790946099.175505:0:19479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1790946099.175678:0:19479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:19479:1877942638665344:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790946099.176081:0:19479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946099.176276:0:19479:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4099661600 going to sleep for 11 seconds 00000100:00100000:0.0:1790946099.176332:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638665344 00000100:00100000:0.0:1790946099.176341:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638665344 00000100:00100000:0.0:1790946099.176509:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1790946099.176520:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+23:19479:x1877942638665344:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790946099.176717:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+23:19479:x1877942638665344:12345-0@lo:501:mount.lustre.0 Request processed in 198us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946099.176743:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790946099.176954:0:19479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:19479:1877942638665344:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790946099.176996:0:19479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:19479:1877942638665472:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790946099.177111:0:19479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946099.177138:0:19479:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4099661600 going to sleep for 11 seconds 00000100:00100000:0.0:1790946099.177238:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638665472 00000100:00100000:0.0:1790946099.177243:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638665472 00000100:00100000:0.0:1790946099.177273:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1790946099.177280:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+23:19479:x1877942638665472:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790946099.177373:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+23:19479:x1877942638665472:12345-0@lo:503:mount.lustre.0 Request processed in 92us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946099.177438:0:19479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:19479:1877942638665472:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790946099.177505:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000040:00080000:2.0:1790946099.178312:0:19479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790946099.178386:0:19479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:19479:1877942638665600:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790946099.178438:0:19479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946099.178515:0:19479:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40996616c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790946099.178553:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638665600 00000100:00100000:1.0:1790946099.178642:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638665600 00000100:00100000:1.0:1790946099.178688:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1790946099.178696:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+23:19479:x1877942638665600:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790946099.178804:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+23:19479:x1877942638665600:12345-0@lo:502:mount.lustre.0 Request processed in 108us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946099.178811:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790946099.178885:0:19479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:19479:1877942638665600:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790946099.179090:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1790946099.179118:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1790946099.179135:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1790946099.179155:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1790946099.179211:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1790946099.179230:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1790946099.179257:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1790946099.179278:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1790946099.179293:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1790946099.179305:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1790946099.179317:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1790946099.179338:0:19479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:19479:1877942638665728:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790946099.179375:0:19479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946099.179396:0:19479:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40996616c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790946099.179456:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638665728 00000100:00100000:0.0:1790946099.179461:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638665728 00000100:00100000:0.0:1790946099.179496:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1790946099.179503:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8238b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+23:19479:x1877942638665728:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790946099.179606:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8238b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+23:19479:x1877942638665728:12345-0@lo:502:mount.lustre.0 Request processed in 103us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946099.179612:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1790946099.179708:0:19479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:19479:1877942638665728:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790946099.179753:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1790946099.179765:0:19479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1790946099.181340:0:19487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790946099.181354:0:19487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946099.181356:0:19487:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790946099.181365:0:19487:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d40bff17000 00000020:00000080:0.0:1790946099.181367:0:19487:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790946099.181377:0:19487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790946099.181380:0:19487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946099.181381:0:19487:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1790946099.181384:0:19487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790946099.181387:0:19487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946099.181388:0:19487:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790946099.181391:0:19487:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d40bff17000 00000020:00000080:0.0:1790946099.181393:0:19487:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790946099.181508:0:19487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790946099.181512:0:19487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946099.181514:0:19487:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1790946099.181516:0:19487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790946099.181519:0:19487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946099.181520:0:19487:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790946099.181523:0:19487:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d40bff17000 00000020:00000080:0.0:1790946099.181525:0:19487:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790946099.182134:0:19487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790946099.182140:0:19487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946099.182141:0:19487:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790946099.182144:0:19487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790946099.182146:0:19487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946099.182147:0:19487:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1790946099.182150:0:19487:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d40bff17000 00000020:00000080:0.0:1790946099.182152:0:19487:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790946099.182292:0:19487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790946099.182295:0:19487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946099.182296:0:19487:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1790946099.182299:0:19487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1790946099.182728:0:19479:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1790946099.182760:0:19479:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790946099.182821:0:19479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64800/0xd9f4181e0d27e534 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e53b expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946099.182833:0:19479:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64800/0xd9f4181e0d27e534 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e53b expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946099.182884:0:19479:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790946099.182888:0:19479:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d40bff17000 10000000:01000000:3.0:1790946099.182891:0:19479:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d40bff17000 10000000:01000000:3.0:1790946099.182894:0:19479:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790946099.182899:0:19479:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d40bff17000 from 1 10000000:01000000:3.0:1790946099.182902:0:19479:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790946099.182947:0:19479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef0200/0xd9f4181e0d27e542 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946099.182957:0:19479:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40baef0200/0xd9f4181e0d27e542 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946099.182978:0:19479:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40baef0200/0xd9f4181e0d27e542 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946099.183000:0:19479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83ded180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:19479:1877942638665856:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790946099.183064:0:19479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946099.183111:0:19479:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40baf8f300 going to sleep for 11 seconds 00000100:00100000:0.0:1790946099.183188:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638665856 00000100:00100000:0.0:1790946099.183195:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638665856 00000100:00100000:0.0:1790946099.183234:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1790946099.183243:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f82388c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+23:19479:x1877942638665856:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790946099.183255:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946099.183267:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40bcbe0c00/0xd9f4181e0d27e549 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27e542 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946099.183288:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40bcbe0c00/0xd9f4181e0d27e549 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27e542 expref: 24 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946099.183298:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40bcbe0c00/0xd9f4181e0d27e549 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27e542 expref: 24 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946099.183311:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe0c00, rc 0) 00000100:00100000:0.0:1790946099.183353:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f82388c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+24:19479:x1877942638665856:12345-0@lo:101:mount.lustre.0 Request processed in 111us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946099.183360:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1790946099.183408:0:19479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83ded180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:19479:1877942638665856:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790946099.183422:0:19479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40baef0200/0xd9f4181e0d27e542 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e549 expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946099.183431:0:19479:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40baef0200/0xd9f4181e0d27e542 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e549 expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790946099.192626:0:19479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:1.0:1790946099.192903:0:19479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790946099.193097:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1790946099.193120:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1790946099.193135:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1790946099.193148:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1790946099.193161:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1790946099.193205:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1790946099.193220:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1790946099.193232:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1790946099.193245:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1790946099.193266:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1790946099.193279:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1790946099.193291:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1790946099.193304:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1790946099.193318:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1790946099.193332:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1790946099.193363:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1790946099.193378:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1790946099.193393:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1790946099.193406:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1790946099.193418:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1790946099.193432:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1790946099.193445:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1790946099.193461:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1790946099.193474:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1790946099.193486:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1790946099.193499:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1790946099.193510:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1790946099.193522:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1790946099.193533:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1790946099.193545:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1790946099.193556:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1790946099.193600:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1790946099.193616:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1790946099.193630:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1790946099.193642:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1790946099.193654:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1790946099.193667:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1790946099.193681:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1790946099.193695:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:1.0:1790946099.193708:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:1.0:1790946099.193720:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:1.0:1790946099.193735:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:1.0:1790946099.193760:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:1.0:1790946099.193775:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:1.0:1790946099.193789:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:1.0:1790946099.193802:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:1.0:1790946099.193821:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:1.0:1790946099.193827:0:19479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:1.0:1790946099.193910:0:19479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d00700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:19479:1877942638665984:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790946099.193994:0:19479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946099.194049:0:19479:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4d07300 going to sleep for 11 seconds 00000100:00100000:3.0:1790946099.194426:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638665984 00000100:00100000:3.0:1790946099.194434:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638665984 00000100:00100000:3.0:1790946099.194484:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1790946099.194496:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f82388850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+24:19479:x1877942638665984:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790946099.194633:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f82388850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+24:19479:x1877942638665984:12345-0@lo:501:mount.lustre.0 Request processed in 140us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946099.194642:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790946099.194824:0:19479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d00700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:19479:1877942638665984:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790946099.194858:0:19479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d00700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:19479:1877942638666112:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790946099.194896:0:19479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946099.194970:0:19479:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4d07300 going to sleep for 11 seconds 00000100:00100000:2.0:1790946099.195011:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638666112 00000100:00100000:2.0:1790946099.195016:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638666112 00000100:00100000:2.0:1790946099.195054:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1790946099.195061:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f82388050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+24:19479:x1877942638666112:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790946099.195253:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f82388050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+24:19479:x1877942638666112:12345-0@lo:503:mount.lustre.0 Request processed in 192us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946099.195259:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790946099.195434:0:19479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d00700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:19479:1877942638666112:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790946099.195864:0:19479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790946099.195950:0:19479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d00700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:19479:1877942638666240:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790946099.195992:0:19479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946099.196064:0:19479:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4d07300 going to sleep for 11 seconds 00000100:00100000:2.0:1790946099.196099:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638666240 00000100:00100000:2.0:1790946099.196104:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638666240 00000100:00100000:2.0:1790946099.196187:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1790946099.196195:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8238a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+24:19479:x1877942638666240:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790946099.196276:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8238a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+24:19479:x1877942638666240:12345-0@lo:502:mount.lustre.0 Request processed in 82us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946099.196282:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790946099.196356:0:19479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d00700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:19479:1877942638666240:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790946099.196523:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1790946099.196547:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1790946099.196576:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1790946099.196592:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1790946099.196605:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1790946099.196618:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1790946099.196631:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1790946099.196646:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1790946099.196669:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1790946099.196684:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1790946099.196697:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1790946099.196711:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1790946099.196723:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1790946099.196752:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1790946099.196767:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1790946099.196780:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1790946099.196794:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1790946099.196807:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1790946099.196819:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1790946099.196832:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1790946099.196846:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1790946099.196858:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1790946099.196869:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1790946099.196883:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1790946099.196897:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1790946099.196911:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1790946099.196937:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1790946099.196954:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1790946099.196968:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1790946099.196995:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1790946099.197011:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1790946099.197026:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1790946099.197040:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1790946099.197054:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1790946099.197067:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1790946099.197080:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1790946099.197092:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1790946099.197103:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1790946099.197114:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1790946099.197127:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1790946099.197141:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1790946099.197164:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1790946099.197201:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1790946099.197221:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1790946099.197236:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1790946099.197262:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1790946099.197277:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1790946099.197290:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1790946099.197329:0:19479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d00700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:19479:1877942638666368:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790946099.197379:0:19479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946099.197651:0:19479:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4d07300 going to sleep for 11 seconds 00000100:00100000:3.0:1790946099.197710:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638666368 00000100:00100000:3.0:1790946099.197717:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638666368 00000100:00100000:3.0:1790946099.197755:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1790946099.197763:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8238a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+24:19479:x1877942638666368:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790946099.197905:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8238a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+24:19479:x1877942638666368:12345-0@lo:502:mount.lustre.0 Request processed in 142us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946099.197913:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790946099.198068:0:19479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d00700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:19479:1877942638666368:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790946099.198341:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1790946099.198366:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1790946099.198464:0:19479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d00700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:19479:1877942638666496:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790946099.198501:0:19479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946099.198532:0:19479:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4d07300 going to sleep for 11 seconds 00000100:00100000:2.0:1790946099.198643:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638666496 00000100:00100000:2.0:1790946099.198648:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638666496 00000100:00100000:2.0:1790946099.198687:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1790946099.198694:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8238a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+24:19479:x1877942638666496:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790946099.198771:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8238a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+24:19479:x1877942638666496:12345-0@lo:502:mount.lustre.0 Request processed in 77us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946099.198782:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1790946099.198957:0:19479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d00700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:19479:1877942638666496:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790946099.199002:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1790946099.199010:0:19479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1790946099.201528:0:19492:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1790946099.201546:0:19492:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9d40b4a419c0) 00000020:00000080:3.0:1790946099.201572:0:19492:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1790946099.201674:0:19492:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d40bff17000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1790946099.201679:0:19492:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d40bff17000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1790946099.201681:0:19492:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d40bff17000 3 00010000:00080000:3.0:1790946099.201715:0:19492:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d3f82763800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.120@tcp at head 00010000:00010000:3.0:1790946099.203611:0:19492:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1790946099.203880:0:19492:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1790946099.203934:0:19492:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790946099.203945:0:19492:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xd9f4181e0d27e557 00000100:00080000:3.0:1790946099.203954:0:19492:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790946099.203964:0:19492:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9d3f82763800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1790946099.203995:0:19492:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f83dee680 x1877942638666624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790946099.204019:0:19492:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1790946099.204517:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83dee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1877942638666624:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790946099.204610:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790946099.204707:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790946099.204712:0:15915:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790946099.204715:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790946099.204718:0:15915:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790946099.204761:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790946099.204764:0:15915:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790946099.204767:0:15915:0:(import.c:65:import_set_state_nolock()) ffff9d40914e2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790946099.204772:0:15915:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 545 00000100:00080000:0.0:1790946099.204776:0:15915:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1790946099.204782:0:15915:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9d40914e2800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1790946099.204803:0:15915:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f845eed80 x1877942638667264/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790946099.204962:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f845edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638666752:0@lo:400:kworker.0 00000100:00100000:2.0:1790946099.205048:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946099.205060:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f845eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638667008:0@lo:400:kworker.0 00000100:00100000:2.0:1790946099.205071:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f845ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877942638667392:0@lo:400:kworker.0 00000100:00100000:2.0:1790946099.205091:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946099.205107:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946099.205108:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790946099.205114:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f845ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638667136:0@lo:400:kworker.0 00000100:00100000:1.0:1790946099.205124:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f845ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1877942638667648:0@lo:400:kworker.0 00000100:00100000:2.0:1790946099.205136:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946099.205144:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946099.205157:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1790946099.205161:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f845ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877942638666880:0@lo:400:kworker.0 00000100:00100000:2.0:1790946099.205163:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638666752 00000100:00100000:2.0:1790946099.205187:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638666752 00000100:00100000:1.0:1790946099.205199:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946099.205209:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f845ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1877942638667520:0@lo:400:kworker.0 00000100:00100000:2.0:1790946099.205220:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638667008 00000100:00100000:2.0:1790946099.205223:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638667008 00000100:00100000:1.0:1790946099.205235:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946099.205252:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790946099.205259:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638666752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946099.205314:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638666752:12345-0@lo:400:kworker.0 Request processed in 54us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946099.205321:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790946099.205336:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790946099.205341:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638667008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946099.205374:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638667008:12345-0@lo:400:kworker.0 Request processed in 33us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946099.205403:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790946099.205423:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638666624 00000100:00100000:2.0:1790946099.205427:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638666624 00000100:00100000:2.0:1790946099.205440:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638667392 00000100:00100000:2.0:1790946099.205442:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638667392 00000100:00100000:2.0:1790946099.205463:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638667648 00000100:00100000:2.0:1790946099.205466:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638667648 00000100:00100000:2.0:1790946099.205486:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638666880 00000100:00100000:2.0:1790946099.205489:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638666880 00000100:00100000:2.0:1790946099.205497:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638667520 00000100:00100000:2.0:1790946099.205500:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638667520 00000100:00100000:2.0:1790946099.205511:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790946099.205516:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877942638667392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946099.205548:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877942638667392:12345-0@lo:400:kworker.0 Request processed in 31us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946099.205553:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790946099.205563:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790946099.205569:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1877942638667648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946099.205596:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1877942638667648:12345-0@lo:400:kworker.0 Request processed in 28us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946099.205602:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790946099.205614:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790946099.205619:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1877942638666880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946099.205645:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1877942638666880:12345-0@lo:400:kworker.0 Request processed in 26us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946099.205650:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790946099.205660:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790946099.205665:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1877942638667520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946099.205688:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1877942638667520:12345-0@lo:400:kworker.0 Request processed in 23us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946099.205692:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790946099.205701:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790946099.205711:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f845efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1877942638666624:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1790946099.205734:0:17147:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 550 last 0 00000020:00000080:2.0:1790946099.205764:0:17147:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xd9f4181e0d27e55e 00000004:00100000:2.0:1790946099.205783:0:17147:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790946099.205820:0:17147:0:(import.c:65:import_set_state_nolock()) ffff9d3f83c39800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790946099.205852:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f845efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1877942638666624:12345-0@lo:38:llog_process_th.0 Request processed in 141us (1243us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946099.205858:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790946099.205886:0:18669:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638667136 00000100:00100000:2.0:1790946099.205889:0:18669:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638667136 00000100:00100000:0.0:1790946099.205903:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f845eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638667264:0@lo:8:kworker.0 00000100:00100000:2.0:1790946099.205915:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790946099.205934:0:18669:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638667136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946099.205964:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946099.205965:0:18669:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638667136:12345-0@lo:400:kworker.0 Request processed in 45us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946099.205971:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790946099.205981:0:18669:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638667264 00000100:00100000:2.0:1790946099.205984:0:18669:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638667264 00010000:00080000:0.0:1790946099.205999:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f83dee680 x1877942638666624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790946109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946099.206000:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790946099.206004:0:18669:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f845ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3646:x1877942638667264:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1790946099.206011:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790946099.206019:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1790946099.206026:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1790946099.206030:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790946099.206033:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d3f82763800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790946099.206039:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83dee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1877942638666624:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790946099.206048:0:18669:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f845ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3646:x1877942638667264:12345-0@lo:8:kworker.0 Request processed in 42us (84us total) trans 0 rc -11/-11 00000100:00100000:2.0:1790946099.206053:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790946099.206058:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790946099.206061:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40914e2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790946099.206064:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1790946099.206067:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f845eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638667264:0@lo:8:kworker.0 00010000:00080000:2.0:1790946099.206076:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f845ed880 x1877942638666880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946099.206085:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f845ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877942638666880:0@lo:400:kworker.0 00010000:00080000:2.0:1790946099.206094:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f845ef800 x1877942638667520/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946099.206112:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f845ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1877942638667520:0@lo:400:kworker.0 00000100:00100000:2.0:1790946099.206125:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f845eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638667008:0@lo:400:kworker.0 00010000:00080000:2.0:1790946099.206134:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f845ee300 x1877942638667648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946099.206141:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f845ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1877942638667648:0@lo:400:kworker.0 00000100:00080000:2.0:1790946099.206162:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790946099.206183:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790946099.206185:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1790946099.206204:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f845ed500 x1877942638667136/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946099.206212:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f845ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638667136:0@lo:400:kworker.0 00000100:00100000:2.0:1790946099.206221:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f845edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638666752:0@lo:400:kworker.0 00010000:00080000:2.0:1790946099.206229:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f845ec000 x1877942638667392/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946099.206236:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f845ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877942638667392:0@lo:400:kworker.0 00000020:01000004:3.0:1790946099.207591:0:19492:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1790946099.207610:0:19492:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9d40b4a40000) 00000020:00000080:3.0:1790946099.207634:0:19492:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1790946099.207713:0:19492:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d40bff17000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1790946099.207717:0:19492:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d40bff17000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1790946099.207720:0:19492:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d40bff17000 3 00010000:00080000:3.0:1790946099.207748:0:19492:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d3f82761000@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.120@tcp at head 00010000:00010000:3.0:1790946099.210007:0:19492:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1790946099.210264:0:19492:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1790946099.210304:0:19492:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790946099.210315:0:19492:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xd9f4181e0d27e56c 00000100:00080000:3.0:1790946099.210326:0:19492:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790946099.210336:0:19492:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9d3f82761000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1790946099.210512:0:19492:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f83ded500 x1877942638667776/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790946099.210537:0:19492:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1790946099.211107:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83ded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1877942638667776:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790946099.211197:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790946099.211274:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790946099.211280:0:15915:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790946099.211282:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790946099.211285:0:15915:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790946099.211306:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638667776 00000100:00100000:0.0:1790946099.211319:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638667776 00000100:00100000:0.0:1790946099.211354:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790946099.211362:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f845eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1877942638667776:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1790946099.211393:0:17147:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 550 last 0 00000020:00000080:0.0:1790946099.211425:0:17147:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xd9f4181e0d27e573 00000004:00100000:0.0:1790946099.211441:0:17147:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790946099.211475:0:17147:0:(import.c:65:import_set_state_nolock()) ffff9d3f820bf800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790946099.211532:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f845eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1877942638667776:12345-0@lo:38:llog_process_th.0 Request processed in 169us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946099.211540:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1790946099.211596:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f83ded500 x1877942638667776/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790946109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946099.211608:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790946099.211616:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1790946099.211623:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1790946099.211627:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1790946099.211629:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d3f82761000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790946099.211634:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83ded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1877942638667776:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1790946099.212667:0:19492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1790946099.212758:0:19479:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1790946099.212788:0:19479:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790946099.212809:0:19479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef0200/0xd9f4181e0d27e542 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e549 expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946099.212821:0:19479:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40baef0200/0xd9f4181e0d27e542 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e549 expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790946099.212869:0:19479:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790946099.212871:0:19479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790946099.212873:0:19479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790946099.212874:0:19479:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790946099.212875:0:19479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790946099.212877:0:19479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790946099.212878:0:19479:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790946099.212880:0:19479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790946099.212882:0:19479:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790946099.212886:0:19479:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1790946099.212889:0:19479:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790946099.212890:0:19479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790946099.212891:0:19479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790946099.212892:0:19479:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790946099.212893:0:19479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790946099.212894:0:19479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790946099.212895:0:19479:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790946099.212896:0:19479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790946099.212897:0:19479:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790946099.212947:0:19479:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1790946099.212964:0:19479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4d02a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:19479:1877942638667904:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790946099.213017:0:19479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946099.213050:0:19479:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4d079c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790946099.216685:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638667904 00000100:00100000:0.0:1790946099.216704:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638667904 00000100:00100000:0.0:1790946099.216777:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1790946099.216788:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8238b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+24:19479:x1877942638667904:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790946099.216822:0:17140:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1790946099.216837:0:17140:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1790946099.220539:0:17140:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1790946099.220566:0:17140:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1790946099.220676:0:17163:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790946099.220681:0:17163:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790946099.220704:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d40baef1400/0xd9f4181e0d27e57a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946099.220726:0:17163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3f83c64e00/0xd9f4181e0d27e4ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27e4e7 expref: 24 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946099.220734:0:17163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3f83c65600/0xd9f4181e0d27e4fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27e4f5 expref: 24 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946099.220758:0:17163:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d40baef1400/0xd9f4181e0d27e57a lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946099.220797:0:17163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3f83c65600/0xd9f4181e0d27e4fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27e4f5 expref: 24 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946099.220812:0:17163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d3f83c65600/0xd9f4181e0d27e4fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27e4f5 expref: 24 pid: 17140 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946099.220826:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83dedc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17163:1877942638668032:0@lo:104: 00000100:00100000:3.0:1790946099.220893:0:17163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790946099.220952:0:17163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3f83c64e00/0xd9f4181e0d27e4ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27e4e7 expref: 24 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946099.220961:0:17163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d3f83c64e00/0xd9f4181e0d27e4ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27e4e7 expref: 24 pid: 17142 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946099.220970:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83deed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17163:1877942638668160:0@lo:104: 00000100:00100000:3.0:1790946099.220991:0:17163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946099.221023:0:17163:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40baeab780 going to sleep for 11 seconds 00000100:00100000:3.0:1790946099.221049:0:17130:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638668032 00000100:00100000:3.0:1790946099.221057:0:17130:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638668032 00000100:00100000:3.0:1790946099.221089:0:17130:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638668160 00000100:00100000:3.0:1790946099.221093:0:17130:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638668160 00000100:00100000:3.0:1790946099.221106:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790946099.221114:0:17130:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83def100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:87d8d138-d2ce-4761-a98a-4e847b9142bd+4:17163:x1877942638668032:12345-0@lo:104: 00010000:00010000:3.0:1790946099.221127:0:17130:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64a00/0xd9f4181e0d27e4f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27e4fc expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946099.221197:0:17130:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790946099.221204:0:17130:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83def100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:87d8d138-d2ce-4761-a98a-4e847b9142bd+4:17163:x1877942638668032:12345-0@lo:104: Request processed in 90us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946099.221211:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790946099.221228:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790946099.221234:0:17130:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83dec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:87d8d138-d2ce-4761-a98a-4e847b9142bd+3:17163:x1877942638668160:12345-0@lo:104: 00010000:00010000:3.0:1790946099.221242:0:17130:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d4092afde00/0xd9f4181e0d27e4e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27e4ee expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946099.221277:0:17130:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790946099.221282:0:17130:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83dec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:87d8d138-d2ce-4761-a98a-4e847b9142bd+3:17163:x1877942638668160:12345-0@lo:104: Request processed in 49us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946099.221288:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1790946099.221325:0:18315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790946099.221332:0:18315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64a00/0xd9f4181e0d27e4f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27e4fc expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946099.221340:0:18315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c64a00 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:3.0:1790946099.221343:0:18315:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64a00/0xd9f4181e0d27e4f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27e4fc expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946099.221359:0:18315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64a00/0xd9f4181e0d27e4f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27e4fc expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790946099.221365:0:18315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64a00/0xd9f4181e0d27e4f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27e4fc expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946099.221371:0:18315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790946099.225270:0:18315:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64a00/0xd9f4181e0d27e4f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27e4fc expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946099.225286:0:18315:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790946099.225320:0:18315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64a00/0xd9f4181e0d27e4f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27e4fc expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946099.225329:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64a00/0xd9f4181e0d27e4f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27e4fc expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946099.225343:0:18315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790946099.225347:0:18315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d4092afde00/0xd9f4181e0d27e4e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27e4ee expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946099.225354:0:18315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afde00 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:3.0:1790946099.225358:0:18315:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d4092afde00/0xd9f4181e0d27e4e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27e4ee expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946099.225366:0:18315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d4092afde00/0xd9f4181e0d27e4e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27e4ee expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790946099.225373:0:18315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d4092afde00/0xd9f4181e0d27e4e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27e4ee expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946099.225389:0:18315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790946099.225404:0:18315:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d4092afde00/0xd9f4181e0d27e4e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27e4ee expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946099.225409:0:18315:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790946099.225414:0:18315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d4092afde00/0xd9f4181e0d27e4e7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27e4ee expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946099.225420:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d4092afde00/0xd9f4181e0d27e4e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27e4ee expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946099.225433:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946099.225435:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946099.225437:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946099.225444:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946099.225461:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:87d8d138-d2ce-4761-a98a-4e847b9142bd:3649:1877942638668288:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790946099.225532:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946099.225590:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790946099.225596:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:87d8d138-d2ce-4761-a98a-4e847b9142bd:3649:1877942638668416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790946099.225621:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946099.225658:0:17133:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638668288 00000100:00100000:3.0:1790946099.225665:0:17133:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638668288 00000100:00100000:1.0:1790946099.225667:0:17134:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638668416 00000100:00100000:1.0:1790946099.225670:0:17134:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638668416 00010000:00010000:3.0:1790946099.225692:0:17133:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3f83c65600/0xd9f4181e0d27e4fc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27e4f5 expref: 26 pid: 17140 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946099.225692:0:17134:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3f83c64e00/0xd9f4181e0d27e4ee lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27e4e7 expref: 26 pid: 17142 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946099.225724:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790946099.225732:0:17134:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ded500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:87d8d138-d2ce-4761-a98a-4e847b9142bd+26:3649:x1877942638668416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790946099.225746:0:17134:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946099.225750:0:17134:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3f83c64e00/0xd9f4181e0d27e4ee lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27e4e7 expref: 26 pid: 17142 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946099.225759:0:17134:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3f83c64e00/0xd9f4181e0d27e4ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27e4e7 expref: 26 pid: 17142 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946099.225775:0:17134:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946099.225812:0:17134:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ded500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:87d8d138-d2ce-4761-a98a-4e847b9142bd+26:3649:x1877942638668416:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946099.226269:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8238b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+26:19479:x1877942638667904:12345-0@lo:253:mount.lustre.0 Request processed in 9482us (13251us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946099.226278:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790946099.226332:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83dedc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17163:1877942638668032:0@lo:104: 00010000:00010000:2.0:1790946099.226343:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3f83c64e00/0xd9f4181e0d27e4ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27e4e7 expref: 25 pid: 17142 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946099.226352:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83deed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17163:1877942638668160:0@lo:104: 00010000:00010000:2.0:1790946099.226380:0:17163:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d40baef1400/0xd9f4181e0d27e57a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946099.226411:0:19479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4d02a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87d8d138-d2ce-4761-a98a-4e847b9142bd:19479:1877942638667904:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790946099.226422:0:19479:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1790946099.226425:0:19479:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790946099.226426:0:19479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790946099.226428:0:19479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790946099.226429:0:19479:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790946099.226430:0:19479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790946099.226432:0:19479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790946099.226433:0:19479:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790946099.226435:0:19479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790946099.226437:0:19479:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790946099.226446:0:19479:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1790946099.226832:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790946099.226846:0:17133:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83dec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87d8d138-d2ce-4761-a98a-4e847b9142bd+24:3649:x1877942638668288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790946099.226858:0:17133:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946099.226871:0:17133:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3f83c65600/0xd9f4181e0d27e4fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27e4f5 expref: 24 pid: 17140 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946099.226883:0:17133:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3f83c65600/0xd9f4181e0d27e4fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27e4f5 expref: 24 pid: 17140 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946099.226906:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3f83c65600/0xd9f4181e0d27e4fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27e4f5 expref: 24 pid: 17140 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946099.226931:0:17133:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d40baef1400/0xd9f4181e0d27e57a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946099.226941:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40baef1400/0xd9f4181e0d27e57a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790946099.226955:0:17133:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006274516s 00010000:00010000:3.0:1790946099.226960:0:17133:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d40baef1400/0xd9f4181e0d27e57a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946099.226966:0:17133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d40baef1400/0xd9f4181e0d27e57a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946099.226973:0:17133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d40baef1400/0xd9f4181e0d27e57a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946099.226980:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d40baef1400/0xd9f4181e0d27e57a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946099.226986:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef1400 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:3.0:1790946099.226990:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d40baef1400/0xd9f4181e0d27e57a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946099.227009:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d40baef1400/0xd9f4181e0d27e57a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946099.227026:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d40baef1400/0xd9f4181e0d27e57a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946099.227036:0:17133:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790946099.227071:0:17133:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83dec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87d8d138-d2ce-4761-a98a-4e847b9142bd+23:3649:x1877942638668288:12345-0@lo:103:ldlm_bl.0 Request processed in 231us (1539us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946099.227080:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790946099.227115:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:87d8d138-d2ce-4761-a98a-4e847b9142bd:3649:1877942638668416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790946099.227124:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:87d8d138-d2ce-4761-a98a-4e847b9142bd:3649:1877942638668288:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790946099.227143:0:17163:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d40baef1400/0xd9f4181e0d27e57a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946099.227151:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d40baef1400/0xd9f4181e0d27e57a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946099.227157:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40baef1400/0xd9f4181e0d27e57a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946099.229852:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000001:00000004:3.0:1790946099.242864:0:19479:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1790946099.249521:0:19479:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1790946099.249530:0:19479:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1790946099.249566:0:19479:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790946099.249608:0:19479:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.120@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790946099.249627:0:19479:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1790946099.249645:0:19479:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1790946099.253658:0:19479:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790946099.253915:0:19479:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790946099.489329:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1790946100.021615:0:19546:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790946100.027509:0:19546:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1790946100.064659:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790946100.064685:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638668544:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790946100.064765:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946100.064871:0:18670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638668544 00000100:00100000:2.0:1790946100.064881:0:18670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638668544 00000100:00100000:2.0:1790946100.064955:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790946100.064966:0:18670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638668544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790946100.064999:0:18670:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1790946100.065052:0:18670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638668544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946100.065058:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790946100.065141:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f825a4000 x1877942638668544/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946116 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946100.065159:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638668544:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790946100.256308:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790946079/real 1790946079] req@ffff9d3f825a4e00 x1877942638655232/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946099 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946100.256340:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d3f825a4e00 x1877942638655232/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946099 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946100.256366:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790946079/real 1790946079] req@ffff9d3f825a6300 x1877942638655360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946099 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946100.256379:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d3f825a6300 x1877942638655360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946099 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790946100.256399:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d3f81b10000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790946100.256427:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1790946100.256431:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638655232:0@lo:8:kworker.0 00000100:00080000:1.0:1790946100.256437:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40bb1a7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790946100.256443:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1790946100.256446:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638655360:0@lo:8:kworker.0 00000100:00080000:3.0:1790946100.256597:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790946100.256602:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00100000:1.0:1790946100.256706:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:87d8d138-d2ce-4761-a98a-4e847b9142bd:3648:1877942638668672:0@lo:400:kworker.0 00000100:00100000:1.0:1790946100.256777:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790946100.256850:0:36:0:(import.c:65:import_set_state_nolock()) ffff9d3f81b10000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790946100.256856:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 529 00000100:00080000:3.0:1790946100.256861:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1790946100.256948:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9d3f81b10000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1790946100.256973:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f83dee680 x1877942638668928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790946100.256991:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790946100.256994:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790946100.256996:0:36:0:(import.c:65:import_set_state_nolock()) ffff9d40bb1a7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790946100.256999:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 529 00000100:00080000:3.0:1790946100.257002:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1790946100.257007:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d40bb1a7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1790946100.257018:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f83ded180 x1877942638669056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790946100.257051:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790946100.257054:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790946100.257056:0:36:0:(import.c:65:import_set_state_nolock()) ffff9d40914e2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790946100.257062:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9d40914e2800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1790946100.257071:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f83dedc00 x1877942638669568/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790946100.257124:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638668800:0@lo:400:kworker.0 00000100:00100000:3.0:1790946100.257156:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946100.257214:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638669696:0@lo:400:kworker.0 00000100:00100000:3.0:1790946100.257244:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946100.257263:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1877942638670208:0@lo:400:kworker.0 00000100:00100000:3.0:1790946100.257286:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946100.257303:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1790946100.257309:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83dec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877942638669184:0@lo:400:kworker.0 00000100:00100000:3.0:1790946100.257328:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946100.257344:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1877942638669824:0@lo:400:kworker.0 00000100:00100000:3.0:1790946100.257366:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946100.257388:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83deed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638669440:0@lo:400:kworker.0 00000100:00100000:3.0:1790946100.257410:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946100.257427:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1877942638670080:0@lo:400:kworker.0 00000100:00100000:3.0:1790946100.257452:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946100.257463:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1790946100.257469:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83dece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638669312:0@lo:400:kworker.0 00000100:00100000:3.0:1790946100.257489:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946100.257505:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1877942638669952:0@lo:400:kworker.0 00000100:00100000:3.0:1790946100.257524:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946100.257543:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638668800 00000100:00100000:3.0:1790946100.257551:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638668800 00000100:00100000:3.0:1790946100.257585:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638669312 00000100:00100000:3.0:1790946100.257588:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638669312 00000100:00100000:3.0:1790946100.257602:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790946100.257723:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638668672 00000100:00100000:0.0:1790946100.257728:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638668672 00000100:00100000:0.0:1790946100.257766:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1790946100.257774:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f82389050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+22:3648:x1877942638668672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946100.257828:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f82389050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+22:3648:x1877942638668672:12345-0@lo:400:kworker.0 Request processed in 55us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946100.257836:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1790946100.257867:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638669696 00000100:00100000:0.0:1790946100.257884:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638669696 00000100:00100000:0.0:1790946100.257914:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638670208 00000100:00100000:0.0:1790946100.257917:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638670208 00000100:00100000:0.0:1790946100.257941:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638669184 00000100:00100000:0.0:1790946100.257944:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638669184 00000100:00100000:0.0:1790946100.257953:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638669824 00000100:00100000:0.0:1790946100.257955:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638669824 00000100:00100000:0.0:1790946100.257964:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638670080 00000100:00100000:0.0:1790946100.257966:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638670080 00000100:00100000:0.0:1790946100.257976:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638669952 00000100:00100000:0.0:1790946100.257978:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638669952 00000100:00100000:0.0:1790946100.257990:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790946100.257996:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638669696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946100.258035:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638669696:12345-0@lo:400:kworker.0 Request processed in 38us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946100.258041:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790946100.258053:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790946100.258058:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877942638670208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946100.258085:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877942638670208:12345-0@lo:400:kworker.0 Request processed in 27us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946100.258091:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790946100.258102:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790946100.258107:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877942638669184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946100.258142:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877942638669184:12345-0@lo:400:kworker.0 Request processed in 34us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946100.258149:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790946100.258161:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790946100.258185:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877942638669824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946100.258212:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877942638669824:12345-0@lo:400:kworker.0 Request processed in 46us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946100.258219:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790946100.258229:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790946100.258235:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1877942638670080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946100.258263:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1877942638670080:12345-0@lo:400:kworker.0 Request processed in 28us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946100.258269:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790946100.258281:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790946100.258286:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1877942638669952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946100.258313:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1877942638669952:12345-0@lo:400:kworker.0 Request processed in 27us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946100.258318:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1790946100.258339:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790946100.258343:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1790946100.258368:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f833f0700 x1877942638669952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946100.258382:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1877942638669952:0@lo:400:kworker.0 00010000:00080000:0.0:1790946100.258393:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f833f0380 x1877942638670080/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946100.258414:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1877942638670080:0@lo:400:kworker.0 00000100:00100000:0.0:1790946100.258426:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:87d8d138-d2ce-4761-a98a-4e847b9142bd:3648:1877942638668672:0@lo:400:kworker.0 00010000:00080000:0.0:1790946100.258461:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f83dec380 x1877942638669184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946100.258470:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83dec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877942638669184:0@lo:400:kworker.0 00010000:00080000:0.0:1790946100.258479:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f833f3800 x1877942638669824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946100.258486:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1877942638669824:0@lo:400:kworker.0 00010000:00080000:0.0:1790946100.258495:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f833f0e00 x1877942638669696/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946100.258504:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638669696:0@lo:400:kworker.0 00010000:00080000:0.0:1790946100.258512:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f833f1180 x1877942638670208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946100.258520:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1877942638670208:0@lo:400:kworker.0 00000100:00100000:1.0:1790946100.258720:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83dee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638668928:0@lo:8:kworker.0 00000100:00100000:1.0:1790946100.258812:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946100.258853:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83ded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638669056:0@lo:8:kworker.0 00000100:00100000:1.0:1790946100.258893:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946100.258920:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83dedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638669568:0@lo:8:kworker.0 00000100:00100000:1.0:1790946100.258947:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946100.259153:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638668800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946100.259224:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638668800:12345-0@lo:400:kworker.0 Request processed in 75us (2066us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946100.259242:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790946100.259260:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790946100.259266:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638669312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946100.259302:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638669312:12345-0@lo:400:kworker.0 Request processed in 36us (1812us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946100.259308:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790946100.259335:0:18669:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638669440 00000100:00100000:3.0:1790946100.259339:0:18669:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638669440 00000100:00100000:3.0:1790946100.259359:0:18669:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638668928 00000100:00100000:3.0:1790946100.259362:0:18669:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638668928 00000100:00100000:3.0:1790946100.259370:0:18669:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638669056 00000100:00100000:3.0:1790946100.259373:0:18669:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638669056 00000100:00100000:3.0:1790946100.259379:0:18669:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638669568 00000100:00100000:3.0:1790946100.259381:0:18669:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638669568 00000100:00100000:3.0:1790946100.259389:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790946100.259394:0:18669:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638669440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946100.259425:0:18669:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638669440:12345-0@lo:400:kworker.0 Request processed in 30us (2014us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946100.259430:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790946100.259442:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790946100.259445:0:18669:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3646:x1877942638668928:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1790946100.259472:0:18669:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 551 last 0 00000020:00000080:3.0:1790946100.259500:0:18669:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd9f4181e0d27e581 00002000:00100000:3.0:1790946100.259513:0:18669:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9d3f82761800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1790946100.259518:0:18669:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1790946100.259520:0:18669:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1790946100.259711:0:19252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790946100.259716:0:19252:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4d01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1877942638669056:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1790946100.259734:0:19252:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 551 last 0 00000020:00000080:0.0:1790946100.259751:0:19252:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd9f4181e0d27e588 00002000:00100000:0.0:1790946100.259758:0:19252:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9d3f820bb800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1790946100.259761:0:19252:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1790946100.259769:0:19252:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1790946100.260258:0:19252:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790946100.260283:0:19252:0:(import.c:65:import_set_state_nolock()) ffff9d3f820b9800 : changing import state from RECOVER to FULL 00002000:00080000:3.0:1790946100.260500:0:18669:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790946100.260516:0:18669:0:(import.c:65:import_set_state_nolock()) ffff9d3f82766800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790946100.260582:0:19252:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3646:x1877942638669056:12345-0@lo:8:kworker.0 Request processed in 863us (1687us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946100.260591:0:19252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790946100.260622:0:19252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790946100.260626:0:19252:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1877942638669568:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1790946100.260666:0:19252:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 551 last 0 00000020:00000080:0.0:1790946100.260687:0:19252:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd9f4181e0d27e58f 00002000:00100000:0.0:1790946100.260695:0:19252:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9d3f820be800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1790946100.260698:0:19252:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1790946100.260701:0:19252:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1790946100.260730:0:19252:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1790946100.260743:0:19252:0:(import.c:65:import_set_state_nolock()) ffff9d3f820bd000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790946100.260970:0:18669:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4d03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1877942638668928:12345-0@lo:8:kworker.0 Request processed in 1521us (2156us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946100.260978:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790946100.261026:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83dece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638669312:0@lo:400:kworker.0 00010000:00080000:3.0:1790946100.261041:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f83deed80 x1877942638669440/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946100.261050:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83deed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638669440:0@lo:400:kworker.0 00000100:00100000:3.0:1790946100.261084:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638668800:0@lo:400:kworker.0 00000100:00100000:0.0:1790946100.261145:0:19252:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3646:x1877942638669568:12345-0@lo:8:kworker.0 Request processed in 516us (2196us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946100.261151:0:19252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1790946100.263360:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f83ded180 x1877942638669056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790946125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946100.263376:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790946100.263387:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1790946100.263404:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1790946100.263410:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1790946100.263414:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40bb1a7800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1790946100.263444:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1790946100.263451:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83ded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638669056:0@lo:8:kworker.0 00000004:00080000:1.0:1790946100.264910:0:17173:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1790946100.265010:0:17173:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 551080841205ns, next at 0ns, rc = 0 00080000:00080000:1.0:1790946100.265019:0:17173:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1790946100.265698:0:17174:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:0.0:1790946100.265725:0:17174:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f845edf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17174:1877942638670464:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1790946100.265796:0:17174:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946100.265829:0:17174:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bcbcd180 going to sleep for 11 seconds 00000100:00100000:0.0:1790946100.265847:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790946100.265858:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f845ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638670336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790946100.265898:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946100.265944:0:18670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638670336 00000100:00100000:0.0:1790946100.265953:0:18670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638670336 00000100:00100000:0.0:1790946100.266022:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790946100.266032:0:18670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f845ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1877942638670336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790946100.266061:0:18670:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790946100.266109:0:18670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f845ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1877942638670336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946100.266116:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1790946100.266140:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790946100.266152:0:18669:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638670464 00000100:00100000:0.0:1790946100.266155:0:18669:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638670464 00000100:00100000:0.0:1790946100.266196:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790946100.266203:0:18669:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f845ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17174:x1877942638670464:12345-0@lo:5:osp-pre-1-0.0 00010000:00080000:0.0:1790946100.266453:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f845ec000 x1877942638670336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946116 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946100.266471:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f845ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638670336:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1790946100.266510:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f83dedc00 x1877942638669568/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790946125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790946100.266522:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1790946100.266529:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1790946100.266533:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1790946100.266536:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40914e2800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1790946100.266564:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1790946100.266569:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83dedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638669568:0@lo:8:kworker.0 00010000:00080000:0.0:1790946100.266609:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f83dee680 x1877942638668928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790946125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946100.266616:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790946100.266628:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1790946100.266634:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1790946100.266638:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1790946100.266639:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d3f81b10000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1790946100.266650:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1790946100.266653:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83dee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638668928:0@lo:8:kworker.0 00000004:00080000:0.0:1790946100.266697:0:17904:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1790946100.266713:0:17904:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f845eea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17904:1877942638670720:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1790946100.266744:0:17904:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946100.266760:0:17904:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bcbcdd80 going to sleep for 11 seconds 00000004:00080000:0.0:1790946100.266782:0:17172:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:0.0:1790946100.266792:0:17172:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f845ed180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17172:1877942638670976:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1790946100.266812:0:17172:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946100.266825:0:17172:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bcbcd6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790946100.266837:0:18666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638670720 00000100:00100000:0.0:1790946100.266840:0:18666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638670720 00000100:00100000:0.0:1790946100.266868:0:18666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638670976 00000100:00100000:0.0:1790946100.266870:0:18666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638670976 00000100:00100000:0.0:1790946100.266885:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790946100.266890:0:18666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f845ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17904:x1877942638670720:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1790946100.266936:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f845ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638670592:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790946100.266959:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946100.266976:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790946100.266981:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f845ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638670848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790946100.266997:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946100.267019:0:18671:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638670592 00000100:00100000:0.0:1790946100.267029:0:18671:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638670592 00000100:00100000:0.0:1790946100.267045:0:18671:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638670848 00000100:00100000:0.0:1790946100.267047:0:18671:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638670848 00000100:00100000:0.0:1790946100.267059:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790946100.267065:0:18671:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83dedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3647:x1877942638670592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790946100.267075:0:18671:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790946100.267106:0:18671:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83dedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3647:x1877942638670592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946100.267113:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790946100.267124:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790946100.267130:0:18671:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ded180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1877942638670848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790946100.267138:0:18671:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1790946100.267158:0:18671:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ded180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1877942638670848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 29us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946100.267164:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1790946100.267199:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790946100.267202:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1790946100.267221:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f845ed880 x1877942638670848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946116 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946100.267234:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f845ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638670848:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1790946100.267243:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f845ec000 x1877942638670592/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946116 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946100.267253:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f845ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638670592:0@lo:13:osp-pre-1-1.0 00000004:00080000:2.0:1790946100.267700:0:17903:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790946100.267781:0:17903:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 551083612691ns, next at 0ns, rc = 0 00080000:00080000:2.0:1790946100.267788:0:17903:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1790946100.267810:0:17171:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790946100.267843:0:17171:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 551083674777ns, next at 0ns, rc = 0 00080000:00080000:2.0:1790946100.267847:0:17171:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1790946100.269160:0:17127:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1790946100.271986:0:17893:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:0.0:1790946100.272070:0:17127:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:0.0:1790946100.274758:0:18669:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1790946100.274769:0:18669:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1790946100.274783:0:18669:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00002000:00080000:1.0:1790946100.282054:0:18666:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1790946100.282068:0:18666:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1790946100.282197:0:18666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f845ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17904:x1877942638670720:12345-0@lo:7:osp-pre-1-1.0 Request processed in 15299us (15445us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946100.282209:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790946100.282254:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790946100.282267:0:18666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83dee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17172:x1877942638670976:12345-0@lo:5:osp-pre-0-0.0 00010000:00080000:2.0:1790946100.282822:0:17904:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f845eea00 x1877942638670720/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790946116 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946100.282842:0:17904:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f845eea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17904:1877942638670720:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1790946100.282859:0:17904:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1790946100.282928:0:17904:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17904:1877942638671104:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1790946100.282977:0:17904:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946100.283009:0:17904:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4091069180 going to sleep for 11 seconds 00000100:00100000:2.0:1790946100.283029:0:18667:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1790946100.283039:0:18667:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00002000:00080000:1.0:1790946100.283590:0:18666:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1790946100.283600:0:18666:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1790946100.283605:0:18666:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00000100:00100000:2.0:1790946100.285293:0:18667:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638671104 00000100:00100000:2.0:1790946100.285306:0:18667:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638671104 00000100:00100000:2.0:1790946100.285445:0:19563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790946100.285455:0:19563:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17904:x1877942638671104:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1790946100.285486:0:19563:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1790946100.285579:0:19563:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17904:x1877942638671104:12345-0@lo:5:osp-pre-1-1.0 Request processed in 125us (2601us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946100.285587:0:19563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1790946100.285709:0:17904:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f825a6680 x1877942638671104/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790946116 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946100.285723:0:17904:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17904:1877942638671104:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1790946100.285737:0:17904:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1790946100.285787:0:17904:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17904:1877942638671232:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1790946100.285828:0:17904:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946100.285855:0:17904:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4091069180 going to sleep for 11 seconds 00000100:00100000:2.0:1790946100.285866:0:18667:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638671232 00000100:00100000:2.0:1790946100.285957:0:18667:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638671232 00000100:00100000:2.0:1790946100.285984:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790946100.285990:0:18667:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17904:x1877942638671232:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1790946100.286016:0:18667:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:2.0:1790946100.292745:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790946100.292757:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aaf3bb43/0xd9f4181e0d27e596 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.292774:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1790946100.292814:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946100.292822:0:18669:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aaf3bb43/0xd9f4181e0d27e596 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.292865:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aaf3bb43/0xd9f4181e0d27e596 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.292895:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aaf3bb43/0xd9f4181e0d27e596 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.292914:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aaf3bb43/0xd9f4181e0d27e596 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.292947:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790946100.293726:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790946100.293735:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a795762/0xd9f4181e0d27e59d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.293747:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1790946100.293758:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946100.293763:0:18669:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a795762/0xd9f4181e0d27e59d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.293774:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a795762/0xd9f4181e0d27e59d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.293785:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a795762/0xd9f4181e0d27e59d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.293792:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a795762/0xd9f4181e0d27e59d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.293815:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1790946100.295357:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790946100.295369:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d24e564d/0xd9f4181e0d27e5a4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.295383:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1790946100.295388:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946100.295392:0:18669:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d24e564d/0xd9f4181e0d27e5a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.295405:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d24e564d/0xd9f4181e0d27e5a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.295414:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d24e564d/0xd9f4181e0d27e5a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.295431:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d24e564d/0xd9f4181e0d27e5a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.295454:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1790946100.296093:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790946100.296102:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aaf3bb43/0xd9f4181e0d27e596 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.296111:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65e00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:0.0:1790946100.296116:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aaf3bb43/0xd9f4181e0d27e596 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.296126:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aaf3bb43/0xd9f4181e0d27e596 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.296160:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aaf3bb43/0xd9f4181e0d27e596 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.296205:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aaf3bb43/0xd9f4181e0d27e596 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.296244:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790946100.296249:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a795762/0xd9f4181e0d27e59d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.296256:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65000 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:0.0:1790946100.296273:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a795762/0xd9f4181e0d27e59d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.296293:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a795762/0xd9f4181e0d27e59d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.296313:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a795762/0xd9f4181e0d27e59d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.296332:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a795762/0xd9f4181e0d27e59d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.296346:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790946100.296350:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d24e564d/0xd9f4181e0d27e5a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.296368:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c64c00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:0.0:1790946100.296371:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d24e564d/0xd9f4181e0d27e5a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.296379:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d24e564d/0xd9f4181e0d27e5a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.296390:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d24e564d/0xd9f4181e0d27e5a4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.296409:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d24e564d/0xd9f4181e0d27e5a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.296422:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946100.296424:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946100.296443:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790946100.297914:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790946100.297942:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a9ba27d/0xd9f4181e0d27e5ab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.297957:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1790946100.297961:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946100.297981:0:18669:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a9ba27d/0xd9f4181e0d27e5ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.298008:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a9ba27d/0xd9f4181e0d27e5ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.298017:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a9ba27d/0xd9f4181e0d27e5ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.298025:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a9ba27d/0xd9f4181e0d27e5ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.298044:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790946100.298409:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790946100.298416:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a9ba27d/0xd9f4181e0d27e5ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.298425:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65c00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:0.0:1790946100.298430:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a9ba27d/0xd9f4181e0d27e5ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.298439:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a9ba27d/0xd9f4181e0d27e5ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.298457:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a9ba27d/0xd9f4181e0d27e5ab lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.298464:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a9ba27d/0xd9f4181e0d27e5ab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.298483:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946100.298486:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946100.298487:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790946100.299215:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790946100.299223:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf6b031e/0xd9f4181e0d27e5b2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.299242:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1790946100.299246:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946100.299251:0:18669:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf6b031e/0xd9f4181e0d27e5b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.299261:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf6b031e/0xd9f4181e0d27e5b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.299270:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf6b031e/0xd9f4181e0d27e5b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.299278:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf6b031e/0xd9f4181e0d27e5b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.299293:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790946100.299466:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790946100.299472:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf6b031e/0xd9f4181e0d27e5b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.299480:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65a00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:0.0:1790946100.299484:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf6b031e/0xd9f4181e0d27e5b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.299505:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf6b031e/0xd9f4181e0d27e5b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.299522:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf6b031e/0xd9f4181e0d27e5b2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.299531:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf6b031e/0xd9f4181e0d27e5b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.299554:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946100.299556:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946100.299558:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946100.301345:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946100.301355:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790946100.302091:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790946100.302102:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078e2ae93/0xd9f4181e0d27e5b9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.302118:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1790946100.302122:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946100.302128:0:18669:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078e2ae93/0xd9f4181e0d27e5b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.302141:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078e2ae93/0xd9f4181e0d27e5b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.302206:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078e2ae93/0xd9f4181e0d27e5b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.302216:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078e2ae93/0xd9f4181e0d27e5b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.302231:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790946100.302439:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790946100.302447:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078e2ae93/0xd9f4181e0d27e5b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.302456:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c64e00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:0.0:1790946100.302460:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078e2ae93/0xd9f4181e0d27e5b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.302469:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078e2ae93/0xd9f4181e0d27e5b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.302486:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078e2ae93/0xd9f4181e0d27e5b9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.302500:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078e2ae93/0xd9f4181e0d27e5b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.302519:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946100.302521:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946100.302523:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790946100.304408:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790946100.304421:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b646a08/0xd9f4181e0d27e5c0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.304437:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=551s v=(0 0) 00010000:00010000:0.0:1790946100.304442:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946100.304448:0:18669:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b646a08/0xd9f4181e0d27e5c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.304461:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b646a08/0xd9f4181e0d27e5c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.304469:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b646a08/0xd9f4181e0d27e5c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.304477:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b646a08/0xd9f4181e0d27e5c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.304498:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790946100.304917:0:17136:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946100.304925:0:17136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b646a08/0xd9f4181e0d27e5c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.304934:0:17136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0600 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:1.0:1790946100.304939:0:17136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b646a08/0xd9f4181e0d27e5c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.304960:0:17136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b646a08/0xd9f4181e0d27e5c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.304979:0:17136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b646a08/0xd9f4181e0d27e5c0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.304987:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b646a08/0xd9f4181e0d27e5c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.305005:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946100.305007:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946100.305009:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790946100.305382:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790946100.305395:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2bfdc13/0xd9f4181e0d27e5c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.305406:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=551s v=(0 0) 00010000:00010000:0.0:1790946100.305410:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946100.305415:0:18666:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2bfdc13/0xd9f4181e0d27e5c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.305427:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2bfdc13/0xd9f4181e0d27e5c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.305436:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2bfdc13/0xd9f4181e0d27e5c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.305442:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2bfdc13/0xd9f4181e0d27e5c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.305459:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790946100.305468:0:18315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790946100.305472:0:18315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2bfdc13/0xd9f4181e0d27e5c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.305479:0:18315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe1000 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:0.0:1790946100.305483:0:18315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2bfdc13/0xd9f4181e0d27e5c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.305492:0:18315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2bfdc13/0xd9f4181e0d27e5c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.305511:0:18315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2bfdc13/0xd9f4181e0d27e5c7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.305518:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2bfdc13/0xd9f4181e0d27e5c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.305533:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946100.305535:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946100.305543:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946100.305726:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790946100.305732:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d6ea928/0xd9f4181e0d27e5ce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.305741:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1790946100.305748:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946100.305752:0:18669:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d6ea928/0xd9f4181e0d27e5ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.305761:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d6ea928/0xd9f4181e0d27e5ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.305768:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d6ea928/0xd9f4181e0d27e5ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.305782:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d6ea928/0xd9f4181e0d27e5ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.305808:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790946100.306686:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790946100.306694:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bac932d6/0xd9f4181e0d27e5d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.306704:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1790946100.306707:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946100.306712:0:18669:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bac932d6/0xd9f4181e0d27e5d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.306721:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bac932d6/0xd9f4181e0d27e5d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.306729:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bac932d6/0xd9f4181e0d27e5d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.306737:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bac932d6/0xd9f4181e0d27e5d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.306754:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790946100.307225:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790946100.307232:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d6ea928/0xd9f4181e0d27e5ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.307241:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afc800 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:0.0:1790946100.307245:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d6ea928/0xd9f4181e0d27e5ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.307254:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d6ea928/0xd9f4181e0d27e5ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.307268:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d6ea928/0xd9f4181e0d27e5ce lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.307276:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d6ea928/0xd9f4181e0d27e5ce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.307335:0:17136:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946100.307341:0:17136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bac932d6/0xd9f4181e0d27e5d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.307349:0:17136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afd000 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946100.307352:0:17136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bac932d6/0xd9f4181e0d27e5d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.307361:0:17136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bac932d6/0xd9f4181e0d27e5d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.307371:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946100.307373:0:17136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bac932d6/0xd9f4181e0d27e5d5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.307374:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946100.307376:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946100.307380:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bac932d6/0xd9f4181e0d27e5d5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.307393:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946100.307400:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946100.307402:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790946100.307423:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790946100.307429:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309fc8f8/0xd9f4181e0d27e5dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.307437:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=551s v=(0 0) 00010000:00010000:0.0:1790946100.307440:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946100.307444:0:18666:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000309fc8f8/0xd9f4181e0d27e5dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.307453:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000309fc8f8/0xd9f4181e0d27e5dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.307470:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309fc8f8/0xd9f4181e0d27e5dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.307479:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309fc8f8/0xd9f4181e0d27e5dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.307499:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790946100.307612:0:18315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946100.307617:0:18315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309fc8f8/0xd9f4181e0d27e5dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.307625:0:18315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0400 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946100.307628:0:18315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309fc8f8/0xd9f4181e0d27e5dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.307635:0:18315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309fc8f8/0xd9f4181e0d27e5dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.307649:0:18315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309fc8f8/0xd9f4181e0d27e5dc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.307656:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309fc8f8/0xd9f4181e0d27e5dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.307672:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946100.307673:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946100.307675:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790946100.307982:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790946100.307988:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016e3a5ef/0xd9f4181e0d27e5e3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.308007:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=551s v=(0 0) 00010000:00010000:0.0:1790946100.308010:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946100.308015:0:18666:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016e3a5ef/0xd9f4181e0d27e5e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.308025:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016e3a5ef/0xd9f4181e0d27e5e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.308034:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016e3a5ef/0xd9f4181e0d27e5e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.308042:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016e3a5ef/0xd9f4181e0d27e5e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.308063:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790946100.308205:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946100.308211:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016e3a5ef/0xd9f4181e0d27e5e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.308219:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0a00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946100.308223:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016e3a5ef/0xd9f4181e0d27e5e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.308237:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016e3a5ef/0xd9f4181e0d27e5e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.308249:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016e3a5ef/0xd9f4181e0d27e5e3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.308256:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016e3a5ef/0xd9f4181e0d27e5e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.308270:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946100.308272:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946100.308274:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790946100.308491:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790946100.308497:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000128aa6b6/0xd9f4181e0d27e5ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.308506:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=551s v=(0 0) 00010000:00010000:0.0:1790946100.308509:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946100.308513:0:18666:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000128aa6b6/0xd9f4181e0d27e5ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.308523:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000128aa6b6/0xd9f4181e0d27e5ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.308666:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000128aa6b6/0xd9f4181e0d27e5ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.308676:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000128aa6b6/0xd9f4181e0d27e5ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.308693:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790946100.308822:0:17136:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946100.308828:0:17136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000128aa6b6/0xd9f4181e0d27e5ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.308836:0:17136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe1400 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946100.308840:0:17136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000128aa6b6/0xd9f4181e0d27e5ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.308848:0:17136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000128aa6b6/0xd9f4181e0d27e5ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.308859:0:17136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000128aa6b6/0xd9f4181e0d27e5ea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.309022:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000128aa6b6/0xd9f4181e0d27e5ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.309038:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946100.309040:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946100.309042:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790946100.309302:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790946100.309308:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012d65554/0xd9f4181e0d27e5f1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.309318:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=551s v=(0 0) 00010000:00010000:0.0:1790946100.309322:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946100.309325:0:18666:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012d65554/0xd9f4181e0d27e5f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.309336:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012d65554/0xd9f4181e0d27e5f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.309344:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012d65554/0xd9f4181e0d27e5f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.309351:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012d65554/0xd9f4181e0d27e5f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.309382:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790946100.309527:0:18315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946100.309532:0:18315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012d65554/0xd9f4181e0d27e5f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.309547:0:18315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080030800 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946100.309550:0:18315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012d65554/0xd9f4181e0d27e5f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.309559:0:18315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012d65554/0xd9f4181e0d27e5f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.309570:0:18315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012d65554/0xd9f4181e0d27e5f1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.309577:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012d65554/0xd9f4181e0d27e5f1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.309591:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946100.309593:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946100.309594:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790946100.309865:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790946100.310058:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb9e8e10/0xd9f4181e0d27e5f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.310069:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=551s v=(0 0) 00010000:00010000:0.0:1790946100.310074:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946100.310079:0:18666:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb9e8e10/0xd9f4181e0d27e5f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.310089:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb9e8e10/0xd9f4181e0d27e5f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.310097:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb9e8e10/0xd9f4181e0d27e5f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.310105:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb9e8e10/0xd9f4181e0d27e5f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790946100.310229:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790946100.310235:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed15cc62/0xd9f4181e0d27e5ff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.310244:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1790946100.310248:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946100.310252:0:18669:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed15cc62/0xd9f4181e0d27e5ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.310263:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed15cc62/0xd9f4181e0d27e5ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.310271:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed15cc62/0xd9f4181e0d27e5ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.310278:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed15cc62/0xd9f4181e0d27e5ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.310293:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790946100.310303:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946100.310308:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed15cc62/0xd9f4181e0d27e5ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.310315:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65600 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946100.310319:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed15cc62/0xd9f4181e0d27e5ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.310340:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed15cc62/0xd9f4181e0d27e5ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.310353:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed15cc62/0xd9f4181e0d27e5ff lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.310361:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed15cc62/0xd9f4181e0d27e5ff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.310378:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946100.310381:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946100.310383:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790946100.310953:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790946100.310961:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f04c140/0xd9f4181e0d27e606 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.310971:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1790946100.310976:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946100.310981:0:18669:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f04c140/0xd9f4181e0d27e606 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.310992:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f04c140/0xd9f4181e0d27e606 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.311001:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f04c140/0xd9f4181e0d27e606 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.311015:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f04c140/0xd9f4181e0d27e606 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.311038:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790946100.311242:0:17136:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946100.311249:0:17136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f04c140/0xd9f4181e0d27e606 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.311264:0:17136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c64a00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:1.0:1790946100.311268:0:17136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f04c140/0xd9f4181e0d27e606 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.311275:0:17136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f04c140/0xd9f4181e0d27e606 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.311287:0:17136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f04c140/0xd9f4181e0d27e606 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.311293:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f04c140/0xd9f4181e0d27e606 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.311308:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946100.311311:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946100.311313:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790946100.311384:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790946100.311391:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fca33821/0xd9f4181e0d27e60d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.311399:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1790946100.311403:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946100.311408:0:18669:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fca33821/0xd9f4181e0d27e60d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.311417:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fca33821/0xd9f4181e0d27e60d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.311425:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fca33821/0xd9f4181e0d27e60d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.311433:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fca33821/0xd9f4181e0d27e60d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.311455:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790946100.311628:0:18315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790946100.311635:0:18315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fca33821/0xd9f4181e0d27e60d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.311644:0:18315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d6e00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:3.0:1790946100.311647:0:18315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fca33821/0xd9f4181e0d27e60d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.311654:0:18315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fca33821/0xd9f4181e0d27e60d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.311667:0:18315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fca33821/0xd9f4181e0d27e60d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.311674:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fca33821/0xd9f4181e0d27e60d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.311718:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946100.311720:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946100.311722:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946100.312688:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790946100.312697:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081ca4e47/0xd9f4181e0d27e614 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.312709:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1790946100.312714:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946100.312718:0:18669:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081ca4e47/0xd9f4181e0d27e614 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.312729:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081ca4e47/0xd9f4181e0d27e614 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.312750:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081ca4e47/0xd9f4181e0d27e614 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.312758:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081ca4e47/0xd9f4181e0d27e614 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.312787:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790946100.312973:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790946100.312981:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081ca4e47/0xd9f4181e0d27e614 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.312990:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afd200 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:3.0:1790946100.312995:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081ca4e47/0xd9f4181e0d27e614 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.313004:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081ca4e47/0xd9f4181e0d27e614 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.313020:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081ca4e47/0xd9f4181e0d27e614 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.313028:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081ca4e47/0xd9f4181e0d27e614 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.313048:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946100.313050:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946100.313052:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946100.316488:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790946100.316510:0:17136:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946100.316518:0:17136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb9e8e10/0xd9f4181e0d27e5f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.316532:0:17136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080030400 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:1.0:1790946100.316536:0:17136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb9e8e10/0xd9f4181e0d27e5f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.316557:0:17136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb9e8e10/0xd9f4181e0d27e5f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.316582:0:17136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb9e8e10/0xd9f4181e0d27e5f8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.316589:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb9e8e10/0xd9f4181e0d27e5f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.316629:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946100.316631:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946100.316633:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790946100.319038:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790946100.319051:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037fd6a81/0xd9f4181e0d27e61b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.319068:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=551s v=(0 0) 00010000:00010000:0.0:1790946100.319072:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946100.319088:0:18666:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037fd6a81/0xd9f4181e0d27e61b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.319103:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037fd6a81/0xd9f4181e0d27e61b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.319113:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037fd6a81/0xd9f4181e0d27e61b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.319122:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037fd6a81/0xd9f4181e0d27e61b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.319219:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1790946100.320532:0:17144:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790946100.320538:0:17144:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d40871f9800 from 10 10000000:01000000:0.0:1790946100.320543:0:17144:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790946100.320582:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4080030200/0xd9f4181e0d27e622 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.320592:0:17144:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d4080030200/0xd9f4181e0d27e622 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.320613:0:17144:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d4080030200/0xd9f4181e0d27e622 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946100.320641:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83deea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638671360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790946100.320715:0:17144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946100.320759:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40baf05cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1790946100.323572:0:18315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946100.323589:0:18315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037fd6a81/0xd9f4181e0d27e61b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.323603:0:18315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080030c00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:1.0:1790946100.323610:0:18315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037fd6a81/0xd9f4181e0d27e61b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.323622:0:18315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037fd6a81/0xd9f4181e0d27e61b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946100.323676:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638671360 00000100:00100000:2.0:1790946100.323689:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638671360 00000100:00100000:2.0:1790946100.323770:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1790946100.323781:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8238b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+22:17144:x1877942638671360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790946100.323800:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946100.323820:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40c21d7400/0xd9f4181e0d27e629 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27e622 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.323847:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40c21d7400/0xd9f4181e0d27e629 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27e622 expref: 23 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.323860:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40c21d7400/0xd9f4181e0d27e629 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27e622 expref: 23 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.323869:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40c21d7400, rc 0) 00000100:00100000:2.0:1790946100.323965:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8238b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+23:17144:x1877942638671360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (3250us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946100.323973:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00002000:00010000:2.0:1790946100.324094:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790946100.324101:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092d1948c/0xd9f4181e0d27e630 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.324114:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1790946100.324119:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946100.324124:0:18669:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092d1948c/0xd9f4181e0d27e630 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.324137:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092d1948c/0xd9f4181e0d27e630 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.324158:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092d1948c/0xd9f4181e0d27e630 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.324185:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092d1948c/0xd9f4181e0d27e630 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.324205:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790946100.324233:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790946100.324241:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092d1948c/0xd9f4181e0d27e630 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.324262:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d6200 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:3.0:1790946100.324266:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092d1948c/0xd9f4181e0d27e630 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.324275:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092d1948c/0xd9f4181e0d27e630 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.324290:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092d1948c/0xd9f4181e0d27e630 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.324297:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092d1948c/0xd9f4181e0d27e630 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.324317:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946100.324328:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946100.324330:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946100.324669:0:18315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037fd6a81/0xd9f4181e0d27e61b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.324680:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037fd6a81/0xd9f4181e0d27e61b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.324697:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946100.324699:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946100.324701:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946100.327344:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83deea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638671360:0@lo:101:ll_cfg_requeue.0 00002000:00010000:2.0:1790946100.327377:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790946100.327378:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d4080030200/0xd9f4181e0d27e622 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e629 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.327388:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e23926f/0xd9f4181e0d27e637 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.327417:0:17144:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d4080030200/0xd9f4181e0d27e622 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e629 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.327418:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1790946100.327428:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946100.327436:0:18669:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e23926f/0xd9f4181e0d27e637 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.327450:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e23926f/0xd9f4181e0d27e637 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.327460:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e23926f/0xd9f4181e0d27e637 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.327468:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e23926f/0xd9f4181e0d27e637 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.327505:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790946100.327507:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff81c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638671488:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1790946100.327583:0:17144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946100.327626:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40871a9780 going to sleep for 11 seconds 00010000:00010000:3.0:1790946100.328474:0:17136:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790946100.328487:0:17136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e23926f/0xd9f4181e0d27e637 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.328499:0:17136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d7a00 already unused, calling callback (ffffffffc0d4cac0) 00002000:00010000:2.0:1790946100.328501:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790946100.328504:0:17136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e23926f/0xd9f4181e0d27e637 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.328509:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080914808/0xd9f4181e0d27e63e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.328519:0:17136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e23926f/0xd9f4181e0d27e637 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.328523:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1790946100.328527:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946100.328536:0:18669:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080914808/0xd9f4181e0d27e63e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.328558:0:17136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e23926f/0xd9f4181e0d27e637 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.328563:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080914808/0xd9f4181e0d27e63e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.328569:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e23926f/0xd9f4181e0d27e637 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.328579:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080914808/0xd9f4181e0d27e63e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.328589:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080914808/0xd9f4181e0d27e63e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.328596:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946100.328600:0:17136:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790946100.328604:0:17136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080914808/0xd9f4181e0d27e63e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.328610:0:17136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d7c00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:3.0:1790946100.328613:0:17136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080914808/0xd9f4181e0d27e63e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.328621:0:17136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080914808/0xd9f4181e0d27e63e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.328635:0:17136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080914808/0xd9f4181e0d27e63e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.328646:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946100.328647:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946100.328686:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1790946100.328692:0:18669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080914808/0xd9f4181e0d27e63e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.328817:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1790946100.329472:0:19480:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1790946100.329500:0:19480:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1790946100.329512:0:19480:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:2.0:1790946100.329524:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790946100.329532:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000446ab762/0xd9f4181e0d27e645 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.329563:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1790946100.329567:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946100.329572:0:18669:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000446ab762/0xd9f4181e0d27e645 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.329584:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000446ab762/0xd9f4181e0d27e645 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.329593:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000446ab762/0xd9f4181e0d27e645 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.329600:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000446ab762/0xd9f4181e0d27e645 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.329694:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790946100.329733:0:18667:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17904:x1877942638671232:12345-0@lo:5:osp-pre-1-1.0 Request processed in 43739us (43900us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1790946100.329743:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790946100.329799:0:17904:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1790946100.329806:0:17904:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17904:1877942638671232:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1790946100.329823:0:17904:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1790946100.329870:0:17904:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17904:1877942638671616:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1790946100.329916:0:17904:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946100.329941:0:17904:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f827a5480 going to sleep for 11 seconds 00000100:00100000:3.0:1790946100.330037:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638671616 00000100:00100000:3.0:1790946100.330045:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638671616 00000100:00100000:3.0:1790946100.330094:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790946100.330104:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17904:x1877942638671616:12345-0@lo:900:osp-pre-1-1.0 00002000:00010000:2.0:1790946100.330111:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790946100.330118:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000899aafd8/0xd9f4181e0d27e64c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.330128:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1790946100.330132:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946100.330136:0:18669:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000899aafd8/0xd9f4181e0d27e64c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.330146:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000899aafd8/0xd9f4181e0d27e64c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946100.330155:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17904:x1877942638671616:12345-0@lo:900:osp-pre-1-1.0 Request processed in 52us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946100.330188:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1790946100.330199:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000899aafd8/0xd9f4181e0d27e64c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.330207:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000899aafd8/0xd9f4181e0d27e64c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.330223:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790946100.330298:0:17136:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790946100.330305:0:17136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000446ab762/0xd9f4181e0d27e645 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.330314:0:17136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d7600 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:3.0:1790946100.330320:0:17136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000446ab762/0xd9f4181e0d27e645 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.330328:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790946100.330330:0:17136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000446ab762/0xd9f4181e0d27e645 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.330337:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000899aafd8/0xd9f4181e0d27e64c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.330350:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d6600 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:1.0:1790946100.330353:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000899aafd8/0xd9f4181e0d27e64c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.330361:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000899aafd8/0xd9f4181e0d27e64c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.330375:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000899aafd8/0xd9f4181e0d27e64c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.330382:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000899aafd8/0xd9f4181e0d27e64c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.330400:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946100.330402:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946100.330403:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946100.330418:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946100.330432:0:17136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000446ab762/0xd9f4181e0d27e645 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.330440:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000446ab762/0xd9f4181e0d27e645 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.330458:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946100.330460:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946100.330463:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:3.0:1790946100.330488:0:17904:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f833f2a00 x1877942638671616/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790946116 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946100.330499:0:17904:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17904:1877942638671616:0@lo:900:osp-pre-1-1.0 00002000:00010000:2.0:1790946100.330722:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790946100.330729:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000040757f7/0xd9f4181e0d27e653 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.330739:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1790946100.330742:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946100.330747:0:18669:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000040757f7/0xd9f4181e0d27e653 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790946100.330756:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790946100.330758:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000040757f7/0xd9f4181e0d27e653 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.330770:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000040757f7/0xd9f4181e0d27e653 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.330779:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce0b49eb/0xd9f4181e0d27e65a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.330780:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000040757f7/0xd9f4181e0d27e653 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.330803:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1790946100.330809:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946100.330818:0:18666:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce0b49eb/0xd9f4181e0d27e65a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.330831:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce0b49eb/0xd9f4181e0d27e65a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.330837:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790946100.330839:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce0b49eb/0xd9f4181e0d27e65a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.330848:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce0b49eb/0xd9f4181e0d27e65a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.330865:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1790946100.330942:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638671488 00000100:00100000:0.0:1790946100.330957:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638671488 00000100:00100000:0.0:1790946100.330996:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00010000:00010000:1.0:1790946100.331000:0:18315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1790946100.331006:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f82389c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+23:17144:x1877942638671488:12345-0@lo:256:ll_cfg_requeue.0 00010000:00010000:1.0:1790946100.331007:0:18315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000040757f7/0xd9f4181e0d27e653 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.331019:0:18315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d6400 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:1.0:1790946100.331024:0:18315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000040757f7/0xd9f4181e0d27e653 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790946100.331027:0:17142:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790946100.331046:0:17142:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 00010000:00010000:1.0:1790946100.331048:0:18315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000040757f7/0xd9f4181e0d27e653 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790946100.331051:0:17142:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00010000:00010000:1.0:1790946100.331065:0:18315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000040757f7/0xd9f4181e0d27e653 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.331073:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000040757f7/0xd9f4181e0d27e653 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.331091:0:18315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946100.331094:0:18315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce0b49eb/0xd9f4181e0d27e65a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.331101:0:18315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afc400 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:1.0:1790946100.331104:0:18315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce0b49eb/0xd9f4181e0d27e65a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.331112:0:18315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce0b49eb/0xd9f4181e0d27e65a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946100.331158:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f82389c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+23:17144:x1877942638671488:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 153us (3574us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946100.331198:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1790946100.331259:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff81c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638671488:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1790946100.331336:0:17144:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790946100.331344:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4080030200/0xd9f4181e0d27e622 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e629 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.331352:0:17144:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d4080030200/0xd9f4181e0d27e622 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e629 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790946100.331362:0:17144:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790946100.331365:0:17144:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d3f81bb7000 from 10 10000000:01000000:0.0:1790946100.331368:0:17144:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790946100.331394:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4080031600/0xd9f4181e0d27e661 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.331402:0:17144:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d4080031600/0xd9f4181e0d27e661 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.331411:0:17144:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d4080031600/0xd9f4181e0d27e661 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946100.331428:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83deed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638671744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790946100.331466:0:17144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946100.331496:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40baf05b40 going to sleep for 11 seconds 00002000:00010000:2.0:1790946100.332262:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790946100.332271:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fd20c00/0xd9f4181e0d27e668 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.332285:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1790946100.332289:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946100.332294:0:18669:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fd20c00/0xd9f4181e0d27e668 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.332305:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fd20c00/0xd9f4181e0d27e668 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.332312:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fd20c00/0xd9f4181e0d27e668 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.332319:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fd20c00/0xd9f4181e0d27e668 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.332333:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790946100.332620:0:18315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce0b49eb/0xd9f4181e0d27e65a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.332629:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce0b49eb/0xd9f4181e0d27e65a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.332673:0:18315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946100.332678:0:18315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fd20c00/0xd9f4181e0d27e668 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.332685:0:18315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d6c00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:1.0:1790946100.332690:0:18315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fd20c00/0xd9f4181e0d27e668 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.332699:0:18315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fd20c00/0xd9f4181e0d27e668 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.332710:0:18315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fd20c00/0xd9f4181e0d27e668 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.332717:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fd20c00/0xd9f4181e0d27e668 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.332730:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946100.332732:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946100.332734:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790946100.332737:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790946100.332744:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000321f6b67/0xd9f4181e0d27e66f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946100.332751:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638671744 00010000:00010000:2.0:1790946100.332754:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=551s v=(0 0) 00000100:00100000:1.0:1790946100.332760:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638671744 00010000:00010000:2.0:1790946100.332766:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946100.332771:0:18666:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000321f6b67/0xd9f4181e0d27e66f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.332783:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000321f6b67/0xd9f4181e0d27e66f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.332791:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000321f6b67/0xd9f4181e0d27e66f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.332798:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000321f6b67/0xd9f4181e0d27e66f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.332799:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946100.332809:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946100.332817:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790946100.332823:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1790946100.332832:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f82389450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+23:17144:x1877942638671744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790946100.332845:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946100.332868:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d4092afde00/0xd9f4181e0d27e676 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27e661 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.332888:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d4092afde00/0xd9f4181e0d27e676 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27e661 expref: 24 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.332909:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d4092afde00/0xd9f4181e0d27e676 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27e661 expref: 24 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.332916:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4092afde00, rc 0) 00000100:00100000:1.0:1790946100.332979:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f82389450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+24:17144:x1877942638671744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (1512us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946100.332986:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00010000:1.0:1790946100.333018:0:18315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946100.333022:0:18315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000321f6b67/0xd9f4181e0d27e66f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.333029:0:18315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d7000 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:1.0:1790946100.333033:0:18315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000321f6b67/0xd9f4181e0d27e66f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.333041:0:18315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000321f6b67/0xd9f4181e0d27e66f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.333054:0:18315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000321f6b67/0xd9f4181e0d27e66f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946100.333057:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83deed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638671744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790946100.333075:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000321f6b67/0xd9f4181e0d27e66f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.333078:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d4080031600/0xd9f4181e0d27e661 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e676 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.333098:0:17144:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d4080031600/0xd9f4181e0d27e661 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e676 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.333106:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946100.333109:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946100.333111:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946100.333159:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638671872:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1790946100.333229:0:17144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946100.333260:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f827a5480 going to sleep for 11 seconds 00000100:00100000:1.0:1790946100.333795:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638671872 00000100:00100000:1.0:1790946100.333800:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638671872 00002000:00010000:2.0:1790946100.333838:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1790946100.333839:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00010000:00010000:2.0:1790946100.333849:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ffcaf1c/0xd9f4181e0d27e67d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946100.333851:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8238bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+24:17144:x1877942638671872:12345-0@lo:256:ll_cfg_requeue.0 00010000:00010000:2.0:1790946100.333866:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=551s v=(0 0) 20000000:01000000:1.0:1790946100.333872:0:17140:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 00010000:00010000:2.0:1790946100.333882:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946100.333887:0:18669:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ffcaf1c/0xd9f4181e0d27e67d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790946100.333889:0:17140:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790946100.333896:0:17140:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00010000:00010000:2.0:1790946100.333916:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ffcaf1c/0xd9f4181e0d27e67d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.333925:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ffcaf1c/0xd9f4181e0d27e67d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.333941:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ffcaf1c/0xd9f4181e0d27e67d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.333955:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790946100.334002:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8238bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+24:17144:x1877942638671872:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 153us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946100.334010:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00010000:3.0:1790946100.334028:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790946100.334042:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ffcaf1c/0xd9f4181e0d27e67d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.334051:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d7800 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:3.0:1790946100.334056:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ffcaf1c/0xd9f4181e0d27e67d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.334066:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ffcaf1c/0xd9f4181e0d27e67d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.334080:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ffcaf1c/0xd9f4181e0d27e67d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.334088:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ffcaf1c/0xd9f4181e0d27e67d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.334104:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946100.334106:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946100.334108:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946100.334129:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638671872:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1790946100.334213:0:17144:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790946100.334220:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4080031600/0xd9f4181e0d27e661 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e676 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.334229:0:17144:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d4080031600/0xd9f4181e0d27e661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e676 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790946100.335825:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790946100.335838:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed803b26/0xd9f4181e0d27e684 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.335852:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1790946100.335856:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946100.335861:0:18669:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed803b26/0xd9f4181e0d27e684 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.335880:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed803b26/0xd9f4181e0d27e684 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.335890:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed803b26/0xd9f4181e0d27e684 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.335907:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed803b26/0xd9f4181e0d27e684 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.335929:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790946100.336449:0:17136:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790946100.336456:0:17136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed803b26/0xd9f4181e0d27e684 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.336465:0:17136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d6000 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:0.0:1790946100.336470:0:17136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed803b26/0xd9f4181e0d27e684 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.336480:0:17136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed803b26/0xd9f4181e0d27e684 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.336498:0:17136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed803b26/0xd9f4181e0d27e684 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.336506:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed803b26/0xd9f4181e0d27e684 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.336526:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946100.336528:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946100.336531:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946100.337187:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790946100.337195:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d261f598/0xd9f4181e0d27e68b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.337207:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1790946100.337210:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946100.337215:0:18666:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d261f598/0xd9f4181e0d27e68b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.337227:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d261f598/0xd9f4181e0d27e68b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.337235:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d261f598/0xd9f4181e0d27e68b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.337256:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d261f598/0xd9f4181e0d27e68b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.337271:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790946100.337282:0:18315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946100.337287:0:18315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d261f598/0xd9f4181e0d27e68b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.337295:0:18315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afce00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:1.0:1790946100.337299:0:18315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d261f598/0xd9f4181e0d27e68b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.337308:0:18315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d261f598/0xd9f4181e0d27e68b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.337321:0:18315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d261f598/0xd9f4181e0d27e68b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.337328:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d261f598/0xd9f4181e0d27e68b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.337343:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946100.337345:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946100.337346:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946100.337829:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790946100.337843:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081ca4e47/0xd9f4181e0d27e692 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.337852:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1790946100.337856:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946100.337860:0:18666:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081ca4e47/0xd9f4181e0d27e692 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.337882:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081ca4e47/0xd9f4181e0d27e692 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.337891:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081ca4e47/0xd9f4181e0d27e692 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.337909:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081ca4e47/0xd9f4181e0d27e692 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.337926:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790946100.337934:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946100.337938:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081ca4e47/0xd9f4181e0d27e692 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.337945:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afd200 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:1.0:1790946100.337949:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081ca4e47/0xd9f4181e0d27e692 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.337956:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081ca4e47/0xd9f4181e0d27e692 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.337976:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081ca4e47/0xd9f4181e0d27e692 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.337983:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081ca4e47/0xd9f4181e0d27e692 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.337997:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946100.337999:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946100.338001:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946100.338487:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790946100.338493:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bac932d6/0xd9f4181e0d27e699 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.338504:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1790946100.338507:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946100.338511:0:18666:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bac932d6/0xd9f4181e0d27e699 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.338521:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bac932d6/0xd9f4181e0d27e699 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.338529:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bac932d6/0xd9f4181e0d27e699 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.338550:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bac932d6/0xd9f4181e0d27e699 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.338577:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790946100.338586:0:17136:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946100.338590:0:17136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bac932d6/0xd9f4181e0d27e699 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.338598:0:17136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afd000 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:1.0:1790946100.338613:0:17136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bac932d6/0xd9f4181e0d27e699 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.338623:0:17136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bac932d6/0xd9f4181e0d27e699 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.338636:0:17136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bac932d6/0xd9f4181e0d27e699 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.338644:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bac932d6/0xd9f4181e0d27e699 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.338658:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946100.338660:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946100.338662:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790946100.338774:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790946100.338782:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be4eb9a9/0xd9f4181e0d27e6a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.338797:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1790946100.338800:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946100.338804:0:18669:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be4eb9a9/0xd9f4181e0d27e6a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.338812:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be4eb9a9/0xd9f4181e0d27e6a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.338820:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be4eb9a9/0xd9f4181e0d27e6a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.338826:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be4eb9a9/0xd9f4181e0d27e6a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.338847:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790946100.339307:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790946100.339313:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029c6f988/0xd9f4181e0d27e6a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.339323:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1790946100.339326:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946100.339331:0:18669:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029c6f988/0xd9f4181e0d27e6a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.339340:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029c6f988/0xd9f4181e0d27e6a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.339358:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029c6f988/0xd9f4181e0d27e6a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.339365:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029c6f988/0xd9f4181e0d27e6a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.339381:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790946100.339430:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790946100.339444:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be4eb9a9/0xd9f4181e0d27e6a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.339452:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d6a00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:3.0:1790946100.339456:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be4eb9a9/0xd9f4181e0d27e6a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.339465:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be4eb9a9/0xd9f4181e0d27e6a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.339483:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be4eb9a9/0xd9f4181e0d27e6a0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.339489:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be4eb9a9/0xd9f4181e0d27e6a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.339506:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790946100.339510:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029c6f988/0xd9f4181e0d27e6a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.339516:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d6800 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:3.0:1790946100.339519:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029c6f988/0xd9f4181e0d27e6a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.339525:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029c6f988/0xd9f4181e0d27e6a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.339547:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029c6f988/0xd9f4181e0d27e6a7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.339554:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029c6f988/0xd9f4181e0d27e6a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.339568:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946100.339570:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946100.339572:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946100.339652:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790946100.339880:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790946100.339887:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fca33821/0xd9f4181e0d27e6ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.339907:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1790946100.339910:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946100.339915:0:18666:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fca33821/0xd9f4181e0d27e6ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.339925:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fca33821/0xd9f4181e0d27e6ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.339933:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fca33821/0xd9f4181e0d27e6ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.339941:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fca33821/0xd9f4181e0d27e6ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.339969:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790946100.340071:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790946100.340078:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090615add/0xd9f4181e0d27e6b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.340087:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1790946100.340090:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790946100.340094:0:18669:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090615add/0xd9f4181e0d27e6b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.340103:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090615add/0xd9f4181e0d27e6b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.340111:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090615add/0xd9f4181e0d27e6b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.340118:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090615add/0xd9f4181e0d27e6b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.340149:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790946100.340272:0:17136:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790946100.340278:0:17136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fca33821/0xd9f4181e0d27e6ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.340296:0:17136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d6e00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:1.0:1790946100.340300:0:17136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fca33821/0xd9f4181e0d27e6ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.340309:0:17136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fca33821/0xd9f4181e0d27e6ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.340321:0:17136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fca33821/0xd9f4181e0d27e6ae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.340328:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fca33821/0xd9f4181e0d27e6ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.340342:0:17136:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946100.340345:0:17136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090615add/0xd9f4181e0d27e6b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.340352:0:17136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef1400 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:1.0:1790946100.340355:0:17136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090615add/0xd9f4181e0d27e6b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.340361:0:17136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090615add/0xd9f4181e0d27e6b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.340369:0:17136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090615add/0xd9f4181e0d27e6b5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.340381:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090615add/0xd9f4181e0d27e6b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.340394:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946100.340396:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946100.340398:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946100.340462:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946100.340518:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790946100.340523:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d6ea928/0xd9f4181e0d27e6bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.340531:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1790946100.340540:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946100.340544:0:18666:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d6ea928/0xd9f4181e0d27e6bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.340553:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d6ea928/0xd9f4181e0d27e6bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.340561:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d6ea928/0xd9f4181e0d27e6bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.340568:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d6ea928/0xd9f4181e0d27e6bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.340586:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790946100.340839:0:18315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946100.340845:0:18315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d6ea928/0xd9f4181e0d27e6bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.340853:0:18315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afc800 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946100.340856:0:18315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d6ea928/0xd9f4181e0d27e6bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.340864:0:18315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d6ea928/0xd9f4181e0d27e6bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.340888:0:18315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d6ea928/0xd9f4181e0d27e6bc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.340896:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d6ea928/0xd9f4181e0d27e6bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.340923:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946100.340925:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946100.340927:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790946100.340937:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790946100.340945:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001de3f05b/0xd9f4181e0d27e6c3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.340954:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1790946100.340957:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790946100.340960:0:18669:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001de3f05b/0xd9f4181e0d27e6c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.340969:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001de3f05b/0xd9f4181e0d27e6c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.341075:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001de3f05b/0xd9f4181e0d27e6c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.341083:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001de3f05b/0xd9f4181e0d27e6c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.341097:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790946100.341643:0:17136:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946100.341655:0:17136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001de3f05b/0xd9f4181e0d27e6c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.341663:0:17136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef0000 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:1.0:1790946100.341667:0:17136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001de3f05b/0xd9f4181e0d27e6c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.341675:0:17136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001de3f05b/0xd9f4181e0d27e6c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.341687:0:17136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001de3f05b/0xd9f4181e0d27e6c3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.341695:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001de3f05b/0xd9f4181e0d27e6c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.341708:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946100.341710:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946100.341711:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790946100.341788:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790946100.341794:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb94e99e/0xd9f4181e0d27e6ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.341803:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1790946100.341813:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790946100.341818:0:18666:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb94e99e/0xd9f4181e0d27e6ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.341831:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb94e99e/0xd9f4181e0d27e6ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.341840:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb94e99e/0xd9f4181e0d27e6ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.341849:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb94e99e/0xd9f4181e0d27e6ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.341873:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790946100.341955:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946100.341961:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb94e99e/0xd9f4181e0d27e6ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.341980:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef0400 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946100.341983:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb94e99e/0xd9f4181e0d27e6ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.341990:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb94e99e/0xd9f4181e0d27e6ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.342001:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb94e99e/0xd9f4181e0d27e6ca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.342007:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb94e99e/0xd9f4181e0d27e6ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.342019:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946100.342021:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946100.342022:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790946100.342701:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790946100.342710:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050f88e0d/0xd9f4181e0d27e6d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.342721:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1790946100.342724:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790946100.342728:0:18666:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050f88e0d/0xd9f4181e0d27e6d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.342738:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050f88e0d/0xd9f4181e0d27e6d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.342746:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050f88e0d/0xd9f4181e0d27e6d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.342759:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050f88e0d/0xd9f4181e0d27e6d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.342783:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790946100.342791:0:18315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946100.342798:0:18315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050f88e0d/0xd9f4181e0d27e6d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.342807:0:18315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef0a00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946100.342812:0:18315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050f88e0d/0xd9f4181e0d27e6d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.342823:0:18315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050f88e0d/0xd9f4181e0d27e6d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.342843:0:18315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050f88e0d/0xd9f4181e0d27e6d1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.342851:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050f88e0d/0xd9f4181e0d27e6d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.342865:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946100.342945:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946100.342947:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790946100.342989:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790946100.342994:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080914808/0xd9f4181e0d27e6d8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.343003:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1790946100.343007:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946100.343011:0:18669:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080914808/0xd9f4181e0d27e6d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.343021:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080914808/0xd9f4181e0d27e6d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.343029:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080914808/0xd9f4181e0d27e6d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.343037:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080914808/0xd9f4181e0d27e6d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.343069:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790946100.343494:0:17136:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790946100.343501:0:17136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080914808/0xd9f4181e0d27e6d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.343510:0:17136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d7c00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:3.0:1790946100.343514:0:17136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080914808/0xd9f4181e0d27e6d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.343523:0:17136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080914808/0xd9f4181e0d27e6d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.343537:0:17136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080914808/0xd9f4181e0d27e6d8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.343555:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080914808/0xd9f4181e0d27e6d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.343571:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946100.343573:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946100.343574:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790946100.343822:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790946100.343829:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ffcaf1c/0xd9f4181e0d27e6df lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.343839:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1790946100.343842:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946100.343847:0:18669:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ffcaf1c/0xd9f4181e0d27e6df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.343856:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ffcaf1c/0xd9f4181e0d27e6df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.343863:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ffcaf1c/0xd9f4181e0d27e6df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790946100.344527:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790946100.344535:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce0b49eb/0xd9f4181e0d27e6e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.344606:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1790946100.344609:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946100.344613:0:18666:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce0b49eb/0xd9f4181e0d27e6e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.344635:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce0b49eb/0xd9f4181e0d27e6e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.344643:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce0b49eb/0xd9f4181e0d27e6e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.344651:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce0b49eb/0xd9f4181e0d27e6e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.344708:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790946100.344801:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ffcaf1c/0xd9f4181e0d27e6df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.344886:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790946100.344893:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce0b49eb/0xd9f4181e0d27e6e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.344918:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afc400 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:3.0:1790946100.344924:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce0b49eb/0xd9f4181e0d27e6e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.344933:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce0b49eb/0xd9f4181e0d27e6e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.344948:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce0b49eb/0xd9f4181e0d27e6e6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.344955:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce0b49eb/0xd9f4181e0d27e6e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.344973:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790946100.344977:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ffcaf1c/0xd9f4181e0d27e6df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.344983:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d7800 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:3.0:1790946100.344986:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ffcaf1c/0xd9f4181e0d27e6df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.344994:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ffcaf1c/0xd9f4181e0d27e6df lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.345005:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ffcaf1c/0xd9f4181e0d27e6df lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.345021:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946100.345023:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946100.345025:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946100.346451:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790946100.346466:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000128aa6b6/0xd9f4181e0d27e6ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.346481:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1790946100.346484:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946100.346490:0:18666:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000128aa6b6/0xd9f4181e0d27e6ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.346504:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000128aa6b6/0xd9f4181e0d27e6ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.346513:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000128aa6b6/0xd9f4181e0d27e6ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.346532:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000128aa6b6/0xd9f4181e0d27e6ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.346555:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790946100.346950:0:18315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790946100.346958:0:18315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000128aa6b6/0xd9f4181e0d27e6ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.346967:0:18315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe1400 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:3.0:1790946100.346971:0:18315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000128aa6b6/0xd9f4181e0d27e6ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.346980:0:18315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000128aa6b6/0xd9f4181e0d27e6ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.346996:0:18315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000128aa6b6/0xd9f4181e0d27e6ed lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.347004:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000128aa6b6/0xd9f4181e0d27e6ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.347024:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946100.347026:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946100.347028:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946100.347342:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790946100.347478:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016e3a5ef/0xd9f4181e0d27e6f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.347489:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1790946100.347493:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946100.347498:0:18666:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016e3a5ef/0xd9f4181e0d27e6f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.347508:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016e3a5ef/0xd9f4181e0d27e6f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.347517:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016e3a5ef/0xd9f4181e0d27e6f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.347525:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016e3a5ef/0xd9f4181e0d27e6f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.347725:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790946100.347793:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790946100.347801:0:18669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ffcaf1c/0xd9f4181e0d27e6df lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.347933:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790946100.347940:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016e3a5ef/0xd9f4181e0d27e6f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1790946100.347950:0:18669:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00010000:00010000:3.0:1790946100.347963:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0a00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:3.0:1790946100.347968:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016e3a5ef/0xd9f4181e0d27e6f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.347976:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016e3a5ef/0xd9f4181e0d27e6f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.347990:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016e3a5ef/0xd9f4181e0d27e6f4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.347998:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016e3a5ef/0xd9f4181e0d27e6f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.348014:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946100.348016:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946100.348017:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946100.348025:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946100.348060:0:18669:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f845ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17174:x1877942638670464:12345-0@lo:5:osp-pre-1-0.0 Request processed in 81853us (82259us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946100.348077:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790946100.348201:0:17174:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f845edf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17174:1877942638670464:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1790946100.348220:0:17174:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:0.0:1790946100.348267:0:17174:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83dece00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17174:1877942638672000:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1790946100.348305:0:17174:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946100.348348:0:17174:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40baf053c0 going to sleep for 11 seconds 00002000:00010000:1.0:1790946100.348362:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1790946100.348368:0:19563:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638672000 00010000:00010000:1.0:1790946100.348369:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309fc8f8/0xd9f4181e0d27e6fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946100.348375:0:19563:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638672000 00010000:00010000:1.0:1790946100.348384:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1790946100.348387:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946100.348391:0:18666:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000309fc8f8/0xd9f4181e0d27e6fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.348400:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000309fc8f8/0xd9f4181e0d27e6fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.348408:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309fc8f8/0xd9f4181e0d27e6fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.348416:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309fc8f8/0xd9f4181e0d27e6fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946100.348417:0:19563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790946100.348426:0:19563:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83dec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:17174:x1877942638672000:12345-0@lo:5:osp-pre-1-0.0 00010000:00010000:1.0:1790946100.348429:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1790946100.348461:0:19563:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00010000:00010000:3.0:1790946100.348550:0:18315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790946100.348556:0:18315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309fc8f8/0xd9f4181e0d27e6fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.348575:0:18315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0400 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:3.0:1790946100.348578:0:18315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309fc8f8/0xd9f4181e0d27e6fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.348587:0:18315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309fc8f8/0xd9f4181e0d27e6fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.348599:0:18315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309fc8f8/0xd9f4181e0d27e6fb lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.348607:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309fc8f8/0xd9f4181e0d27e6fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.348621:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946100.348623:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946100.348625:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946100.349385:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790946100.349395:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2bfdc13/0xd9f4181e0d27e702 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.349404:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1790946100.349408:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946100.349413:0:18666:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2bfdc13/0xd9f4181e0d27e702 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.349423:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2bfdc13/0xd9f4181e0d27e702 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.349445:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2bfdc13/0xd9f4181e0d27e702 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.349452:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2bfdc13/0xd9f4181e0d27e702 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.349478:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790946100.350269:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946100.350279:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2bfdc13/0xd9f4181e0d27e702 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.350291:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe1000 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946100.350296:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2bfdc13/0xd9f4181e0d27e702 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.350306:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2bfdc13/0xd9f4181e0d27e702 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.350322:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2bfdc13/0xd9f4181e0d27e702 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.350330:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2bfdc13/0xd9f4181e0d27e702 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946100.350349:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946100.350351:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946100.350353:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946100.350832:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790946100.350840:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b646a08/0xd9f4181e0d27e709 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.350852:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1790946100.350855:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946100.350861:0:18666:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b646a08/0xd9f4181e0d27e709 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.350872:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b646a08/0xd9f4181e0d27e709 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.350882:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b646a08/0xd9f4181e0d27e709 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.350890:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b646a08/0xd9f4181e0d27e709 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.350934:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790946100.351214:0:17136:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790946100.351223:0:17136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b646a08/0xd9f4181e0d27e709 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.351231:0:17136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0600 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:3.0:1790946100.351235:0:17136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b646a08/0xd9f4181e0d27e709 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.351243:0:17136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b646a08/0xd9f4181e0d27e709 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.351267:0:17136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b646a08/0xd9f4181e0d27e709 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.351274:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b646a08/0xd9f4181e0d27e709 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.351544:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946100.351548:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946100.351550:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790946100.352017:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790946100.352025:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055df2cbd/0xd9f4181e0d27e710 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.352036:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=551s v=(0 0) 00010000:00010000:0.0:1790946100.352041:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946100.352046:0:18666:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055df2cbd/0xd9f4181e0d27e710 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.352058:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055df2cbd/0xd9f4181e0d27e710 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.352067:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055df2cbd/0xd9f4181e0d27e710 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.352075:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055df2cbd/0xd9f4181e0d27e710 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.352102:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790946100.352987:0:18315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946100.352995:0:18315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055df2cbd/0xd9f4181e0d27e710 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.353004:0:18315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080031800 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:1.0:1790946100.353008:0:18315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055df2cbd/0xd9f4181e0d27e710 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.353018:0:18315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055df2cbd/0xd9f4181e0d27e710 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.353035:0:18315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055df2cbd/0xd9f4181e0d27e710 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.353042:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055df2cbd/0xd9f4181e0d27e710 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.353070:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946100.353072:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946100.353073:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790946100.353866:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790946100.353958:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6f1c9eb/0xd9f4181e0d27e717 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.353973:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=551s v=(0 0) 00010000:00010000:0.0:1790946100.353987:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946100.353993:0:18666:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6f1c9eb/0xd9f4181e0d27e717 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.354008:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6f1c9eb/0xd9f4181e0d27e717 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.354018:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6f1c9eb/0xd9f4181e0d27e717 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.354027:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6f1c9eb/0xd9f4181e0d27e717 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.354097:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790946100.355454:0:19563:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83dec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17174:x1877942638672000:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7022us (7142us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1790946100.355466:0:19563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790946100.356017:0:17174:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83dece00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17174:1877942638672000:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1790946100.356038:0:17174:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00002000:00010000:3.0:1790946100.356080:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790946100.356089:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d602fbe/0xd9f4181e0d27e71e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.356104:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1790946100.356108:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790946100.356114:0:18666:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d602fbe/0xd9f4181e0d27e71e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.356127:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d602fbe/0xd9f4181e0d27e71e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.356137:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d602fbe/0xd9f4181e0d27e71e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.356146:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d602fbe/0xd9f4181e0d27e71e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.357153:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790946100.357224:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6f1c9eb/0xd9f4181e0d27e717 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.357237:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080030a00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:1.0:1790946100.357258:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6f1c9eb/0xd9f4181e0d27e717 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.357268:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6f1c9eb/0xd9f4181e0d27e717 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.357287:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6f1c9eb/0xd9f4181e0d27e717 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.357296:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6f1c9eb/0xd9f4181e0d27e717 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.357324:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946100.357328:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d602fbe/0xd9f4181e0d27e71e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.357335:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef1000 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:1.0:1790946100.357339:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d602fbe/0xd9f4181e0d27e71e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.357347:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d602fbe/0xd9f4181e0d27e71e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.357357:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d602fbe/0xd9f4181e0d27e71e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.357365:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946100.357374:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946100.357376:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946100.358469:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790946100.358480:0:18666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d602fbe/0xd9f4181e0d27e71e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946100.358822:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790946100.359028:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790946100.359036:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5663a5e/0xd9f4181e0d27e725 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.359050:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1790946100.359054:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790946100.359060:0:18666:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5663a5e/0xd9f4181e0d27e725 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.359073:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5663a5e/0xd9f4181e0d27e725 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.359081:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5663a5e/0xd9f4181e0d27e725 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.359089:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5663a5e/0xd9f4181e0d27e725 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.359427:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790946100.359630:0:18315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946100.359639:0:18315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5663a5e/0xd9f4181e0d27e725 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.359650:0:18315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef1c00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:1.0:1790946100.359655:0:18315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5663a5e/0xd9f4181e0d27e725 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.359666:0:18315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5663a5e/0xd9f4181e0d27e725 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.359688:0:18315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5663a5e/0xd9f4181e0d27e725 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.359697:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5663a5e/0xd9f4181e0d27e725 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.359715:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946100.359717:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946100.359719:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790946100.359777:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790946100.359784:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f272f75/0xd9f4181e0d27e72c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.359800:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1790946100.359803:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790946100.359808:0:18666:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f272f75/0xd9f4181e0d27e72c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.359818:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f272f75/0xd9f4181e0d27e72c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.359827:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f272f75/0xd9f4181e0d27e72c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.359835:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f272f75/0xd9f4181e0d27e72c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946100.359922:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790946100.359956:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946100.359962:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f272f75/0xd9f4181e0d27e72c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.359970:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef0800 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:1.0:1790946100.359973:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f272f75/0xd9f4181e0d27e72c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.359988:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f272f75/0xd9f4181e0d27e72c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.359999:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f272f75/0xd9f4181e0d27e72c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.360006:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f272f75/0xd9f4181e0d27e72c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946100.360020:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946100.360021:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946100.360023:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1790946100.361079:0:18666:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:3.0:1790946100.361197:0:18666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83dee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17172:x1877942638670976:12345-0@lo:5:osp-pre-0-0.0 Request processed in 78931us (94378us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946100.361664:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790946100.361799:0:17172:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f845ed180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17172:1877942638670976:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1790946100.361815:0:17172:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:0.0:1790946100.361865:0:17172:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83defb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17172:1877942638672128:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1790946100.362532:0:17172:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946100.363522:0:17172:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40baf053c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790946100.364058:0:18667:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638672128 00000100:00100000:3.0:1790946100.364067:0:18667:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638672128 00000100:00100000:3.0:1790946100.364213:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790946100.364223:0:18667:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83deed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17172:x1877942638672128:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1790946100.364268:0:18667:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:0.0:1790946100.376239:0:18663:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:0.0:1790946100.376288:0:18663:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1790946100.376806:0:18667:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83deed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17172:x1877942638672128:12345-0@lo:5:osp-pre-0-0.0 Request processed in 12579us (14270us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1790946100.376832:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790946100.377843:0:17172:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1790946100.377878:0:17172:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83defb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17172:1877942638672128:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1790946100.377911:0:17172:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:3.0:1790946100.511392:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946100.575356:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790946100.575382:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638672256:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790946100.575457:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946100.575548:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638672256 00000100:00100000:1.0:1790946100.575570:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638672256 00000100:00100000:1.0:1790946100.575731:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790946100.575742:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638672256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790946100.575777:0:17152:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790946100.575833:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638672256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946100.575841:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790946100.581293:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638672256:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790946100.582111:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638672384:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790946100.582197:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946100.582322:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638672384 00000100:00100000:1.0:1790946100.582331:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638672384 00000100:00100000:1.0:1790946100.582646:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790946100.582658:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638672384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790946100.582696:0:17152:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1790946100.582889:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638672384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 233us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946100.582906:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790946100.585031:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638672384:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1790946101.419599:0:17919:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790946101.535806:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946102.561394:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946103.583707:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946104.612672:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946105.188268:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790946105.188419:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638672512:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790946105.188504:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946105.188627:0:18671:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638672512 00000100:00100000:1.0:1790946105.188638:0:18671:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638672512 00000100:00100000:1.0:1790946105.188713:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790946105.188725:0:18671:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f845ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638672512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790946105.188753:0:18671:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1790946105.188801:0:18671:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f845ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638672512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946105.188820:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790946105.188867:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638672512:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1790946105.188924:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1790946105.392656:0:19836:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1790946105.631334:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946105.711538:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f845edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638672640:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790946105.711616:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946105.711671:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638673152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790946105.711697:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946105.711929:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f845eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638672768:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790946105.711960:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946105.712003:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790946105.712009:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f845ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638672896:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790946105.712034:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946105.712093:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638672640 00000100:00100000:3.0:1790946105.712102:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638672640 00000100:00100000:3.0:1790946105.712136:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638672768 00000100:00100000:3.0:1790946105.712138:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638672768 00000100:00100000:3.0:1790946105.712152:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790946105.712160:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638672640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790946105.712402:0:17153:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1790946105.712460:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638672640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 299us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946105.712467:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790946105.712484:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790946105.712490:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638672768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790946105.712505:0:17153:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1790946105.712536:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638672768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 47us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946105.712553:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790946105.712596:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f845eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638672768:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790946105.713523:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f845edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638672640:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790946105.713539:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790946105.713548:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f845ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638673024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790946105.713588:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946105.713631:0:18671:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638673152 00000100:00100000:0.0:1790946105.713636:0:18671:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638673152 00000100:00100000:0.0:1790946105.713679:0:18671:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638672896 00000100:00100000:0.0:1790946105.713682:0:18671:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638672896 00000100:00100000:0.0:1790946105.713693:0:18671:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638673024 00000100:00100000:0.0:1790946105.713696:0:18671:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638673024 00000100:00100000:0.0:1790946105.713932:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790946105.713943:0:18671:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1877942638673152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790946105.714025:0:18671:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790946105.714579:0:18671:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1877942638673152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (2378us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946105.714588:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790946105.714609:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790946105.714616:0:18671:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638672896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790946105.714629:0:18671:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790946105.714669:0:18671:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638672896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (2634us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946105.714675:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790946105.714688:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790946105.714695:0:18671:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638673024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790946105.714706:0:18671:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00080000:3.0:1790946105.715243:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790946105.715248:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790946105.715595:0:18671:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638673024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 898us (2004us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946105.715604:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790946105.715665:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f845ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638672896:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790946105.717415:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f845ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638673024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790946105.718205:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638673152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790946105.728396:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:87d8d138-d2ce-4761-a98a-4e847b9142bd:3649:1877942638673280:0@lo:400:kworker.0 00000100:00100000:0.0:1790946105.728473:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946105.728522:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1877942638673792:0@lo:400:kworker.0 00000100:00100000:0.0:1790946105.728558:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946105.728586:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1790946105.728592:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877942638673408:0@lo:400:kworker.0 00000100:00100000:0.0:1790946105.728612:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946105.728631:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f845ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1877942638673920:0@lo:400:kworker.0 00000100:00100000:0.0:1790946105.728651:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946105.728680:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1877942638673536:0@lo:400:kworker.0 00000100:00100000:0.0:1790946105.728702:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946105.728715:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f845ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1877942638674048:0@lo:400:kworker.0 00000100:00100000:0.0:1790946105.728731:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946105.728741:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790946105.728746:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1877942638673664:0@lo:400:kworker.0 00000100:00100000:3.0:1790946105.730118:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638673280 00000100:00100000:3.0:1790946105.730132:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638673280 00000100:00100000:3.0:1790946105.730199:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1790946105.730210:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f82388450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+24:3649:x1877942638673280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946105.730429:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f82388450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+24:3649:x1877942638673280:12345-0@lo:400:kworker.0 Request processed in 221us (1955us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946105.730437:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1790946105.732154:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946105.732591:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638673792 00000100:00100000:0.0:1790946105.732600:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638673792 00000100:00100000:0.0:1790946105.732656:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638673408 00000100:00100000:0.0:1790946105.732660:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638673408 00000100:00100000:0.0:1790946105.732672:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638673920 00000100:00100000:0.0:1790946105.732675:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638673920 00000100:00100000:0.0:1790946105.732687:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638673536 00000100:00100000:0.0:1790946105.732689:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638673536 00000100:00100000:0.0:1790946105.732699:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638674048 00000100:00100000:0.0:1790946105.732702:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638674048 00000100:00100000:0.0:1790946105.732713:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638673664 00000100:00100000:0.0:1790946105.732715:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638673664 00000100:00100000:0.0:1790946105.732730:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790946105.732739:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877942638673792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946105.732841:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877942638673792:12345-0@lo:400:kworker.0 Request processed in 104us (4282us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946105.732855:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790946105.732872:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790946105.732878:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877942638673408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946105.732913:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877942638673408:12345-0@lo:400:kworker.0 Request processed in 35us (4299us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946105.732919:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790946105.732931:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790946105.732937:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84416300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1877942638673920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946105.732966:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84416300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1877942638673920:12345-0@lo:400:kworker.0 Request processed in 30us (4314us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946105.732986:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790946105.732999:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790946105.733005:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1877942638673536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946105.733038:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1877942638673536:12345-0@lo:400:kworker.0 Request processed in 34us (4335us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946105.733044:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790946105.733055:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790946105.733061:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1877942638674048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946105.733106:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1877942638674048:12345-0@lo:400:kworker.0 Request processed in 45us (4373us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946105.733111:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790946105.733122:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790946105.733128:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1877942638673664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946105.739484:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1877942638673664:12345-0@lo:400:kworker.0 Request processed in 6342us (7498us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946105.739515:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1790946105.739579:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790946105.739585:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1790946105.739633:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f833f0e00 x1877942638673408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946105.739649:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877942638673408:0@lo:400:kworker.0 00010000:00080000:0.0:1790946105.739664:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f845ed880 x1877942638673920/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946105.739672:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f845ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1877942638673920:0@lo:400:kworker.0 00000100:00100000:0.0:1790946105.739683:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:87d8d138-d2ce-4761-a98a-4e847b9142bd:3649:1877942638673280:0@lo:400:kworker.0 00010000:00080000:0.0:1790946105.739694:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f833f0700 x1877942638673792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946105.739702:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1877942638673792:0@lo:400:kworker.0 00010000:00080000:0.0:1790946105.739745:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f833f0380 x1877942638673664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946105.739754:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1877942638673664:0@lo:400:kworker.0 00010000:00080000:0.0:1790946105.739778:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f833f3800 x1877942638673536/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946105.739785:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1877942638673536:0@lo:400:kworker.0 00010000:00080000:0.0:1790946105.739807:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f845ec000 x1877942638674048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946105.739814:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f845ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1877942638674048:0@lo:400:kworker.0 00000040:00080000:0.0:1790946106.149217:0:17181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:3.0:1790946106.214749:0:19480:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000020:00000004:3.0:1790946106.485633:0:19888:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790946106.485891:0:19888:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790946106.655374:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1790946107.352922:0:19939:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790946107.353150:0:19939:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790946107.679353:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946107.739270:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946107.739493:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616572672 00000100:00100000:0.0:1790946107.739504:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616572672 00000100:00100000:0.0:1790946107.739552:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 114 00000100:00100000:0.0:1790946107.739561:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8238ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2400:x1877942616572672:12345-192.168.204.20@tcp:250:mount.lustre.0 00010000:00080000:0.0:1790946107.739591:0:17140:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 65e62bd4-414e-42c8-885a-5648a45a13a4@192.168.204.20@tcp t0 exp 0000000000000000 cur 558 last 0 00000020:00000080:0.0:1790946107.739621:0:17140:0:(genops.c:1384:class_connect()) connect: client 65e62bd4-414e-42c8-885a-5648a45a13a4, cookie 0xd9f4181e0d27e733 00000100:00080000:0.0:1790946107.739815:0:17140:0:(import.c:65:import_set_state_nolock()) ffff9d3f820bb000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790946107.739898:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8238ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65e62bd4-414e-42c8-885a-5648a45a13a4+5:2400:x1877942616572672:12345-192.168.204.20@tcp:250:mount.lustre.0 Request processed in 335us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946107.739906:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 114 00000100:00100000:0.0:1790946107.742705:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946107.742881:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616572800 00000100:00100000:3.0:1790946107.743040:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616572800 00000100:00100000:3.0:1790946107.743100:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 115 00000100:00100000:3.0:1790946107.743109:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f82389850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65e62bd4-414e-42c8-885a-5648a45a13a4+5:14871:x1877942616572800:12345-192.168.204.20@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790946107.743125:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946107.743143:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40baef0800/0xd9f4181e0d27e73a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330ec4 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946107.743329:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40baef0800/0xd9f4181e0d27e73a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ec4 expref: 6 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946107.743458:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40baef0800/0xd9f4181e0d27e73a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ec4 expref: 6 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946107.743484:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40baef0800, rc 0) 00000100:00100000:2.0:1790946107.743916:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f82389850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65e62bd4-414e-42c8-885a-5648a45a13a4+6:14871:x1877942616572800:12345-192.168.204.20@tcp:101:mount.lustre.0 Request processed in 805us (1220us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946107.743924:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 115 00000100:00100000:1.0:1790946107.758266:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946107.758601:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616572928 00000100:00100000:3.0:1790946107.758614:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616572928 00000100:00100000:3.0:1790946107.758676:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 116 00000100:00100000:3.0:1790946107.758686:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4a35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65e62bd4-414e-42c8-885a-5648a45a13a4+6:14871:x1877942616572928:12345-192.168.204.20@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790946107.758834:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4a35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65e62bd4-414e-42c8-885a-5648a45a13a4+6:14871:x1877942616572928:12345-192.168.204.20@tcp:501:mount.lustre.0 Request processed in 149us (578us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790946107.758842:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 116 00000100:00100000:1.0:1790946107.762199:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946107.764060:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616573056 00000100:00100000:2.0:1790946107.764095:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616573056 00000100:00100000:2.0:1790946107.764201:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 117 00000100:00100000:2.0:1790946107.764211:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4a37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65e62bd4-414e-42c8-885a-5648a45a13a4+6:14871:x1877942616573056:12345-192.168.204.20@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790946107.764228:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946107.764247:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40c21d7c00/0xd9f4181e0d27e741 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330ecb expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946107.764278:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40c21d7c00/0xd9f4181e0d27e741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ecb expref: 7 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946107.764290:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40c21d7c00/0xd9f4181e0d27e741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ecb expref: 7 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946107.764300:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40c21d7c00, rc 0) 00000100:00100000:2.0:1790946107.764547:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4a37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65e62bd4-414e-42c8-885a-5648a45a13a4+7:14871:x1877942616573056:12345-192.168.204.20@tcp:101:mount.lustre.0 Request processed in 336us (2388us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946107.764554:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 117 00000100:00100000:1.0:1790946107.770821:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946107.774627:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616573184 00000100:00100000:0.0:1790946107.774645:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616573184 00000100:00100000:0.0:1790946107.774722:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 118 00000100:00100000:0.0:1790946107.774733:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4a36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65e62bd4-414e-42c8-885a-5648a45a13a4+7:14871:x1877942616573184:12345-192.168.204.20@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790946107.774925:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4a36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65e62bd4-414e-42c8-885a-5648a45a13a4+8:14871:x1877942616573184:12345-192.168.204.20@tcp:501:mount.lustre.0 Request processed in 191us (4112us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946107.774933:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 118 00000100:00100000:1.0:1790946107.781344:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946107.783931:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616573312 00000100:00100000:3.0:1790946107.783948:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616573312 00000100:00100000:3.0:1790946107.784105:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 119 00000100:00100000:3.0:1790946107.784116:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4a37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65e62bd4-414e-42c8-885a-5648a45a13a4+8:14871:x1877942616573312:12345-192.168.204.20@tcp:503:mount.lustre.0 00000100:00100000:3.0:1790946107.784318:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4a37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65e62bd4-414e-42c8-885a-5648a45a13a4+8:14871:x1877942616573312:12345-192.168.204.20@tcp:503:mount.lustre.0 Request processed in 203us (2983us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946107.784327:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 119 00000100:00100000:1.0:1790946107.790940:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946107.791016:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616573440 00000100:00100000:2.0:1790946107.791029:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616573440 00000100:00100000:2.0:1790946107.791094:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 120 00000100:00100000:2.0:1790946107.791107:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4a36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65e62bd4-414e-42c8-885a-5648a45a13a4+8:14889:x1877942616573440:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790946107.791313:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4a36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65e62bd4-414e-42c8-885a-5648a45a13a4+8:14889:x1877942616573440:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 206us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946107.791321:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 120 00000100:00100000:1.0:1790946107.826387:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946107.826490:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616573568 00000100:00100000:3.0:1790946107.826501:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616573568 00000100:00100000:0.0:1790946107.826706:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 121 00000100:00100000:0.0:1790946107.826722:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4a35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65e62bd4-414e-42c8-885a-5648a45a13a4+8:14889:x1877942616573568:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790946107.826947:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4a35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65e62bd4-414e-42c8-885a-5648a45a13a4+8:14889:x1877942616573568:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 229us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946107.826956:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 121 00000100:00100000:1.0:1790946107.835503:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946107.836810:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616573696 00000100:00100000:2.0:1790946107.836824:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616573696 00000100:00100000:2.0:1790946107.836893:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 122 00000100:00100000:2.0:1790946107.836904:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4a36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65e62bd4-414e-42c8-885a-5648a45a13a4+8:14889:x1877942616573696:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790946107.837083:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4a36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65e62bd4-414e-42c8-885a-5648a45a13a4+8:14889:x1877942616573696:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 180us (1591us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946107.837091:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 122 00000100:00100000:1.0:1790946107.841686:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946107.842971:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616573824 00000100:00100000:0.0:1790946107.842985:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616573824 00000100:00100000:0.0:1790946107.843059:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 123 00000100:00100000:0.0:1790946107.843069:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4a37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65e62bd4-414e-42c8-885a-5648a45a13a4+8:14871:x1877942616573824:12345-192.168.204.20@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790946107.843086:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946107.843105:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d4080030400/0xd9f4181e0d27e748 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330efc expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946107.843133:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d4080030400/0xd9f4181e0d27e748 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330efc expref: 9 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946107.843145:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d4080030400/0xd9f4181e0d27e748 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330efc expref: 9 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946107.843154:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4080030400, rc 0) 00000100:00100000:0.0:1790946107.843264:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4a37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65e62bd4-414e-42c8-885a-5648a45a13a4+9:14871:x1877942616573824:12345-192.168.204.20@tcp:101:mount.lustre.0 Request processed in 195us (1589us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946107.843272:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 123 00000100:00100000:1.0:1790946107.854044:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946107.854140:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616573952 00000100:00100000:3.0:1790946107.854150:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616573952 00000100:00100000:3.0:1790946107.854232:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 124 00000100:00100000:3.0:1790946107.854242:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4a34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65e62bd4-414e-42c8-885a-5648a45a13a4+9:14871:x1877942616573952:12345-192.168.204.20@tcp:256:mount.lustre.0 20000000:01000000:3.0:1790946107.854269:0:17142:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1790946107.854296:0:17142:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1790946107.854300:0:17142:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1790946107.854304:0:17142:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1790946107.854312:0:17142:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1790946107.854315:0:17142:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1790946107.857931:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4a34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65e62bd4-414e-42c8-885a-5648a45a13a4+9:14871:x1877942616573952:12345-192.168.204.20@tcp:256:mount.lustre.0 Request processed in 3677us (3887us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946107.857947:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 124 00000100:00100000:1.0:1790946107.863199:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946107.863298:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616574080 00000100:00100000:2.0:1790946107.863309:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616574080 00000100:00100000:2.0:1790946107.864052:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 125 00000100:00100000:2.0:1790946107.864064:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4a35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65e62bd4-414e-42c8-885a-5648a45a13a4+9:14871:x1877942616574080:12345-192.168.204.20@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790946107.864082:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946107.864098:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27e74f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330f03 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946107.864126:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27e74f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330f03 expref: 10 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946107.864138:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27e74f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330f03 expref: 10 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946107.864148:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40c21d6800, rc 0) 00000100:00100000:2.0:1790946107.864247:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4a35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65e62bd4-414e-42c8-885a-5648a45a13a4+10:14871:x1877942616574080:12345-192.168.204.20@tcp:101:mount.lustre.0 Request processed in 185us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946107.864256:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 125 00000100:00100000:1.0:1790946107.873319:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946107.873511:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616574208 00000100:00100000:3.0:1790946107.873523:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616574208 00000100:00100000:3.0:1790946107.873588:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 126 00000100:00100000:3.0:1790946107.873598:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4a34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65e62bd4-414e-42c8-885a-5648a45a13a4+10:14871:x1877942616574208:12345-192.168.204.20@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790946107.873789:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4a34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65e62bd4-414e-42c8-885a-5648a45a13a4+10:14871:x1877942616574208:12345-192.168.204.20@tcp:501:mount.lustre.0 Request processed in 192us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946107.873797:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 126 00000100:00100000:1.0:1790946107.877403:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946107.877771:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616574336 00000100:00100000:0.0:1790946107.877782:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616574336 00000100:00100000:0.0:1790946107.877839:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 127 00000100:00100000:0.0:1790946107.877849:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4a35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65e62bd4-414e-42c8-885a-5648a45a13a4+10:14871:x1877942616574336:12345-192.168.204.20@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790946107.878000:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4a35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65e62bd4-414e-42c8-885a-5648a45a13a4+10:14871:x1877942616574336:12345-192.168.204.20@tcp:503:mount.lustre.0 Request processed in 152us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946107.878009:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 127 00000100:00100000:1.0:1790946107.882220:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946107.883290:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616574464 00000100:00100000:3.0:1790946107.883302:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616574464 00000100:00100000:3.0:1790946107.883371:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 128 00000100:00100000:3.0:1790946107.883381:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4daf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65e62bd4-414e-42c8-885a-5648a45a13a4+10:14894:x1877942616574464:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790946107.883861:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4daf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65e62bd4-414e-42c8-885a-5648a45a13a4+10:14894:x1877942616574464:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 479us (1649us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946107.883870:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 128 00000100:00100000:1.0:1790946107.889868:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946107.901097:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616574592 00000100:00100000:3.0:1790946107.901115:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616574592 00000100:00100000:3.0:1790946107.901215:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 129 00000100:00100000:3.0:1790946107.901227:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4dad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65e62bd4-414e-42c8-885a-5648a45a13a4+10:14894:x1877942616574592:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790946107.901406:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4dad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65e62bd4-414e-42c8-885a-5648a45a13a4+10:14894:x1877942616574592:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 181us (11546us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946107.901414:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 129 00000100:00100000:1.0:1790946107.925344:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946107.925729:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946107.925892:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616574720 00000100:00100000:0.0:1790946107.925904:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616574720 00000100:00100000:0.0:1790946107.926002:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616574976 00000100:00100000:0.0:1790946107.926007:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616574976 00000100:00100000:3.0:1790946107.926045:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:3.0:1790946107.926054:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2400:x1877942616574720:12345-192.168.204.20@tcp:38:mount.lustre.0 00010000:00080000:3.0:1790946107.926094:0:17148:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from ca604fcf-845a-4ff8-977f-a1d27931fa85@192.168.204.20@tcp t0 exp 0000000000000000 cur 558 last 0 00000020:00000080:3.0:1790946107.926145:0:17148:0:(genops.c:1384:class_connect()) connect: client ca604fcf-845a-4ff8-977f-a1d27931fa85, cookie 0xd9f4181e0d27e756 00000004:00100000:3.0:1790946107.926207:0:17148:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1790946107.926438:0:17148:0:(import.c:65:import_set_state_nolock()) ffff9d40903f9000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790946107.926521:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+6:2400:x1877942616574720:12345-192.168.204.20@tcp:38:mount.lustre.0 Request processed in 466us (1184us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946107.926528:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:3.0:1790946107.926548:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 8 00000100:00100000:3.0:1790946107.926552:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2400:x1877942616574976:12345-192.168.204.20@tcp:38:mount.lustre.0 00010000:00080000:3.0:1790946107.926582:0:17148:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from ca604fcf-845a-4ff8-977f-a1d27931fa85@192.168.204.20@tcp t0 exp 0000000000000000 cur 558 last 0 00000020:00000080:3.0:1790946107.926626:0:17148:0:(genops.c:1384:class_connect()) connect: client ca604fcf-845a-4ff8-977f-a1d27931fa85, cookie 0xd9f4181e0d27e75d 00000004:00100000:3.0:1790946107.926639:0:17148:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1790946107.926779:0:17148:0:(import.c:65:import_set_state_nolock()) ffff9d3f82489800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790946107.926803:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+6:2400:x1877942616574976:12345-192.168.204.20@tcp:38:mount.lustre.0 Request processed in 250us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946107.926810:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 8 00000100:00100000:1.0:1790946107.945298:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946107.945341:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946107.945381:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946107.945769:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616575232 00000100:00100000:2.0:1790946107.945781:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616575232 00000100:00100000:2.0:1790946107.945843:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616575104 00000100:00100000:2.0:1790946107.945846:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616575104 00000100:00100000:2.0:1790946107.945857:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616574848 00000100:00100000:2.0:1790946107.945860:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616574848 00000100:00100000:2.0:1790946107.945874:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:2.0:1790946107.945896:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+7:14871:x1877942616575232:12345-192.168.204.20@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790946107.945937:0:17149:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1790946107.946033:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+7:14871:x1877942616575232:12345-192.168.204.20@tcp:41:mount.lustre.0 Request processed in 138us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946107.946040:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:2.0:1790946107.946074:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:2.0:1790946107.946083:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+6:0:x1877942616575104:12345-192.168.204.20@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790946107.946100:0:17149:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790946107.946133:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+6:0:x1877942616575104:12345-192.168.204.20@tcp:41:mount.lustre.0 Request processed in 52us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946107.946140:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:2.0:1790946107.946151:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:2.0:1790946107.946157:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+6:0:x1877942616574848:12345-192.168.204.20@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790946107.946198:0:17149:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1790946107.946221:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+6:0:x1877942616574848:12345-192.168.204.20@tcp:41:mount.lustre.0 Request processed in 64us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946107.946227:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00080000:1.0:1790946107.946619:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790946107.946623:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790946107.949474:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946107.950585:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616575360 00000100:00100000:1.0:1790946107.950598:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616575360 00000100:00100000:1.0:1790946107.950791:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:1.0:1790946107.950804:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+6:14871:x1877942616575360:12345-192.168.204.20@tcp:40:mount.lustre.0 00000100:00100000:1.0:1790946107.950899:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+6:14871:x1877942616575360:12345-192.168.204.20@tcp:40:mount.lustre.0 Request processed in 98us (1435us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946107.950908:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:1.0:1790946107.956517:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946107.958349:0:19563:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616575488 00000100:00100000:3.0:1790946107.958368:0:19563:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616575488 00000100:00100000:1.0:1790946107.958933:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946107.958977:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946107.959117:0:17158:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616575744 00000100:00100000:0.0:1790946107.959124:0:17158:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616575744 00000100:00100000:0.0:1790946107.959201:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 3 00000100:00100000:0.0:1790946107.959211:0:17158:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ca604fcf-845a-4ff8-977f-a1d27931fa85+6:14871:x1877942616575744:12345-192.168.204.20@tcp:900:mount.lustre.0 00000100:00100000:0.0:1790946107.959306:0:17158:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ca604fcf-845a-4ff8-977f-a1d27931fa85+6:14871:x1877942616575744:12345-192.168.204.20@tcp:900:mount.lustre.0 Request processed in 96us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946107.959314:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 3 00000100:00100000:3.0:1790946107.960236:0:18666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616575616 00000100:00100000:3.0:1790946107.960245:0:18666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616575616 00000100:00100000:3.0:1790946107.960286:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:3.0:1790946107.960293:0:18666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2400:x1877942616575616:12345-192.168.204.20@tcp:8:mount.lustre.0 00010000:00080000:3.0:1790946107.960329:0:18666:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from ca604fcf-845a-4ff8-977f-a1d27931fa85@192.168.204.20@tcp t0 exp 0000000000000000 cur 558 last 0 00000020:00000080:3.0:1790946107.960379:0:18666:0:(genops.c:1384:class_connect()) connect: client ca604fcf-845a-4ff8-977f-a1d27931fa85, cookie 0xd9f4181e0d27e764 00002000:00100000:3.0:1790946107.960400:0:18666:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ca604fcf-845a-4ff8-977f-a1d27931fa85/ffff9d3f8248b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790946107.960419:0:18666:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790946107.960673:0:18666:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1790946107.960858:0:18666:0:(import.c:65:import_set_state_nolock()) ffff9d40baa30800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790946107.960916:0:18666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ca604fcf-845a-4ff8-977f-a1d27931fa85+6:2400:x1877942616575616:12345-192.168.204.20@tcp:8:mount.lustre.0 Request processed in 622us (1987us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946107.960924:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:1.0:1790946107.962933:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946107.963144:0:17150:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616575872 00000100:00100000:3.0:1790946107.963154:0:17150:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616575872 00000100:00100000:0.0:1790946107.963314:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:0.0:1790946107.963325:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+6:14871:x1877942616575872:12345-192.168.204.20@tcp:33:mount.lustre.0 00000004:00080000:3.0:1790946107.964673:0:17151:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1258us 00000100:00100000:2.0:1790946107.965377:0:19563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:2.0:1790946107.965552:0:19563:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2400:x1877942616575488:12345-192.168.204.20@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790946107.965827:0:19563:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from ca604fcf-845a-4ff8-977f-a1d27931fa85@192.168.204.20@tcp t0 exp 0000000000000000 cur 558 last 0 00000020:00000080:2.0:1790946107.966029:0:19563:0:(genops.c:1384:class_connect()) connect: client ca604fcf-845a-4ff8-977f-a1d27931fa85, cookie 0xd9f4181e0d27e76b 00002000:00100000:2.0:1790946107.966041:0:19563:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ca604fcf-845a-4ff8-977f-a1d27931fa85/ffff9d40bc94d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790946107.966064:0:19563:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790946107.969149:0:19563:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790946107.969225:0:19563:0:(import.c:65:import_set_state_nolock()) ffff9d40bc94e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790946107.969306:0:19563:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ca604fcf-845a-4ff8-977f-a1d27931fa85+6:2400:x1877942616575488:12345-192.168.204.20@tcp:8:mount.lustre.0 Request processed in 3916us (12795us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946107.969319:0:19563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 17 00000004:00200000:3.0:1790946107.981201:0:17151:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1790946107.981347:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+6:14871:x1877942616575872:12345-192.168.204.20@tcp:33:mount.lustre.0 Request processed in 18016us (18415us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946107.981360:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:1.0:1790946108.203693:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946108.204551:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616576000 00000100:00100000:0.0:1790946108.204576:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616576000 00000100:00100000:0.0:1790946108.204653:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:0.0:1790946108.204664:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca604fcf-845a-4ff8-977f-a1d27931fa85+6:14917:x1877942616576000:12345-192.168.204.20@tcp:101:mkdir.0 00010000:00010000:0.0:1790946108.204698:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946108.204732:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030800/0xd9f4181e0d27e772 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330f34 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946108.204810:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031e00/0xd9f4181e0d27e779 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946108.204824:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031e00/0xd9f4181e0d27e779 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946108.204838:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031e00/0xd9f4181e0d27e779 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790946108.204902:0:17147:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790946108.204906:0:17147:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790946108.204954:0:17147:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031e00/0xd9f4181e0d27e779 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946108.204982:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030800/0xd9f4181e0d27e772 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330f34 expref: 8 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946108.205001:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031e00/0xd9f4181e0d27e779 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330f34 expref: 7 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946108.205010:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d40bc9afc00) 00010000:00010000:0.0:1790946108.205013:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790946108.205016:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4080031e00, rc 0) 00000100:00100000:0.0:1790946108.205083:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca604fcf-845a-4ff8-977f-a1d27931fa85+7:14917:x1877942616576000:12345-192.168.204.20@tcp:101:mkdir.0 Request processed in 422us (1400us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946108.205091:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 13 00010000:00010000:1.0:1790946108.703362:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946109.727541:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946110.174974:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946110.175462:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616576128 00000100:00100000:1.0:1790946110.175475:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616576128 00000100:00100000:1.0:1790946110.175602:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 14 00000100:00100000:1.0:1790946110.175616:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f845edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+7:14969:x1877942616576128:12345-192.168.204.20@tcp:41:lfs.0 00000004:00000024:1.0:1790946110.175668:0:17149:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00080000:0.0:1790946110.176563:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790946110.176747:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f845edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+7:14969:x1877942616576128:12345-192.168.204.20@tcp:41:lfs.0 Request processed in 1119us (1770us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946110.176758:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 14 00000100:00100000:1.0:1790946110.182575:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946110.182997:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616576256 00000100:00100000:3.0:1790946110.183007:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616576256 00000100:00080000:0.0:1790946110.183147:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790946110.183352:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15 00000100:00100000:3.0:1790946110.183363:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+6:14969:x1877942616576256:12345-192.168.204.20@tcp:41:lfs.0 00000004:00000024:3.0:1790946110.183402:0:17148:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1790946110.183492:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+6:14969:x1877942616576256:12345-192.168.204.20@tcp:41:lfs.0 Request processed in 131us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946110.183500:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15 00000100:00100000:3.0:1790946110.190011:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946110.190126:0:18671:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616576384 00000100:00100000:0.0:1790946110.190139:0:18671:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616576384 00000100:00100000:0.0:1790946110.190245:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:0.0:1790946110.190256:0:18671:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f845eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ca604fcf-845a-4ff8-977f-a1d27931fa85+6:14969:x1877942616576384:12345-192.168.204.20@tcp:13:lfs.0 00002000:00000024:0.0:1790946110.190295:0:18671:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1790946110.190399:0:18671:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f845eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ca604fcf-845a-4ff8-977f-a1d27931fa85+6:14969:x1877942616576384:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 144us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946110.190407:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00080000:1.0:1790946110.192149:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790946110.195022:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946110.195202:0:18671:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616576512 00000100:00100000:0.0:1790946110.195213:0:18671:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616576512 00000100:00100000:0.0:1790946110.195337:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:0.0:1790946110.195349:0:18671:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ca604fcf-845a-4ff8-977f-a1d27931fa85+6:14969:x1877942616576512:12345-192.168.204.20@tcp:13:lfs.0 00002000:00000024:0.0:1790946110.195382:0:18671:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790946110.195465:0:18671:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ca604fcf-845a-4ff8-977f-a1d27931fa85+6:14969:x1877942616576512:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 118us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946110.195473:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00080000:1.0:1790946110.195669:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790946110.305312:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638674176:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790946110.305392:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946110.305520:0:18670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638674176 00000100:00100000:3.0:1790946110.305541:0:18670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638674176 00000100:00080000:1.0:1790946110.305581:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790946110.305602:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790946110.305608:0:18671:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1790946110.305610:0:18670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638674176:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790946110.305627:0:18671:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:3.0:1790946110.305632:0:18670:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1790946110.305973:0:18670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638674176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 362us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946110.305981:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790946110.306050:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638674176:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790946110.381626:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946110.381744:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616576640 00000100:00100000:0.0:1790946110.381756:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616576640 00000100:00100000:0.0:1790946110.381811:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 130 00000100:00100000:0.0:1790946110.381821:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4daf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65e62bd4-414e-42c8-885a-5648a45a13a4+10:15001:x1877942616576640:12345-192.168.204.20@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790946110.381838:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946110.381855:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d4080030800/0xd9f4181e0d27e780 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330f3b expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946110.381881:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d4080030800/0xd9f4181e0d27e780 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330f3b expref: 11 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946110.381891:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d4080030800/0xd9f4181e0d27e780 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330f3b expref: 11 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946110.381899:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4080030800, rc 0) 00000100:00100000:0.0:1790946110.381957:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4daf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65e62bd4-414e-42c8-885a-5648a45a13a4+11:15001:x1877942616576640:12345-192.168.204.20@tcp:101:mount.lustre.0 Request processed in 137us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946110.381964:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 130 00000100:00100000:3.0:1790946110.388030:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946110.388220:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616576768 00000100:00100000:2.0:1790946110.388231:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616576768 00000100:00100000:2.0:1790946110.388286:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 131 00000100:00100000:2.0:1790946110.388295:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65e62bd4-414e-42c8-885a-5648a45a13a4+11:15001:x1877942616576768:12345-192.168.204.20@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790946110.388461:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65e62bd4-414e-42c8-885a-5648a45a13a4+11:15001:x1877942616576768:12345-192.168.204.20@tcp:501:mount.lustre.0 Request processed in 167us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946110.388477:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 131 00000100:00100000:1.0:1790946110.400232:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946110.400313:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616576896 00000100:00100000:3.0:1790946110.400323:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616576896 00000100:00100000:3.0:1790946110.400389:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 132 00000100:00100000:3.0:1790946110.400398:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65e62bd4-414e-42c8-885a-5648a45a13a4+11:15001:x1877942616576896:12345-192.168.204.20@tcp:503:mount.lustre.0 00000100:00100000:3.0:1790946110.400539:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65e62bd4-414e-42c8-885a-5648a45a13a4+11:15001:x1877942616576896:12345-192.168.204.20@tcp:503:mount.lustre.0 Request processed in 142us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946110.400547:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 132 00000100:00100000:3.0:1790946110.423144:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946110.426794:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616577024 00000100:00100000:0.0:1790946110.426829:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616577024 00000100:00100000:0.0:1790946110.426911:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 133 00000100:00100000:0.0:1790946110.426922:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65e62bd4-414e-42c8-885a-5648a45a13a4+11:15008:x1877942616577024:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790946110.427202:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65e62bd4-414e-42c8-885a-5648a45a13a4+11:15008:x1877942616577024:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 281us (4077us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946110.427211:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 133 00000100:00100000:1.0:1790946110.460998:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946110.461106:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616577152 00000100:00100000:2.0:1790946110.461117:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616577152 00000100:00100000:2.0:1790946110.461202:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 134 00000100:00100000:2.0:1790946110.461212:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65e62bd4-414e-42c8-885a-5648a45a13a4+11:15008:x1877942616577152:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790946110.461374:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65e62bd4-414e-42c8-885a-5648a45a13a4+11:15008:x1877942616577152:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 163us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946110.461382:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 134 00000100:00100000:1.0:1790946110.464155:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946110.464281:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616577280 00000100:00100000:3.0:1790946110.464292:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616577280 00000100:00100000:3.0:1790946110.464357:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 135 00000100:00100000:3.0:1790946110.464366:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65e62bd4-414e-42c8-885a-5648a45a13a4+11:15008:x1877942616577280:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790946110.464727:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65e62bd4-414e-42c8-885a-5648a45a13a4+11:15008:x1877942616577280:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 360us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946110.464734:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 135 00000100:00100000:3.0:1790946110.473059:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946110.476757:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616577408 00000100:00100000:0.0:1790946110.476774:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616577408 00000100:00100000:0.0:1790946110.476849:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 136 00000100:00100000:0.0:1790946110.476860:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65e62bd4-414e-42c8-885a-5648a45a13a4+11:15001:x1877942616577408:12345-192.168.204.20@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790946110.476880:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946110.476897:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d4080030c00/0xd9f4181e0d27e787 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330f6c expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946110.476928:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d4080030c00/0xd9f4181e0d27e787 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330f6c expref: 12 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946110.476939:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d4080030c00/0xd9f4181e0d27e787 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330f6c expref: 12 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946110.476947:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4080030c00, rc 0) 00000100:00100000:0.0:1790946110.477018:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65e62bd4-414e-42c8-885a-5648a45a13a4+12:15001:x1877942616577408:12345-192.168.204.20@tcp:101:mount.lustre.0 Request processed in 159us (3968us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946110.477025:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 136 00000100:00100000:1.0:1790946110.480125:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946110.483940:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616577536 00000100:00100000:3.0:1790946110.483974:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616577536 00000100:00100000:2.0:1790946110.484259:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 137 00000100:00100000:2.0:1790946110.484281:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65e62bd4-414e-42c8-885a-5648a45a13a4+12:15001:x1877942616577536:12345-192.168.204.20@tcp:256:mount.lustre.0 20000000:01000000:2.0:1790946110.484323:0:17142:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1790946110.484900:0:17142:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1790946110.484906:0:17142:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1790946110.484908:0:17142:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1790946110.484911:0:17142:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1790946110.484914:0:17142:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1790946110.486464:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65e62bd4-414e-42c8-885a-5648a45a13a4+12:15001:x1877942616577536:12345-192.168.204.20@tcp:256:mount.lustre.0 Request processed in 2179us (6339us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946110.486479:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 137 00000100:00100000:3.0:1790946110.490433:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946110.490863:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616577664 00000100:00100000:2.0:1790946110.490873:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616577664 00000100:00100000:2.0:1790946110.490990:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 138 00000100:00100000:2.0:1790946110.491001:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65e62bd4-414e-42c8-885a-5648a45a13a4+12:15001:x1877942616577664:12345-192.168.204.20@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790946110.491019:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946110.491037:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40c21d6000/0xd9f4181e0d27e78e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330f73 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946110.491067:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40c21d6000/0xd9f4181e0d27e78e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330f73 expref: 13 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946110.491079:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40c21d6000/0xd9f4181e0d27e78e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330f73 expref: 13 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946110.491088:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40c21d6000, rc 0) 00000100:00100000:2.0:1790946110.491151:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65e62bd4-414e-42c8-885a-5648a45a13a4+13:15001:x1877942616577664:12345-192.168.204.20@tcp:101:mount.lustre.0 Request processed in 152us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946110.491159:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 138 00000100:00100000:1.0:1790946110.499648:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946110.499842:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616577792 00000100:00100000:2.0:1790946110.499852:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616577792 00000100:00100000:2.0:1790946110.499913:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 139 00000100:00100000:2.0:1790946110.499925:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65e62bd4-414e-42c8-885a-5648a45a13a4+13:15001:x1877942616577792:12345-192.168.204.20@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790946110.500097:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65e62bd4-414e-42c8-885a-5648a45a13a4+13:15001:x1877942616577792:12345-192.168.204.20@tcp:501:mount.lustre.0 Request processed in 173us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946110.500104:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 139 00000100:00100000:1.0:1790946110.502483:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946110.502645:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616577920 00000100:00100000:2.0:1790946110.502654:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616577920 00000100:00100000:2.0:1790946110.502721:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 140 00000100:00100000:2.0:1790946110.502805:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65e62bd4-414e-42c8-885a-5648a45a13a4+13:15001:x1877942616577920:12345-192.168.204.20@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790946110.502992:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65e62bd4-414e-42c8-885a-5648a45a13a4+13:15001:x1877942616577920:12345-192.168.204.20@tcp:503:mount.lustre.0 Request processed in 191us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946110.503001:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 140 00000100:00100000:3.0:1790946110.506410:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946110.506903:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616578048 00000100:00100000:0.0:1790946110.506913:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616578048 00000100:00100000:0.0:1790946110.507024:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 141 00000100:00100000:0.0:1790946110.507035:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65e62bd4-414e-42c8-885a-5648a45a13a4+13:15014:x1877942616578048:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790946110.507241:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65e62bd4-414e-42c8-885a-5648a45a13a4+13:15014:x1877942616578048:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 206us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946110.507249:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 141 00000100:00100000:3.0:1790946110.510061:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946110.510155:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616578176 00000100:00100000:1.0:1790946110.510190:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616578176 00000100:00100000:1.0:1790946110.510252:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 142 00000100:00100000:1.0:1790946110.510262:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65e62bd4-414e-42c8-885a-5648a45a13a4+13:15014:x1877942616578176:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790946110.510444:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65e62bd4-414e-42c8-885a-5648a45a13a4+13:15014:x1877942616578176:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 183us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946110.510453:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 142 00000100:00100000:1.0:1790946110.523528:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946110.523913:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946110.530478:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616578304 00000100:00100000:2.0:1790946110.530494:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616578304 00000100:00100000:2.0:1790946110.530596:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616578560 00000100:00100000:2.0:1790946110.530600:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616578560 00000100:00100000:3.0:1790946110.530727:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:3.0:1790946110.530735:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2400:x1877942616578304:12345-192.168.204.20@tcp:38:mount.lustre.0 00010000:00080000:3.0:1790946110.530767:0:17148:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713@192.168.204.20@tcp t0 exp 0000000000000000 cur 561 last 0 00000020:00000080:3.0:1790946110.530956:0:17148:0:(genops.c:1384:class_connect()) connect: client ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713, cookie 0xd9f4181e0d27e795 00000004:00100000:3.0:1790946110.531046:0:17148:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1790946110.531138:0:17148:0:(import.c:65:import_set_state_nolock()) ffff9d40baa31800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790946110.531228:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+6:2400:x1877942616578304:12345-192.168.204.20@tcp:38:mount.lustre.0 Request processed in 492us (7712us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946110.531780:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:3.0:1790946110.532053:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:3.0:1790946110.532060:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2400:x1877942616578560:12345-192.168.204.20@tcp:38:mount.lustre.0 00010000:00080000:3.0:1790946110.532098:0:17148:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713@192.168.204.20@tcp t0 exp 0000000000000000 cur 561 last 0 00000020:00000080:3.0:1790946110.532129:0:17148:0:(genops.c:1384:class_connect()) connect: client ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713, cookie 0xd9f4181e0d27e79c 00000004:00100000:3.0:1790946110.532145:0:17148:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1790946110.532504:0:17148:0:(import.c:65:import_set_state_nolock()) ffff9d40baa35000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790946110.532565:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+6:2400:x1877942616578560:12345-192.168.204.20@tcp:38:mount.lustre.0 Request processed in 504us (8652us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946110.532573:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:1.0:1790946110.546157:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946110.546378:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946110.546464:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946110.546514:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616578688 00000100:00100000:0.0:1790946110.546529:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616578688 00000100:00100000:0.0:1790946110.546585:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616578432 00000100:00100000:0.0:1790946110.546588:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616578432 00000100:00100000:0.0:1790946110.546599:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616578816 00000100:00100000:0.0:1790946110.546601:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616578816 00000100:00100000:0.0:1790946110.546614:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 18 00000100:00100000:0.0:1790946110.546622:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+6:0:x1877942616578688:12345-192.168.204.20@tcp:41:mount.lustre.0 00000100:00080000:3.0:1790946110.546735:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790946110.546740:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:0.0:1790946110.546783:0:17148:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790946110.547416:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+6:0:x1877942616578688:12345-192.168.204.20@tcp:41:mount.lustre.0 Request processed in 792us (1268us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946110.547426:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 18 00000100:00100000:0.0:1790946110.547451:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:0.0:1790946110.547459:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f845ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+7:0:x1877942616578432:12345-192.168.204.20@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790946110.547492:0:17148:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1790946110.547524:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f845ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+7:0:x1877942616578432:12345-192.168.204.20@tcp:41:mount.lustre.0 Request processed in 67us (1148us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946110.547531:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:0.0:1790946110.547544:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 20 00000100:00100000:0.0:1790946110.547550:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f845ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+6:15001:x1877942616578816:12345-192.168.204.20@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790946110.547561:0:17148:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1790946110.547584:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f845ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+6:15001:x1877942616578816:12345-192.168.204.20@tcp:41:mount.lustre.0 Request processed in 34us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946110.547597:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 20 00000100:00100000:1.0:1790946110.559579:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946110.559743:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616578944 00000100:00100000:0.0:1790946110.559753:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616578944 00000100:00100000:0.0:1790946110.560108:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 21 00000100:00100000:0.0:1790946110.560120:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+6:15001:x1877942616578944:12345-192.168.204.20@tcp:40:mount.lustre.0 00000100:00100000:0.0:1790946110.560274:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+6:15001:x1877942616578944:12345-192.168.204.20@tcp:40:mount.lustre.0 Request processed in 156us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946110.560282:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 21 00000100:00100000:1.0:1790946110.572935:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946110.572980:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946110.573022:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946110.573112:0:18666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616579072 00000100:00100000:3.0:1790946110.573123:0:18666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616579072 00000100:00100000:3.0:1790946110.573163:0:18666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616579200 00000100:00100000:3.0:1790946110.573191:0:18666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616579200 00000100:00100000:3.0:1790946110.573213:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 18 00000100:00100000:3.0:1790946110.573222:0:18666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83deea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2400:x1877942616579072:12345-192.168.204.20@tcp:8:mount.lustre.0 00010000:00080000:3.0:1790946110.573270:0:18666:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713@192.168.204.20@tcp t0 exp 0000000000000000 cur 561 last 0 00000020:00000080:3.0:1790946110.573300:0:18666:0:(genops.c:1384:class_connect()) connect: client ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713, cookie 0xd9f4181e0d27e7a3 00002000:00100000:3.0:1790946110.573311:0:18666:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713/ffff9d40baa36000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790946110.573322:0:18666:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790946110.573410:0:18666:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790946110.573441:0:18666:0:(import.c:65:import_set_state_nolock()) ffff9d40baa32000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790946110.573516:0:18666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83deea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+6:2400:x1877942616579072:12345-192.168.204.20@tcp:8:mount.lustre.0 Request processed in 281us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946110.573525:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 18 00000100:00100000:3.0:1790946110.573544:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:3.0:1790946110.573549:0:18666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2400:x1877942616579200:12345-192.168.204.20@tcp:8:mount.lustre.0 00010000:00080000:3.0:1790946110.573565:0:18666:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713@192.168.204.20@tcp t0 exp 0000000000000000 cur 561 last 0 00000020:00000080:3.0:1790946110.573580:0:18666:0:(genops.c:1384:class_connect()) connect: client ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713, cookie 0xd9f4181e0d27e7aa 00002000:00100000:3.0:1790946110.573586:0:18666:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713/ffff9d40baa34800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790946110.573592:0:18666:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790946110.573632:0:18666:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1790946110.573647:0:18666:0:(import.c:65:import_set_state_nolock()) ffff9d40baa35800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790946110.573670:0:18666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+6:2400:x1877942616579200:12345-192.168.204.20@tcp:8:mount.lustre.0 Request processed in 120us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946110.573691:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:0.0:1790946110.575215:0:17158:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616579328 00000100:00100000:0.0:1790946110.575282:0:17158:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616579328 00000100:00100000:0.0:1790946110.575752:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4 00000100:00100000:0.0:1790946110.575765:0:17158:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+6:15001:x1877942616579328:12345-192.168.204.20@tcp:900:mount.lustre.0 00000100:00100000:0.0:1790946110.575851:0:17158:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+6:15001:x1877942616579328:12345-192.168.204.20@tcp:900:mount.lustre.0 Request processed in 88us (2925us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946110.577868:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946110.577952:0:17150:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616579456 00000100:00100000:3.0:1790946110.577965:0:17150:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616579456 00000100:00100000:3.0:1790946110.578026:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1 00000100:00100000:3.0:1790946110.578036:0:17150:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+7:15001:x1877942616579456:12345-192.168.204.20@tcp:33:mount.lustre.0 00000004:00200000:3.0:1790946110.578127:0:17150:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1790946110.578243:0:17150:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+7:15001:x1877942616579456:12345-192.168.204.20@tcp:33:mount.lustre.0 Request processed in 209us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946110.578251:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1 00000100:00100000:0.0:1790946110.585585:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4 00010000:00010000:1.0:1790946110.751543:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946110.784445:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946110.784689:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616579584 00000100:00100000:0.0:1790946110.784717:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616579584 00000100:00100000:0.0:1790946110.784774:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 22 00000100:00100000:0.0:1790946110.784784:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+6:15037:x1877942616579584:12345-192.168.204.20@tcp:101:mkdir.0 00010000:00010000:0.0:1790946110.784804:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946110.784824:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27e7b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330fa4 expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946110.784887:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e7b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946110.784919:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e7b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946110.784930:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e7b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790946110.784974:0:17148:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790946110.784977:0:17148:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790946110.784996:0:17148:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e7b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946110.785021:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031800/0xd9f4181e0d27e7b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330fa4 expref: 8 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946110.785049:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e7b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330fa4 expref: 7 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946110.785058:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d40bc9afc00) 00010000:00010000:0.0:1790946110.785061:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790946110.785064:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4080030a00, rc 0) 00000100:00100000:0.0:1790946110.785137:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+7:15037:x1877942616579584:12345-192.168.204.20@tcp:101:mkdir.0 Request processed in 346us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946110.785145:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 22 00000100:00100000:0.0:1790946110.815464:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638674304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790946110.815544:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946110.815830:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790946110.815839:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f825a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638674432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790946110.815869:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946110.816051:0:18671:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638674304 00000100:00100000:1.0:1790946110.816058:0:18671:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638674304 00000100:00100000:1.0:1790946110.816105:0:18671:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638674432 00000100:00100000:1.0:1790946110.816108:0:18671:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638674432 00000100:00100000:1.0:1790946110.816124:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790946110.816142:0:18671:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638674304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790946110.816163:0:18671:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1790946110.816233:0:18671:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638674304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946110.816240:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790946110.816254:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790946110.816259:0:18671:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638674432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790946110.816268:0:18671:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1790946110.816289:0:18671:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638674432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 30us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946110.816294:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1790946110.816309:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790946110.816313:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790946110.816468:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638674560:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790946110.816498:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946110.816532:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638674560 00000100:00100000:2.0:1790946110.816536:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638674560 00000100:00100000:2.0:1790946110.816563:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790946110.816569:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638674560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790946110.816599:0:17153:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1790946110.816635:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638674560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946110.816641:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790946110.816682:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638674560:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790946110.816842:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f825a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638674432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790946110.816852:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1790946110.816865:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638674304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790946110.818936:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790946110.818953:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638674688:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790946110.819007:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946110.821353:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638674944:0@lo:400:kworker.0 00000100:00100000:3.0:1790946110.821370:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638675072:0@lo:400:kworker.0 00000100:00100000:3.0:1790946110.821429:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946110.821429:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946110.821445:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1877942638675200:0@lo:400:kworker.0 00000100:00100000:3.0:1790946110.821466:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1877942638675584:0@lo:400:kworker.0 00000100:00100000:2.0:1790946110.821483:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946110.821507:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638675072 00000100:00100000:2.0:1790946110.821515:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40baced500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1877942638675712:0@lo:400:kworker.0 00000100:00100000:3.0:1790946110.821516:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638675072 00000100:00100000:2.0:1790946110.821549:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946110.821652:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40baced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1877942638675456:0@lo:400:kworker.0 00000100:00100000:0.0:1790946110.821687:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946110.821910:0:18671:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638674688 00000100:00100000:1.0:1790946110.821915:0:18671:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638674688 00000100:00100000:1.0:1790946110.821962:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790946110.821970:0:18671:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638674688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790946110.821995:0:18671:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1790946110.822042:0:18671:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638674688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (3033us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946110.822049:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1790946110.822071:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790946110.822099:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:87d8d138-d2ce-4761-a98a-4e847b9142bd:3649:1877942638674816:0@lo:400:kworker.0 00000100:00100000:1.0:1790946110.822142:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946110.822183:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bacef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1877942638675328:0@lo:400:kworker.0 00000100:00100000:1.0:1790946110.822217:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638674816 00000100:00100000:1.0:1790946110.822221:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638674816 00000100:00100000:1.0:1790946110.822256:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1790946110.822262:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+24:3649:x1877942638674816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946110.822298:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+24:3649:x1877942638674816:12345-0@lo:400:kworker.0 Request processed in 36us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946110.822304:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1790946110.824648:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946110.828311:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638675200 00000100:00100000:3.0:1790946110.828328:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638675200 00000100:00100000:2.0:1790946110.828333:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638675712 00000100:00100000:2.0:1790946110.828340:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638675712 00000100:00100000:2.0:1790946110.828430:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638675456 00000100:00100000:2.0:1790946110.828433:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638675456 00000100:00100000:2.0:1790946110.828455:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790946110.828465:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638675072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946110.828559:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638675072:12345-0@lo:400:kworker.0 Request processed in 95us (7136us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946110.828566:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790946110.828584:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790946110.828589:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1877942638675712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946110.828625:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1877942638675712:12345-0@lo:400:kworker.0 Request processed in 37us (7077us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946110.828646:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790946110.828660:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790946110.828666:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1877942638675456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946110.828717:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1877942638675456:12345-0@lo:400:kworker.0 Request processed in 51us (7029us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946110.828723:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790946110.828772:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790946110.828779:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1877942638675200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946110.828815:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1877942638675200:12345-0@lo:400:kworker.0 Request processed in 36us (7333us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946110.828822:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790946110.828875:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638674944 00000100:00100000:3.0:1790946110.828879:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638674944 00000100:00100000:3.0:1790946110.828903:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790946110.828909:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bacec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638674944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946110.828943:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bacec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638674944:12345-0@lo:400:kworker.0 Request processed in 33us (7521us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946110.828948:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1790946110.828966:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790946110.829012:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1877942638675200:0@lo:400:kworker.0 00010000:00080000:3.0:1790946110.829029:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40baced500 x1877942638675712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946110.829040:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40baced500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1877942638675712:0@lo:400:kworker.0 00000100:00100000:3.0:1790946110.829087:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638674944:0@lo:400:kworker.0 00010000:00080000:3.0:1790946110.829099:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40baced180 x1877942638675456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946110.829109:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40baced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1877942638675456:0@lo:400:kworker.0 00000100:00100000:0.0:1790946110.833030:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638674688:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790946110.833077:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638675072:0@lo:400:kworker.0 00000100:00100000:1.0:1790946110.833243:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946110.835620:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638675840:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790946110.835819:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946110.835870:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:87d8d138-d2ce-4761-a98a-4e847b9142bd:3649:1877942638674816:0@lo:400:kworker.0 00000100:00100000:1.0:1790946110.835925:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638675840 00000100:00100000:1.0:1790946110.835931:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638675840 00000100:00100000:1.0:1790946110.835976:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790946110.835984:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638675840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790946110.836028:0:17153:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790946110.836077:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638675840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946110.836084:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790946110.836120:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638675840:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790946110.837418:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638675584 00000100:00100000:3.0:1790946110.837570:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638675584 00000100:00100000:3.0:1790946110.837640:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638675328 00000100:00100000:3.0:1790946110.837645:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638675328 00000100:00100000:3.0:1790946110.837664:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790946110.837673:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1877942638675584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946110.838323:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1877942638675584:12345-0@lo:400:kworker.0 Request processed in 104us (13134us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946110.838332:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790946110.838370:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790946110.838377:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877942638675328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946110.838421:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877942638675328:12345-0@lo:400:kworker.0 Request processed in 45us (5179us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946110.838427:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790946110.838555:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1877942638675584:0@lo:400:kworker.0 00000100:00080000:1.0:1790946110.838776:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790946110.838803:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bacef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1877942638675328:0@lo:400:kworker.0 00000040:00080000:3.0:1790946111.649151:0:17919:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790946111.775402:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946112.802325:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790946113.620477:0:20037:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1790946113.823314:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790946113.891298:0:19480:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713 00000001:00100000:0.0:1790946113.891309:0:19480:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ca604fcf-845a-4ff8-977f-a1d27931fa85 00000001:00100000:0.0:1790946113.895936:0:17127:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713 00000001:00100000:0.0:1790946113.895950:0:17127:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ca604fcf-845a-4ff8-977f-a1d27931fa85 00000001:00100000:0.0:1790946113.896922:0:17893:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713 00000001:00100000:0.0:1790946113.896930:0:17893:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ca604fcf-845a-4ff8-977f-a1d27931fa85 00000001:00100000:0.0:1790946113.910578:0:18663:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713 00000001:00100000:0.0:1790946113.910592:0:18663:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ca604fcf-845a-4ff8-977f-a1d27931fa85 00010000:00010000:1.0:1790946114.848239:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946115.423618:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638675968:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790946115.423692:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946115.424436:0:19952:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638675968 00000100:00100000:1.0:1790946115.424446:0:19952:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638675968 00000100:00100000:1.0:1790946115.424538:0:19952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790946115.424550:0:19952:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638675968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790946115.424588:0:19952:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1790946115.424663:0:19952:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638675968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946115.424671:0:19952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790946115.424929:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638675968:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1790946115.425157:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790946115.653367:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946115.653418:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946115.653455:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946115.653477:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946115.653501:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946115.653517:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946115.653532:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946115.653548:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946115.653566:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946115.653606:0:19563:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616580096 00000100:00100000:2.0:1790946115.653617:0:19563:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616580096 00000100:00100000:2.0:1790946115.653671:0:19563:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616580608 00000100:00100000:2.0:1790946115.653675:0:19563:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616580608 00000100:00100000:2.0:1790946115.653688:0:19563:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616580224 00000100:00100000:2.0:1790946115.653690:0:19563:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616580224 00000100:00100000:2.0:1790946115.653700:0:19563:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616580736 00000100:00100000:2.0:1790946115.653702:0:19563:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616580736 00000100:00100000:2.0:1790946115.653717:0:19563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2 00000100:00100000:2.0:1790946115.653727:0:19563:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83dece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ca604fcf-845a-4ff8-977f-a1d27931fa85+5:2402:x1877942616580096:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790946115.653996:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 3 00000100:00100000:0.0:1790946115.654007:0:18667:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4cec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+5:2402:x1877942616580608:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790946115.654084:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616579840 00000100:00100000:1.0:1790946115.654089:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616579840 00000100:00100000:1.0:1790946115.654112:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616580352 00000100:00100000:1.0:1790946115.654115:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616580352 00000100:00100000:1.0:1790946115.654138:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616579968 00000100:00100000:1.0:1790946115.654141:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616579968 00000100:00100000:1.0:1790946115.654155:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616580480 00000100:00100000:1.0:1790946115.654182:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616580480 00000100:00100000:1.0:1790946115.654202:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 42 00000100:00100000:1.0:1790946115.654208:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f825a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+6:2402:x1877942616579840:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790946115.654302:0:19563:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83dece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ca604fcf-845a-4ff8-977f-a1d27931fa85+5:2402:x1877942616580096:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 574us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946115.654310:0:19563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2 00000100:00100000:2.0:1790946115.654328:0:19563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4 00000100:00100000:2.0:1790946115.654335:0:19563:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4ced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ca604fcf-845a-4ff8-977f-a1d27931fa85+5:2402:x1877942616580224:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790946115.655585:0:19252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00100000:3.0:1790946115.655615:0:19252:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4cef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+5:2402:x1877942616580736:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790946115.657746:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f825a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+6:2402:x1877942616579840:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 3532us (4507us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946115.657762:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 42 00000100:00100000:1.0:1790946115.657816:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 43 00000100:00100000:1.0:1790946115.657828:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4ced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+6:2402:x1877942616580352:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790946115.657872:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4ced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+6:2402:x1877942616580352:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 49us (4416us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946115.657878:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 43 00000100:00100000:1.0:1790946115.657891:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 44 00000100:00100000:1.0:1790946115.657897:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4cee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+5:2402:x1877942616579968:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790946115.657920:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4cee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+5:2402:x1877942616579968:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 24us (4402us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946115.657926:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 44 00000100:00100000:1.0:1790946115.657935:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 45 00000100:00100000:1.0:1790946115.657941:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4cee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+5:2402:x1877942616580480:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790946115.657963:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4cee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+5:2402:x1877942616580480:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 23us (4414us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946115.657969:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 45 00000100:00100000:1.0:1790946115.658032:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616579712 00000100:00100000:1.0:1790946115.658040:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616579712 00000100:00100000:1.0:1790946115.658082:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 144 00000100:00100000:1.0:1790946115.658089:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65e62bd4-414e-42c8-885a-5648a45a13a4+13:2402:x1877942616579712:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790946115.658140:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65e62bd4-414e-42c8-885a-5648a45a13a4+13:2402:x1877942616579712:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 42us (4628us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946115.658148:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 144 00000100:00100000:0.0:1790946115.658591:0:18667:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4cec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+5:2402:x1877942616580608:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 3225us (3751us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946115.658615:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 3 00000100:00080000:0.0:1790946115.659741:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790946115.659748:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790946115.659751:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790946115.659754:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790946115.664554:0:19563:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4ced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ca604fcf-845a-4ff8-977f-a1d27931fa85+5:2402:x1877942616580224:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 10206us (11007us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946115.664655:0:19563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4 00000100:00100000:3.0:1790946115.668360:0:19252:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4cef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+5:2402:x1877942616580736:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 12751us (14780us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946115.668375:0:19252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5 00010000:00010000:2.0:1790946115.873619:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946115.935434:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:87d8d138-d2ce-4761-a98a-4e847b9142bd:3647:1877942638676096:0@lo:400:kworker.0 00000100:00100000:0.0:1790946115.935534:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946115.935578:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84569880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638676608:0@lo:400:kworker.0 00000100:00100000:0.0:1790946115.935614:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946115.935630:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8456ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1877942638677120:0@lo:400:kworker.0 00000100:00100000:0.0:1790946115.935650:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946115.935671:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1790946115.935676:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638676224:0@lo:400:kworker.0 00000100:00100000:0.0:1790946115.935699:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946115.935713:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84568e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638676736:0@lo:400:kworker.0 00000100:00100000:0.0:1790946115.935748:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946115.935760:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84568380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1877942638677248:0@lo:400:kworker.0 00000100:00100000:0.0:1790946115.935779:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946115.935801:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8456bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638676480:0@lo:400:kworker.0 00000100:00100000:0.0:1790946115.935825:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946115.935841:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84569500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877942638676992:0@lo:400:kworker.0 00000100:00100000:0.0:1790946115.935858:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946115.935867:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84568700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1877942638677504:0@lo:400:kworker.0 00000100:00100000:0.0:1790946115.935883:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946115.935893:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1790946115.935898:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8456b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638676352:0@lo:400:kworker.0 00000100:00100000:0.0:1790946115.935917:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946115.935933:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8456b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638676864:0@lo:400:kworker.0 00000100:00100000:0.0:1790946115.935950:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946115.935974:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84569c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1877942638677376:0@lo:400:kworker.0 00000100:00100000:0.0:1790946115.935991:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946115.936014:0:18667:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638676480 00000100:00100000:0.0:1790946115.936026:0:18667:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638676480 00000100:00100000:3.0:1790946115.937228:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638677760:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790946115.937269:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946115.937297:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790946115.937303:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4ceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638677632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790946115.937321:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946115.937346:0:18670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638677760 00000100:00100000:3.0:1790946115.937363:0:18670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638677760 00000100:00100000:3.0:1790946115.937408:0:18670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638677632 00000100:00100000:3.0:1790946115.937411:0:18670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638677632 00000100:00100000:3.0:1790946115.937427:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790946115.937434:0:18670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638677760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790946115.937466:0:18670:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1790946115.937507:0:18670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638677760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946115.937810:0:18667:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638676352 00000100:00100000:0.0:1790946115.937815:0:18667:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638676352 00000100:00100000:0.0:1790946115.937831:0:18667:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638676864 00000100:00100000:0.0:1790946115.937833:0:18667:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638676864 00000100:00100000:0.0:1790946115.937846:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790946115.937853:0:18667:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84568000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638676480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946115.937894:0:18667:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84568000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638676480:12345-0@lo:400:kworker.0 Request processed in 42us (2068us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946115.937901:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790946115.937915:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790946115.937921:0:18667:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087239c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1877942638676352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946115.937949:0:18667:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087239c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1877942638676352:12345-0@lo:400:kworker.0 Request processed in 29us (2031us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946115.937955:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790946115.937967:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790946115.937972:0:18667:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087238a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3650:x1877942638676864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946115.937998:0:18667:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087238a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3650:x1877942638676864:12345-0@lo:400:kworker.0 Request processed in 27us (2046us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946115.938005:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790946115.938557:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790946115.938581:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790946115.938590:0:18670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638677632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790946115.938619:0:18670:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1790946115.938663:0:18670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638677632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (1341us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946115.938669:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790946115.938741:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4ceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638677632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790946115.938759:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638677760:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1790946115.939141:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790946115.939146:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790946115.939195:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8456b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638676352:0@lo:400:kworker.0 00000100:00100000:0.0:1790946115.939207:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8456b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638676864:0@lo:400:kworker.0 00000100:00100000:0.0:1790946115.939228:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8456bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638676480:0@lo:400:kworker.0 00000100:00100000:0.0:1790946115.939248:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790946115.939259:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4087239500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638677888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790946115.939297:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946115.940146:0:18670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638677888 00000100:00100000:3.0:1790946115.940156:0:18670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638677888 00000100:00100000:3.0:1790946115.940216:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790946115.940224:0:18670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408723b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638677888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790946115.940243:0:18670:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1790946115.940296:0:18670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408723b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638677888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946115.940303:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790946115.940680:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638676096 00000100:00100000:1.0:1790946115.940685:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638676096 00000100:00100000:1.0:1790946115.940718:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1790946115.940787:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4087239500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638677888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790946115.940838:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+24:3647:x1877942638676096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946115.940894:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+24:3647:x1877942638676096:12345-0@lo:400:kworker.0 Request processed in 57us (5370us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946115.940900:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1790946115.940931:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638676608 00000100:00100000:1.0:1790946115.940935:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638676608 00000100:00100000:1.0:1790946115.940956:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638677120 00000100:00100000:2.0:1790946115.940958:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:87d8d138-d2ce-4761-a98a-4e847b9142bd:3647:1877942638676096:0@lo:400:kworker.0 00000100:00100000:1.0:1790946115.940961:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638677120 00000100:00100000:1.0:1790946115.940996:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638677248 00000100:00100000:1.0:1790946115.941000:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638677248 00000100:00100000:1.0:1790946115.941013:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638676992 00000100:00100000:1.0:1790946115.941015:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638676992 00000100:00100000:1.0:1790946115.941025:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638677504 00000100:00100000:1.0:1790946115.941027:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638677504 00000100:00100000:0.0:1790946115.941151:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790946115.941163:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d408723a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638678016:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790946115.941219:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790946115.941608:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790946115.941612:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790946115.941867:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638677376 00000100:00100000:1.0:1790946115.941873:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638677376 00000100:00080000:3.0:1790946115.942543:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790946115.942550:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790946115.943751:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790946115.943767:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8456aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638676608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946115.943848:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8456aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638676608:12345-0@lo:400:kworker.0 Request processed in 86us (8232us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946115.943856:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790946115.943879:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790946115.943887:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1877942638677120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946115.943921:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1877942638677120:12345-0@lo:400:kworker.0 Request processed in 36us (8270us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946115.943927:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790946115.943939:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790946115.943945:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8456a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1877942638677248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946115.943958:0:17149:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1790946115.943965:0:17149:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1790946115.943970:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8456a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1877942638677248:12345-0@lo:400:kworker.0 Request processed in 26us (8191us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946115.943989:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790946115.944001:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790946115.944006:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8456a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877942638676992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946115.944215:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4cec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638678144:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790946115.944254:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1790946115.944287:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f84568380 x1877942638677248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946115.944300:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84568380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1877942638677248:0@lo:400:kworker.0 00000100:00100000:0.0:1790946115.944313:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84569880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638676608:0@lo:400:kworker.0 00000100:00100000:0.0:1790946115.944323:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8456ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1877942638677120:0@lo:400:kworker.0 00000100:00100000:2.0:1790946115.944832:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8456a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877942638676992:12345-0@lo:400:kworker.0 Request processed in 823us (8969us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946115.944840:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790946115.944856:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790946115.944863:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877942638677504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946115.944894:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877942638677504:12345-0@lo:400:kworker.0 Request processed in 33us (9010us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946115.944899:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790946115.944908:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790946115.944913:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408723a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877942638677376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946115.944935:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408723a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877942638677376:12345-0@lo:400:kworker.0 Request processed in 23us (8943us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946115.944940:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790946115.944954:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638676224 00000100:00100000:2.0:1790946115.944960:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638676224 00000100:00100000:2.0:1790946115.944979:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638676736 00000100:00100000:2.0:1790946115.944981:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638676736 00000100:00100000:2.0:1790946115.944991:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638678016 00000100:00100000:2.0:1790946115.944993:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638678016 00000100:00100000:2.0:1790946115.945000:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638678144 00000100:00100000:2.0:1790946115.945002:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638678144 00000100:00100000:2.0:1790946115.945009:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790946115.945014:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1877942638676224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946115.945675:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1877942638676224:12345-0@lo:400:kworker.0 Request processed in 658us (9973us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946115.945683:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790946115.945700:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790946115.945707:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8456b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1877942638676736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946115.945925:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638676224:0@lo:400:kworker.0 00000100:00100000:2.0:1790946115.946026:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8456b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1877942638676736:12345-0@lo:400:kworker.0 Request processed in 319us (10277us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946115.946112:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84568e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638676736:0@lo:400:kworker.0 00000100:00100000:2.0:1790946115.946149:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790946115.946161:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790946115.946188:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087238e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638678016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790946115.946215:0:17152:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790946115.946254:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087238e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638678016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (5035us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946115.946260:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790946115.946273:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790946115.946279:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087239180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638678144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790946115.946296:0:17152:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1790946115.946337:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087239180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638678144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (2083us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946115.946343:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790946115.946398:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84569c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1877942638677376:0@lo:400:kworker.0 00000100:00100000:2.0:1790946115.946410:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84569500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877942638676992:0@lo:400:kworker.0 00010000:00080000:2.0:1790946115.946424:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f84568700 x1877942638677504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946115.946447:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84568700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1877942638677504:0@lo:400:kworker.0 00000100:00100000:0.0:1790946115.946575:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d408723a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638678016:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790946115.946678:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4cec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638678144:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1790946116.384052:0:17181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790946116.896429:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790946116.973147:0:20186:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeda5c6190 20000000:00000080:1.0:1790946116.973164:0:20186:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d40baaab800 uarg=0000000000000000 20000000:01000000:1.0:1790946116.973314:0:20186:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1790946116.973320:0:20186:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1790946116.973325:0:20186:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1790946116.974004:0:20187:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1790946116.974164:0:20186:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1790946116.982611:0:20186:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1790946116.982743:0:20186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d4080031400/0xd9f4181e0d27e7bf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946116.982763:0:20186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40baef0c00/0xd9f4181e0d27e454 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27e44d expref: 23 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946116.982787:0:20186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40bcbe0000/0xd9f4181e0d27e462 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27e45b expref: 23 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946116.982793:0:20186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d4092afd800/0xd9f4181e0d27e4a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27e49a expref: 23 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946116.982800:0:20186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d4092afc000/0xd9f4181e0d27e53b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27e534 expref: 23 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946116.982810:0:20186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27e74f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330f03 expref: 12 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946116.982817:0:20186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40c21d6000/0xd9f4181e0d27e78e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330f73 expref: 12 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946116.982825:0:20186:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d4080031400/0xd9f4181e0d27e7bf lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946116.982869:0:20186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40c21d6000/0xd9f4181e0d27e78e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330f73 expref: 12 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946116.982884:0:20186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40c21d6000/0xd9f4181e0d27e78e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330f73 expref: 12 pid: 17141 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946116.982941:0:20186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d408723a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20186:1877942638678272:192.168.204.20@tcp:104: 00010000:00010000:0.0:1790946116.983078:0:20186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27e74f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330f03 expref: 12 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946116.983087:0:20186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27e74f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330f03 expref: 12 pid: 17141 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946116.983103:0:20186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4087238700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20186:1877942638678400:192.168.204.20@tcp:104: 00010000:00010000:0.0:1790946116.983137:0:20186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d4092afc000/0xd9f4181e0d27e53b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27e534 expref: 23 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946116.983144:0:20186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d4092afc000/0xd9f4181e0d27e53b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27e534 expref: 23 pid: 17141 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946116.983152:0:20186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d408723bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20186:1877942638678528:0@lo:104: 00000100:00100000:0.0:1790946116.983227:0:20186:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790946116.983267:0:20186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d4092afd800/0xd9f4181e0d27e4a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27e49a expref: 23 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946116.983274:0:20186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d4092afd800/0xd9f4181e0d27e4a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27e49a expref: 23 pid: 17141 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946116.983281:0:20186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4087239f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20186:1877942638678656:0@lo:104: 00000100:00100000:0.0:1790946116.983301:0:20186:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790946116.983327:0:20186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40bcbe0000/0xd9f4181e0d27e462 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27e45b expref: 23 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946116.983334:0:20186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40bcbe0000/0xd9f4181e0d27e462 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27e45b expref: 23 pid: 17140 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946116.983342:0:20186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4087238000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20186:1877942638678784:0@lo:104: 00000100:00100000:0.0:1790946116.983362:0:20186:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790946116.983378:0:20186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40baef0c00/0xd9f4181e0d27e454 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27e44d expref: 23 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946116.983408:0:20186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40baef0c00/0xd9f4181e0d27e454 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27e44d expref: 23 pid: 17141 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946116.983416:0:20186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d408723b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20186:1877942638678912:0@lo:104: 00000100:00100000:0.0:1790946116.983438:0:20186:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946116.983448:0:20186:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d409016c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790946116.983597:0:17130:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638678528 00000100:00100000:3.0:1790946116.983606:0:17130:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638678528 00000100:00100000:3.0:1790946116.983648:0:17130:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638678656 00000100:00100000:3.0:1790946116.983651:0:17130:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638678656 00000100:00100000:3.0:1790946116.983660:0:17130:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638678784 00000100:00100000:3.0:1790946116.983662:0:17130:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638678784 00000100:00100000:3.0:1790946116.983671:0:17130:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638678912 00000100:00100000:3.0:1790946116.983673:0:17130:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638678912 00000100:00100000:3.0:1790946116.983684:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790946116.983692:0:17130:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408723b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:87d8d138-d2ce-4761-a98a-4e847b9142bd+6:20186:x1877942638678528:12345-0@lo:104: 00010000:00010000:3.0:1790946116.983704:0:17130:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64800/0xd9f4181e0d27e534 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27e53b expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.983765:0:17130:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790946116.983771:0:17130:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408723b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:87d8d138-d2ce-4761-a98a-4e847b9142bd+6:20186:x1877942638678528:12345-0@lo:104: Request processed in 80us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946116.983777:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790946116.983795:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790946116.983801:0:17130:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087239880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:87d8d138-d2ce-4761-a98a-4e847b9142bd+5:20186:x1877942638678656:12345-0@lo:104: 00010000:00010000:3.0:1790946116.983808:0:17130:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe1c00/0xd9f4181e0d27e49a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27e4a1 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.983840:0:17130:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790946116.983844:0:17130:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087239880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:87d8d138-d2ce-4761-a98a-4e847b9142bd+5:20186:x1877942638678656:12345-0@lo:104: Request processed in 44us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946116.983851:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790946116.983863:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790946116.983869:0:17130:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087238380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:87d8d138-d2ce-4761-a98a-4e847b9142bd+4:20186:x1877942638678784:12345-0@lo:104: 00010000:00010000:3.0:1790946116.983884:0:17130:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d40baef0600/0xd9f4181e0d27e45b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27e462 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.983930:0:17130:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1790946116.983935:0:17130:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087238380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:87d8d138-d2ce-4761-a98a-4e847b9142bd+4:20186:x1877942638678784:12345-0@lo:104: Request processed in 67us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946116.983940:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790946116.983952:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790946116.983957:0:17130:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408723ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:87d8d138-d2ce-4761-a98a-4e847b9142bd+3:20186:x1877942638678912:12345-0@lo:104: 00010000:00010000:3.0:1790946116.983964:0:17130:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe0200/0xd9f4181e0d27e44d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27e454 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.984007:0:17130:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1790946116.984011:0:17130:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408723ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:87d8d138-d2ce-4761-a98a-4e847b9142bd+3:20186:x1877942638678912:12345-0@lo:104: Request processed in 55us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946116.984016:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1790946116.984034:0:18315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1790946116.984039:0:18315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64800/0xd9f4181e0d27e534 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27e53b expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.984046:0:18315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c64800 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:3.0:1790946116.984050:0:18315:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64800/0xd9f4181e0d27e534 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27e53b expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.984059:0:18315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64800/0xd9f4181e0d27e534 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27e53b expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790946116.984065:0:18315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64800/0xd9f4181e0d27e534 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27e53b expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946116.984077:0:18315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790946116.984105:0:18315:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64800/0xd9f4181e0d27e534 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27e53b expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.984111:0:18315:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790946116.984129:0:18315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64800/0xd9f4181e0d27e534 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27e53b expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.984137:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64800/0xd9f4181e0d27e534 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27e53b expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.984149:0:18315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1790946116.984152:0:18315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe1c00/0xd9f4181e0d27e49a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27e4a1 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.984157:0:18315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe1c00 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:3.0:1790946116.984160:0:18315:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe1c00/0xd9f4181e0d27e49a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27e4a1 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.984188:0:18315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe1c00/0xd9f4181e0d27e49a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27e4a1 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790946116.984195:0:18315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe1c00/0xd9f4181e0d27e49a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27e4a1 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946116.984199:0:18315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790946116.984211:0:18315:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe1c00/0xd9f4181e0d27e49a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27e4a1 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.984216:0:18315:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790946116.984253:0:18315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe1c00/0xd9f4181e0d27e49a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27e4a1 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.984260:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe1c00/0xd9f4181e0d27e49a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27e4a1 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.984269:0:18315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790946116.984272:0:18315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40baef0600/0xd9f4181e0d27e45b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27e462 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.984278:0:18315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef0600 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:3.0:1790946116.984280:0:18315:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40baef0600/0xd9f4181e0d27e45b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27e462 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.984286:0:18315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40baef0600/0xd9f4181e0d27e45b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27e462 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790946116.984292:0:18315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40baef0600/0xd9f4181e0d27e45b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27e462 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946116.984296:0:18315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790946116.984309:0:18315:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40baef0600/0xd9f4181e0d27e45b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27e462 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.984315:0:18315:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790946116.984320:0:18315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40baef0600/0xd9f4181e0d27e45b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27e462 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.984327:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40baef0600/0xd9f4181e0d27e45b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27e462 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.984347:0:18315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790946116.984349:0:18315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe0200/0xd9f4181e0d27e44d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27e454 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.984355:0:18315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0200 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:3.0:1790946116.984358:0:18315:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe0200/0xd9f4181e0d27e44d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27e454 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.984365:0:18315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe0200/0xd9f4181e0d27e44d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27e454 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790946116.984371:0:18315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe0200/0xd9f4181e0d27e44d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27e454 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946116.984378:0:18315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790946116.984461:0:18315:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe0200/0xd9f4181e0d27e44d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27e454 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.984467:0:18315:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790946116.984474:0:18315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe0200/0xd9f4181e0d27e44d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27e454 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.984481:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe0200/0xd9f4181e0d27e44d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27e454 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.984494:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946116.984496:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946116.984497:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946116.984612:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:87d8d138-d2ce-4761-a98a-4e847b9142bd:3648:1877942638679040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790946116.984651:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946116.984683:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790946116.984689:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:87d8d138-d2ce-4761-a98a-4e847b9142bd:3648:1877942638679424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790946116.984710:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946116.984737:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:87d8d138-d2ce-4761-a98a-4e847b9142bd:3649:1877942638679168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790946116.984758:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946116.984773:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790946116.984778:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:87d8d138-d2ce-4761-a98a-4e847b9142bd:3649:1877942638679296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790946116.984797:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946116.984817:0:17132:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638679040 00000100:00100000:3.0:1790946116.984822:0:17132:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638679040 00010000:00010000:3.0:1790946116.984843:0:17132:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d4092afc000/0xd9f4181e0d27e53b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27e534 expref: 24 pid: 17141 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946116.984859:0:17132:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638679424 00000100:00100000:3.0:1790946116.984862:0:17132:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638679424 00010000:00010000:3.0:1790946116.984873:0:17132:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40baef0c00/0xd9f4181e0d27e454 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27e44d expref: 25 pid: 17141 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946116.984899:0:17132:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638679168 00000100:00100000:3.0:1790946116.984903:0:17132:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638679168 00010000:00010000:3.0:1790946116.984915:0:17132:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d4092afd800/0xd9f4181e0d27e4a1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27e49a expref: 26 pid: 17141 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946116.984925:0:17132:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638679296 00000100:00100000:3.0:1790946116.984926:0:17132:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638679296 00010000:00010000:3.0:1790946116.984934:0:17132:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40bcbe0000/0xd9f4181e0d27e462 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27e45b expref: 27 pid: 17140 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946116.984946:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790946116.984959:0:17132:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87d8d138-d2ce-4761-a98a-4e847b9142bd+27:3648:x1877942638679040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790946116.984971:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946116.984976:0:17132:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d4092afc000/0xd9f4181e0d27e53b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27e534 expref: 27 pid: 17141 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.984985:0:17132:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d4092afc000/0xd9f4181e0d27e53b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27e534 expref: 27 pid: 17141 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.984998:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790946116.985025:0:17132:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87d8d138-d2ce-4761-a98a-4e847b9142bd+27:3648:x1877942638679040:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946116.985032:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790946116.985046:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790946116.985051:0:17132:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87d8d138-d2ce-4761-a98a-4e847b9142bd+26:3648:x1877942638679424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790946116.985072:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946116.985076:0:17132:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40baef0c00/0xd9f4181e0d27e454 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27e44d expref: 26 pid: 17141 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.985083:0:17132:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40baef0c00/0xd9f4181e0d27e454 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27e44d expref: 26 pid: 17141 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.985093:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790946116.985095:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946116.985105:0:17134:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1790946116.985112:0:17134:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1790946116.985113:0:17132:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87d8d138-d2ce-4761-a98a-4e847b9142bd+26:3648:x1877942638679424:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946116.985119:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790946116.985131:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790946116.985137:0:17132:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87d8d138-d2ce-4761-a98a-4e847b9142bd+25:3649:x1877942638679168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790946116.985144:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946116.985153:0:17132:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d4092afd800/0xd9f4181e0d27e4a1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27e49a expref: 25 pid: 17141 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.985160:0:17132:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d4092afd800/0xd9f4181e0d27e4a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27e49a expref: 25 pid: 17141 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.985185:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790946116.985212:0:17132:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87d8d138-d2ce-4761-a98a-4e847b9142bd+25:3649:x1877942638679168:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946116.985219:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790946116.985231:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790946116.985237:0:17132:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87d8d138-d2ce-4761-a98a-4e847b9142bd+24:3649:x1877942638679296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790946116.985244:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946116.985248:0:17132:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40bcbe0000/0xd9f4181e0d27e462 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27e45b expref: 24 pid: 17140 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.985254:0:17132:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40bcbe0000/0xd9f4181e0d27e462 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27e45b expref: 24 pid: 17140 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.985262:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790946116.985281:0:17132:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87d8d138-d2ce-4761-a98a-4e847b9142bd+24:3649:x1877942638679296:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946116.985286:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790946116.985323:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:87d8d138-d2ce-4761-a98a-4e847b9142bd:3649:1877942638679296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790946116.985333:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:87d8d138-d2ce-4761-a98a-4e847b9142bd:3649:1877942638679168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790946116.985357:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:87d8d138-d2ce-4761-a98a-4e847b9142bd:3648:1877942638679424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790946116.985363:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:87d8d138-d2ce-4761-a98a-4e847b9142bd:3648:1877942638679040:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790946116.985860:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946116.986116:0:20186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d4092afc000/0xd9f4181e0d27e53b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27e534 expref: 23 pid: 17141 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946116.986128:0:20186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d408723bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20186:1877942638678528:0@lo:104: 00010000:00010000:0.0:1790946116.986138:0:20186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d4092afd800/0xd9f4181e0d27e4a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27e49a expref: 22 pid: 17141 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946116.986146:0:20186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4087239f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20186:1877942638678656:0@lo:104: 00010000:00010000:0.0:1790946116.986155:0:20186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40bcbe0000/0xd9f4181e0d27e462 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27e45b expref: 21 pid: 17140 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946116.986162:0:20186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4087238000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20186:1877942638678784:0@lo:104: 00010000:00010000:0.0:1790946116.986193:0:20186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40baef0c00/0xd9f4181e0d27e454 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27e44d expref: 20 pid: 17141 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946116.986201:0:20186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d408723b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20186:1877942638678912:0@lo:104: 00000100:00100000:2.0:1790946116.991418:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946116.991507:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946116.991596:0:20186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d408723a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20186:1877942638678272:192.168.204.20@tcp:104: 00000100:00100000:0.0:1790946116.991609:0:20186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4087238700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20186:1877942638678400:192.168.204.20@tcp:104: 00010000:00010000:0.0:1790946116.991650:0:20186:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d4080031400/0xd9f4181e0d27e7bf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946116.992650:0:17132:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616580864 00000100:00100000:3.0:1790946116.992661:0:17132:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616580864 00010000:00010000:3.0:1790946116.992711:0:17132:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40c21d6000/0xd9f4181e0d27e78e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330f73 expref: 13 pid: 17141 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946116.992750:0:17132:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616580992 00000100:00100000:3.0:1790946116.992753:0:17132:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616580992 00010000:00010000:3.0:1790946116.992767:0:17132:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27e74f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330f03 expref: 14 pid: 17141 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946116.992794:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:3.0:1790946116.992803:0:17132:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83d43450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65e62bd4-414e-42c8-885a-5648a45a13a4+14:2404:x1877942616580864:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790946116.992818:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946116.992824:0:17132:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40c21d6000/0xd9f4181e0d27e78e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330f73 expref: 14 pid: 17141 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.992835:0:17132:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40c21d6000/0xd9f4181e0d27e78e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330f73 expref: 14 pid: 17141 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.992852:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40c21d6000/0xd9f4181e0d27e78e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330f73 expref: 14 pid: 17141 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.992865:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790946116.992915:0:17132:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83d43450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65e62bd4-414e-42c8-885a-5648a45a13a4+13:2404:x1877942616580864:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 113us (1508us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946116.992923:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:3.0:1790946116.992969:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 14 00000100:00100000:3.0:1790946116.992976:0:17132:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4cece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65e62bd4-414e-42c8-885a-5648a45a13a4+12:2404:x1877942616580992:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790946116.992996:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946116.993001:0:17132:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27e74f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330f03 expref: 12 pid: 17141 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.993009:0:17132:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27e74f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330f03 expref: 12 pid: 17141 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.993018:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27e74f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330f03 expref: 12 pid: 17141 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.993028:0:17132:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d4080031400/0xd9f4181e0d27e7bf lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.993036:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d4080031400/0xd9f4181e0d27e7bf lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.993051:0:17132:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d4080031400/0xd9f4181e0d27e7bf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.993058:0:17132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d4080031400/0xd9f4181e0d27e7bf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.993065:0:17132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d4080031400/0xd9f4181e0d27e7bf lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.993072:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d4080031400/0xd9f4181e0d27e7bf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.993078:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080031400 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:3.0:1790946116.993083:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d4080031400/0xd9f4181e0d27e7bf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.993101:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d4080031400/0xd9f4181e0d27e7bf lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.993117:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d4080031400/0xd9f4181e0d27e7bf lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946116.993126:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790946116.993146:0:17132:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4cece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65e62bd4-414e-42c8-885a-5648a45a13a4+11:2404:x1877942616580992:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 171us (1639us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946116.993153:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 14 00010000:00010000:0.0:1790946116.993672:0:20186:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d4080031400/0xd9f4181e0d27e7bf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946116.993684:0:20186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d4080031400/0xd9f4181e0d27e7bf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946116.993692:0:20186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d4080031400/0xd9f4181e0d27e7bf lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946117.920021:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946118.020847:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946118.020935:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616581120 00000100:00100000:3.0:1790946118.020947:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616581120 00000100:00100000:3.0:1790946118.021005:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 146 00000100:00100000:3.0:1790946118.021015:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65e62bd4-414e-42c8-885a-5648a45a13a4+11:14885:x1877942616581120:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790946118.021033:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946118.021065:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40baef1c00/0xd9f4181e0d27e7c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330fab expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946118.021096:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40baef1c00/0xd9f4181e0d27e7c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330fab expref: 12 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946118.021109:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40baef1c00/0xd9f4181e0d27e7c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330fab expref: 12 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946118.021118:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40baef1c00, rc 0) 00000100:00100000:3.0:1790946118.021210:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65e62bd4-414e-42c8-885a-5648a45a13a4+12:14885:x1877942616581120:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 196us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946118.021229:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 146 00000100:00100000:2.0:1790946118.031057:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946118.031787:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616581248 00000100:00100000:3.0:1790946118.031800:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616581248 00000100:00100000:3.0:1790946118.031859:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 147 00000100:00100000:3.0:1790946118.031869:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408482c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65e62bd4-414e-42c8-885a-5648a45a13a4+12:14885:x1877942616581248:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790946118.035381:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408482c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65e62bd4-414e-42c8-885a-5648a45a13a4+12:14885:x1877942616581248:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 3500us (4319us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946118.035400:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 147 00000100:00100000:1.0:1790946118.043603:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946118.049448:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616581376 00000100:00100000:3.0:1790946118.049464:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616581376 00000100:00100000:3.0:1790946118.049585:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 148 00000100:00100000:3.0:1790946118.049595:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65e62bd4-414e-42c8-885a-5648a45a13a4+12:14885:x1877942616581376:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790946118.049759:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65e62bd4-414e-42c8-885a-5648a45a13a4+12:14885:x1877942616581376:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 Request processed in 165us (6166us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946118.049768:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 148 00000100:00100000:0.0:1790946118.074284:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946118.074366:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616581504 00000100:00100000:3.0:1790946118.074377:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616581504 00000100:00100000:3.0:1790946118.074490:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 149 00000100:00100000:3.0:1790946118.074502:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65e62bd4-414e-42c8-885a-5648a45a13a4+12:14885:x1877942616581504:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790946118.074520:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946118.074539:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40baef0600/0xd9f4181e0d27e7cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330fb2 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946118.074578:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40baef0600/0xd9f4181e0d27e7cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330fb2 expref: 13 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946118.074604:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40baef0600/0xd9f4181e0d27e7cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330fb2 expref: 13 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946118.074613:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40baef0600, rc 0) 00000100:00100000:3.0:1790946118.074672:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65e62bd4-414e-42c8-885a-5648a45a13a4+13:14885:x1877942616581504:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 172us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946118.074679:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 149 00000100:00100000:1.0:1790946118.082900:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946118.082972:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616581632 00000100:00100000:3.0:1790946118.082985:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616581632 00000100:00100000:3.0:1790946118.083041:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 150 00000100:00100000:3.0:1790946118.083066:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65e62bd4-414e-42c8-885a-5648a45a13a4+13:14885:x1877942616581632:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790946118.083264:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65e62bd4-414e-42c8-885a-5648a45a13a4+13:14885:x1877942616581632:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 212us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946118.083273:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 150 00000100:00100000:0.0:1790946118.093708:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946118.095295:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616581760 00000100:00100000:2.0:1790946118.095313:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616581760 00000100:00100000:2.0:1790946118.095375:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 151 00000100:00100000:2.0:1790946118.095385:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65e62bd4-414e-42c8-885a-5648a45a13a4+13:14885:x1877942616581760:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790946118.095545:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65e62bd4-414e-42c8-885a-5648a45a13a4+13:14885:x1877942616581760:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 Request processed in 160us (1846us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946118.095565:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 151 10000000:01000000:2.0:1790946118.434987:0:17144:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790946118.434996:0:17144:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d40bff17000 from 13 10000000:01000000:2.0:1790946118.435002:0:17144:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790946118.435055:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6e00/0xd9f4181e0d27e7d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946118.435068:0:17144:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6e00/0xd9f4181e0d27e7d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946118.435081:0:17144:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6e00/0xd9f4181e0d27e7d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946118.435109:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4ceed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638679552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790946118.435212:0:17144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946118.435270:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f83421f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790946118.435490:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638679552 00000100:00100000:1.0:1790946118.435499:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638679552 00000100:00100000:1.0:1790946118.435575:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1790946118.435585:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+20:17144:x1877942638679552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790946118.435599:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946118.435616:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40bcbe0400/0xd9f4181e0d27e7db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27e7d4 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946118.435640:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40bcbe0400/0xd9f4181e0d27e7db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27e7d4 expref: 21 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946118.435650:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40bcbe0400/0xd9f4181e0d27e7db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27e7d4 expref: 21 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946118.435658:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe0400, rc 0) 00000100:00100000:1.0:1790946118.435717:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+21:17144:x1877942638679552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946118.435723:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1790946118.435867:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4ceed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638679552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790946118.435883:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6e00/0xd9f4181e0d27e7d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e7db expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946118.435891:0:17144:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6e00/0xd9f4181e0d27e7d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e7db expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946118.435960:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4087238700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638679680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790946118.435990:0:17144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946118.436020:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bacc5600 going to sleep for 11 seconds 00000100:00100000:2.0:1790946118.436074:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638679680 00000100:00100000:2.0:1790946118.436079:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638679680 00000100:00100000:2.0:1790946118.436113:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1790946118.436120:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+21:17144:x1877942638679680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790946118.436264:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+21:17144:x1877942638679680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 143us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946118.436272:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1790946118.436301:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4087238700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638679680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790946118.436332:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4cedf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638679808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790946118.436379:0:17144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946118.436393:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f834216c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790946118.436405:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638679808 00000100:00100000:2.0:1790946118.436409:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638679808 00000100:00100000:2.0:1790946118.436425:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1790946118.436431:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+21:17144:x1877942638679808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790946118.436502:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+21:17144:x1877942638679808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946118.436508:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1790946118.436679:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4cedf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638679808:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790946118.437988:0:20255:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1790946118.442309:0:17144:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1790946118.442350:0:17144:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790946118.442362:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6e00/0xd9f4181e0d27e7d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e7db expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946118.442375:0:17144:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6e00/0xd9f4181e0d27e7d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e7db expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790946118.442404:0:17144:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790946118.442407:0:17144:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d4099fbe800 from 13 10000000:01000000:0.0:1790946118.442410:0:17144:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790946118.442447:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4080031800/0xd9f4181e0d27e7e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946118.442455:0:17144:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d4080031800/0xd9f4181e0d27e7e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946118.442466:0:17144:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d4080031800/0xd9f4181e0d27e7e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946118.442491:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d408723a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638679936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790946118.442647:0:17144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946118.442734:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bacc5600 going to sleep for 11 seconds 00000100:00100000:1.0:1790946118.444647:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638679936 00000100:00100000:1.0:1790946118.444663:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638679936 00000100:00100000:1.0:1790946118.444774:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1790946118.444785:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+21:17144:x1877942638679936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790946118.444816:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946118.444836:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40bcbe0600/0xd9f4181e0d27e7e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27e7e2 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946118.444864:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40bcbe0600/0xd9f4181e0d27e7e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27e7e2 expref: 22 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946118.444875:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40bcbe0600/0xd9f4181e0d27e7e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27e7e2 expref: 22 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946118.444884:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe0600, rc 0) 00000100:00100000:1.0:1790946118.444962:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+22:17144:x1877942638679936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (2315us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946118.444969:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1790946118.445060:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d408723a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638679936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790946118.445078:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d4080031800/0xd9f4181e0d27e7e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e7e9 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946118.445087:0:17144:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d4080031800/0xd9f4181e0d27e7e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e7e9 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946118.445158:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d408723a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638680064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790946118.445209:0:17144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946118.449448:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bacc5600 going to sleep for 11 seconds 00000100:00100000:2.0:1790946118.452720:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638680064 00000100:00100000:2.0:1790946118.452738:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638680064 00000100:00100000:2.0:1790946118.452798:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1790946118.452810:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+22:17144:x1877942638680064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790946118.453012:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+22:17144:x1877942638680064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 204us (7802us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946118.453035:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1790946118.453956:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d408723a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638680064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790946118.454014:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d408723a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638680192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790946118.454081:0:17144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946118.454107:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bacc5600 going to sleep for 11 seconds 00000100:00100000:2.0:1790946118.455885:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638680192 00000100:00100000:2.0:1790946118.455902:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638680192 00000100:00100000:2.0:1790946118.455960:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1790946118.455970:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+22:17144:x1877942638680192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790946118.456127:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+22:17144:x1877942638680192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (2045us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946118.456135:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1790946118.456223:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d408723a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638680192:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790946118.461477:0:20256:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1790946118.462028:0:17144:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1790946118.462055:0:17144:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790946118.462066:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4080031800/0xd9f4181e0d27e7e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e7e9 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946118.462079:0:17144:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d4080031800/0xd9f4181e0d27e7e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e7e9 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790946118.462093:0:17144:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790946118.462095:0:17144:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d40871f9800 from 13 10000000:01000000:0.0:1790946118.462097:0:17144:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790946118.462142:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4080031400/0xd9f4181e0d27e7f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946118.462149:0:17144:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d4080031400/0xd9f4181e0d27e7f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946118.462160:0:17144:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d4080031400/0xd9f4181e0d27e7f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946118.462210:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d408723b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638680320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790946118.462285:0:17144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946118.462328:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f82612240 going to sleep for 11 seconds 00000100:00100000:3.0:1790946118.462352:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638680320 00000100:00100000:3.0:1790946118.462359:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638680320 00000100:00100000:3.0:1790946118.462418:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1790946118.462428:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+22:17144:x1877942638680320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790946118.462442:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946118.462455:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40baef0a00/0xd9f4181e0d27e7f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27e7f0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946118.462479:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40baef0a00/0xd9f4181e0d27e7f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27e7f0 expref: 23 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946118.462490:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40baef0a00/0xd9f4181e0d27e7f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27e7f0 expref: 23 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946118.462527:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40baef0a00, rc 0) 00000100:00100000:3.0:1790946118.462588:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+23:17144:x1877942638680320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946118.462594:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1790946118.463531:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d408723b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638680320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790946118.463562:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d4080031400/0xd9f4181e0d27e7f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e7f7 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946118.463573:0:17144:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d4080031400/0xd9f4181e0d27e7f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e7f7 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946118.463645:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4cedf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638680448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790946118.463691:0:17144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946118.463718:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f834216c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790946118.463876:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638680448 00000100:00100000:0.0:1790946118.463883:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638680448 00000100:00100000:0.0:1790946118.463919:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1790946118.463928:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+23:17144:x1877942638680448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790946118.464072:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+23:17144:x1877942638680448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 144us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946118.464093:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1790946118.464935:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4cedf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638680448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790946118.464978:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4cedf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638680576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790946118.465026:0:17144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946118.465067:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f834216c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790946118.465387:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638680576 00000100:00100000:0.0:1790946118.465395:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638680576 00000100:00100000:0.0:1790946118.465533:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1790946118.465553:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+23:17144:x1877942638680576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790946118.465671:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+23:17144:x1877942638680576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946118.465679:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1790946118.465750:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4cedf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638680576:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790946118.466715:0:20257:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1790946118.466950:0:17144:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1790946118.466973:0:17144:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790946118.466986:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4080031400/0xd9f4181e0d27e7f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e7f7 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946118.466997:0:17144:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d4080031400/0xd9f4181e0d27e7f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e7f7 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946118.467007:0:17144:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790946118.467010:0:17144:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d3f81bb7000 from 13 10000000:01000000:3.0:1790946118.467013:0:17144:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790946118.467044:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27e7fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946118.467052:0:17144:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27e7fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946118.467061:0:17144:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27e7fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946118.467080:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638680704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790946118.467129:0:17144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946118.468299:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f83f7ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1790946118.468740:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638680704 00000100:00100000:1.0:1790946118.468750:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638680704 00000100:00100000:1.0:1790946118.468803:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1790946118.468811:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+23:17144:x1877942638680704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790946118.468825:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946118.468843:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40bcbe1000/0xd9f4181e0d27e805 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27e7fe expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946118.468872:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40bcbe1000/0xd9f4181e0d27e805 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27e7fe expref: 24 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946118.468883:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40bcbe1000/0xd9f4181e0d27e805 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27e7fe expref: 24 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946118.468892:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe1000, rc 0) 00000100:00100000:1.0:1790946118.468979:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+24:17144:x1877942638680704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (1849us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946118.468986:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1790946118.469420:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638680704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790946118.469451:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27e7fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e805 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946118.469462:0:17144:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27e7fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e805 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946118.469576:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638680832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790946118.469620:0:17144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946118.469655:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f83f7ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1790946118.469918:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638680832 00000100:00100000:1.0:1790946118.469924:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638680832 00000100:00100000:1.0:1790946118.469945:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1790946118.469952:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+24:17144:x1877942638680832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790946118.470086:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+24:17144:x1877942638680832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946118.470094:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1790946118.470349:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638680832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790946118.470381:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638680960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790946118.470425:0:17144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946118.470459:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f83f7ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1790946118.470713:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638680960 00000100:00100000:1.0:1790946118.470719:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638680960 00000100:00100000:1.0:1790946118.470797:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1790946118.470805:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40ac277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+24:17144:x1877942638680960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790946118.470900:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40ac277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+24:17144:x1877942638680960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946118.470908:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1790946118.470982:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87d8d138-d2ce-4761-a98a-4e847b9142bd:17144:1877942638680960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790946118.471822:0:20258:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1790946118.471892:0:17144:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1790946118.471909:0:17144:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790946118.471919:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27e7fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e805 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946118.471930:0:17144:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27e7fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e805 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946118.943749:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946119.967508:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946120.543584:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790946120.543609:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d4087238000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638681088:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790946120.543690:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946120.543803:0:18670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638681088 00000100:00100000:2.0:1790946120.543812:0:18670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638681088 00000100:00100000:2.0:1790946120.543879:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790946120.543890:0:18670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638681088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790946120.543937:0:18670:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1790946120.543988:0:18670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638681088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946120.543995:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790946120.544266:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d4087238000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638681088:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1790946120.544337:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790946120.558512:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946120.558604:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616581888 00000100:00100000:1.0:1790946120.558616:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616581888 00000100:00100000:1.0:1790946120.558697:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 23 00000100:00100000:1.0:1790946120.558708:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087239f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca604fcf-845a-4ff8-977f-a1d27931fa85+6:15553:x1877942616581888:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790946120.558729:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946120.558767:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27e80c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330fb9 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946120.558852:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27e813 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946120.558867:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27e813 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946120.558880:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27e813 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946120.558894:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27e81a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946120.558901:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27e81a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946120.558908:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27e81a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946120.558997:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27e821 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946120.559007:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27e821 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946120.559014:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27e821 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790946120.559045:0:17147:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1790946120.559049:0:17147:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790946120.559085:0:17147:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27e821 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946120.559104:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27e813 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946120.559111:0:17147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27e813 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946120.559118:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27e813 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946120.559123:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0200 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:1.0:1790946120.559127:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27e813 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946120.559135:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27e813 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946120.559147:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d40bc9afc00) 00010000:00010000:1.0:1790946120.559150:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946120.559155:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27e813 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946120.559161:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27e813 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946120.559210:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27e81a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946120.559216:0:17147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27e81a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946120.559222:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27e81a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946120.559233:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe0000 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:1.0:1790946120.559237:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27e81a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946120.559242:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27e81a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946120.559250:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9d4096cfda00) 00010000:00010000:1.0:1790946120.559253:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946120.559256:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27e81a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946120.559261:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27e81a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946120.559295:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27e80c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330fb9 expref: 8 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946120.559309:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27e821 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330fb9 expref: 7 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946120.559316:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d4096cfdf00) 00010000:00010000:1.0:1790946120.559318:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790946120.559320:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe0a00, rc 0) 00000100:00100000:1.0:1790946120.559379:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087239f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca604fcf-845a-4ff8-977f-a1d27931fa85+7:15553:x1877942616581888:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 673us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946120.559386:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 23 00000100:00080000:0.0:1790946120.559715:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790946120.568695:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946120.568822:0:17158:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616582016 00000100:00100000:3.0:1790946120.568835:0:17158:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616582016 00000100:00100000:3.0:1790946120.568893:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00100000:3.0:1790946120.568932:0:17158:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408723bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ca604fcf-845a-4ff8-977f-a1d27931fa85+7:15553:x1877942616582016:12345-192.168.204.20@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1790946120.569058:0:17158:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408723bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ca604fcf-845a-4ff8-977f-a1d27931fa85+7:15553:x1877942616582016:12345-192.168.204.20@tcp:900:lhsmtool_posix.0 Request processed in 127us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946120.569066:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00100000:0.0:1790946120.580136:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946120.589236:0:20141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616582272 00000100:00100000:3.0:1790946120.589316:0:20141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616582272 00000100:00100000:3.0:1790946120.589405:0:20141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 24 00000100:00100000:3.0:1790946120.589415:0:20141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408723aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca604fcf-845a-4ff8-977f-a1d27931fa85+7:15553:x1877942616582272:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790946120.589439:0:20141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946120.589462:0:20141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0000/0xd9f4181e0d27e828 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330fc0 expref: -99 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.589651:0:20141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27e82f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.589664:0:20141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27e82f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.589676:0:20141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27e82f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.589744:0:20141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27e836 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.589752:0:20141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27e836 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.589757:0:20141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27e836 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.589878:0:20141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0e00/0xd9f4181e0d27e83d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.589886:0:20141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0e00/0xd9f4181e0d27e83d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.589894:0:20141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0e00/0xd9f4181e0d27e83d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946120.589904:0:20141:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1790946120.590061:0:20141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27e82f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.590083:0:20141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27e82f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.590090:0:20141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27e82f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.590095:0:20141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef1400 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790946120.590099:0:20141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27e82f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.590346:0:20141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27e82f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.590359:0:20141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d4096cfdf00) 00010000:00010000:3.0:1790946120.592149:0:20141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946120.592159:0:20141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27e82f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.592203:0:20141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27e82f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.592227:0:20141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27e836 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.592233:0:20141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27e836 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.592240:0:20141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27e836 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.592246:0:20141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef0400 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790946120.592250:0:20141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27e836 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.592257:0:20141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27e836 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.592271:0:20141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9d3f83415a00) 00010000:00010000:3.0:1790946120.592274:0:20141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946120.592277:0:20141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27e836 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.592283:0:20141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27e836 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.593629:0:20141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0000/0xd9f4181e0d27e828 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330fc0 expref: 10 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.593668:0:20141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0e00/0xd9f4181e0d27e83d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330fc0 expref: 9 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.593677:0:20141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3f83415000) 00010000:00010000:3.0:1790946120.593680:0:20141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946120.593684:0:20141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40baef0e00, rc 0) 00000100:00100000:3.0:1790946120.593771:0:20141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408723aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca604fcf-845a-4ff8-977f-a1d27931fa85+9:15553:x1877942616582272:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 4356us (13645us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1790946120.593782:0:20141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 24 00000100:00100000:1.0:1790946120.606555:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946120.606802:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616582400 00000100:00100000:2.0:1790946120.606814:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616582400 00000100:00100000:2.0:1790946120.606883:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 25 00000100:00100000:2.0:1790946120.606894:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca604fcf-845a-4ff8-977f-a1d27931fa85+9:15553:x1877942616582400:12345-192.168.204.20@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1790946120.607214:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca604fcf-845a-4ff8-977f-a1d27931fa85+9:15553:x1877942616582400:12345-192.168.204.20@tcp:59:lhsmtool_posix.0 Request processed in 321us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946120.607223:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 25 00000100:00100000:0.0:1790946120.613824:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946120.613969:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616582528 00000100:00100000:1.0:1790946120.613980:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616582528 00000100:00100000:1.0:1790946120.614053:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 26 00000100:00100000:1.0:1790946120.614065:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+5:15553:x1877942616582528:12345-192.168.204.20@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1790946120.614649:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1790946120.618977:0:17148:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 4857us 00000100:00100000:0.0:1790946120.640694:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+5:15553:x1877942616582528:12345-192.168.204.20@tcp:59:lhsmtool_posix.0 Request processed in 26619us (26868us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946120.640711:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 26 00000100:00100000:0.0:1790946120.674955:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946120.675050:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616582656 00000100:00100000:3.0:1790946120.675060:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616582656 00000100:00100000:3.0:1790946120.675123:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 27 00000100:00100000:3.0:1790946120.675133:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408723b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+9:15559:x1877942616582656:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1790946120.675153:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946120.675211:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0000/0xd9f4181e0d27e84b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330fc7 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.675441:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27e852 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.675457:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27e852 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.675467:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27e852 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.675481:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27e859 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.675513:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27e859 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.675521:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27e859 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.676073:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27e852 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.676083:0:17149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27e852 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.676090:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27e852 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.676096:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef0400 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790946120.676099:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27e852 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.676106:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27e852 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.676119:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d40bc9afc00) 00010000:00010000:3.0:1790946120.676122:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946120.676126:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27e852 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.676132:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27e852 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.676145:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27e859 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.676158:0:17149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27e859 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.676164:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27e859 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.676278:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef1400 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790946120.676282:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27e859 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.676288:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27e859 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.676295:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d3f83415a00) 00010000:00010000:3.0:1790946120.676298:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946120.676301:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27e859 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.676306:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27e859 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.676345:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0000/0xd9f4181e0d27e84b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330fc7 expref: 10 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.676355:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d40bc9afc00) 00010000:00010000:3.0:1790946120.676357:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946120.676361:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0000/0xd9f4181e0d27e84b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330fc7 expref: 10 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.676381:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40baef0000, rc 0) 00000100:00100000:3.0:1790946120.676459:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408723b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+9:15559:x1877942616582656:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 1327us (1514us total) trans 0 rc 301/301 00000100:00100000:3.0:1790946120.676467:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 27 00000100:00100000:2.0:1790946120.685580:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946120.685732:0:17156:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616582784 00000100:00100000:1.0:1790946120.685742:0:17156:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616582784 00000100:00100000:1.0:1790946120.685796:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:1.0:1790946120.685805:0:17156:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4cedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ca604fcf-845a-4ff8-977f-a1d27931fa85+9:15559:x1877942616582784:12345-192.168.204.20@tcp:700:lfs.0 00000100:00100000:1.0:1790946120.685993:0:17156:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4cedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ca604fcf-845a-4ff8-977f-a1d27931fa85+9:15559:x1877942616582784:12345-192.168.204.20@tcp:700:lfs.0 Request processed in 188us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946120.686002:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:0.0:1790946120.706606:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946120.706771:0:20141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616583040 00000100:00100000:3.0:1790946120.706781:0:20141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616583040 00000100:00100000:3.0:1790946120.706887:0:20141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 28 00000100:00100000:3.0:1790946120.706898:0:20141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408723a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca604fcf-845a-4ff8-977f-a1d27931fa85+9:15559:x1877942616583040:12345-192.168.204.20@tcp:36:lfs.0 00010000:00010000:3.0:1790946120.706956:0:20141:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946120.706982:0:20141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031e00/0xd9f4181e0d27e779 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330f34 expref: 9 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.707013:0:20141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d40bc9afc00) 00010000:00010000:3.0:1790946120.707019:0:20141:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790946120.707074:0:20141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0000/0xd9f4181e0d27e860 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.707095:0:20141:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e7b8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330fa4 expref: 5 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.707104:0:20141:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0000/0xd9f4181e0d27e860 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.707135:0:20141:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e7b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330fa4 expref: 5 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.707149:0:20141:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e7b8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330fa4 expref: 5 pid: 17148 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946120.707250:0:20141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20141:1877942638681216:192.168.204.20@tcp:104: 00000100:00100000:3.0:1790946120.707328:0:20141:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f83f7c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790946120.710924:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946120.712205:0:17132:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616583168 00000100:00100000:1.0:1790946120.712219:0:17132:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616583168 00010000:00010000:1.0:1790946120.712295:0:17132:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e7b8 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330fa4 expref: 6 pid: 17148 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946120.712339:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15 00000100:00100000:1.0:1790946120.712350:0:17132:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087238700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+6:2403:x1877942616583168:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790946120.712366:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946120.712372:0:17132:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e7b8 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330fa4 expref: 6 pid: 17148 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946120.712385:0:17132:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e7b8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330fa4 expref: 6 pid: 17148 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1790946120.712584:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790946120.712669:0:17132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d40bc9afc00) 00010000:00010000:1.0:1790946120.712675:0:17132:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0000/0xd9f4181e0d27e860 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946120.712686:0:17132:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0000/0xd9f4181e0d27e860 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946120.712693:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0000/0xd9f4181e0d27e860 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946120.712711:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946120.712895:0:17132:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087238700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+6:2403:x1877942616583168:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 545us (1979us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946120.712904:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15 00010000:00010000:3.0:1790946120.715334:0:20141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e7b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330fa4 expref: 5 pid: 17148 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946120.715359:0:20141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20141:1877942638681216:192.168.204.20@tcp:104: 00010000:00010000:3.0:1790946120.715384:0:20141:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0000/0xd9f4181e0d27e860 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.715395:0:20141:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0000/0xd9f4181e0d27e860 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.715401:0:20141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0000/0xd9f4181e0d27e860 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.715442:0:20141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27e867 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.715455:0:20141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27e867 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.715465:0:20141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27e867 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.718999:0:20141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27e86e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.719024:0:20141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27e86e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.719044:0:20141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27e86e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790946120.719066:0:20141:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c277338c reply state 00000000118181fb transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27e86e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.719078:0:20141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27e86e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.719086:0:20141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d3f83415600) 00010000:00010000:3.0:1790946120.719090:0:20141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790946120.719094:0:20141:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1790946120.719101:0:20141:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1790946120.719109:0:20141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0000/0xd9f4181e0d27e860 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.719116:0:20141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0000/0xd9f4181e0d27e860 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.719123:0:20141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0000/0xd9f4181e0d27e860 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.719128:0:20141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef0000 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790946120.719132:0:20141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0000/0xd9f4181e0d27e860 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.719335:0:20141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0000/0xd9f4181e0d27e860 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.719347:0:20141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d40bc9afc00) 00010000:00010000:3.0:1790946120.719349:0:20141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946120.719360:0:20141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0000/0xd9f4181e0d27e860 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.719366:0:20141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0000/0xd9f4181e0d27e860 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790946120.719385:0:20141:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c277338c reply state 00000000118181fb transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27e867 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.719395:0:20141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27e867 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.719402:0:20141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d3f83415a00) 00010000:00010000:3.0:1790946120.719404:0:20141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790946120.719406:0:20141:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1790946120.719534:0:20141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408723a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca604fcf-845a-4ff8-977f-a1d27931fa85+10:15559:x1877942616583040:12345-192.168.204.20@tcp:36:lfs.0 Request processed in 12633us (12934us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1790946120.719543:0:20141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 28 00000100:00100000:0.0:1790946120.769922:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946120.770025:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946120.770062:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946120.770104:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946120.770133:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946120.770234:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946120.770262:0:19252:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616583552 00000100:00100000:0.0:1790946120.770272:0:19252:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616583552 00000100:00100000:0.0:1790946120.770323:0:19252:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616583808 00000100:00100000:0.0:1790946120.770327:0:19252:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616583808 00000100:00100000:0.0:1790946120.770341:0:19252:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616583424 00000100:00100000:0.0:1790946120.770344:0:19252:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616583424 00000100:00100000:0.0:1790946120.770354:0:19252:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616583936 00000100:00100000:0.0:1790946120.770356:0:19252:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616583936 00000100:00100000:0.0:1790946120.770370:0:19252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:0.0:1790946120.770380:0:19252:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087239500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ca604fcf-845a-4ff8-977f-a1d27931fa85+5:2402:x1877942616583552:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790946120.770487:0:19252:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087239500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ca604fcf-845a-4ff8-977f-a1d27931fa85+5:2402:x1877942616583552:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 108us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946120.770495:0:19252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:0.0:1790946120.770523:0:19252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:0.0:1790946120.770531:0:19252:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84568700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+5:2402:x1877942616583808:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790946120.770552:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:0.0:1790946120.770561:0:19252:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84568700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+5:2402:x1877942616583808:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 30us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946120.770567:0:18667:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84569500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+5:2402:x1877942616583424:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790946120.770575:0:19252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:0.0:1790946120.770590:0:19252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:0.0:1790946120.770598:0:19252:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84568e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+5:2402:x1877942616583936:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790946120.770621:0:19252:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84568e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+5:2402:x1877942616583936:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 25us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946120.770627:0:19252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00080000:0.0:1790946120.770646:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790946120.770650:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790946120.770935:0:18667:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84569500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+5:2402:x1877942616583424:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 372us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946120.770943:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:2.0:1790946120.770980:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616583680 00000100:00100000:2.0:1790946120.771006:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616583680 00000100:00100000:2.0:1790946120.771097:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 52 00000100:00100000:2.0:1790946120.771105:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+5:2402:x1877942616583680:12345-192.168.204.20@tcp:400:kworker.0 00000100:00080000:3.0:1790946120.771455:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790946120.771550:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+5:2402:x1877942616583680:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 444us (1414us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946120.771560:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 52 00000100:00100000:1.0:1790946120.775788:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616583296 00000100:00100000:1.0:1790946120.775804:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616583296 00000100:00100000:1.0:1790946120.775886:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 164 00000100:00100000:1.0:1790946120.775897:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8238b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65e62bd4-414e-42c8-885a-5648a45a13a4+13:2402:x1877942616583296:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790946120.775992:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8238b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65e62bd4-414e-42c8-885a-5648a45a13a4+13:2402:x1877942616583296:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 97us (6082us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946120.776000:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 164 00000100:00100000:0.0:1790946120.818354:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946120.818612:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616584064 00000100:00100000:1.0:1790946120.818628:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616584064 00000100:00100000:1.0:1790946120.818695:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 29 00000100:00100000:1.0:1790946120.818704:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8456ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+10:15567:x1877942616584064:12345-192.168.204.20@tcp:101:lctl.0 00010000:00010000:1.0:1790946120.818729:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946120.818757:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27e875 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330fce expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946120.818821:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27e87c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946120.818834:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27e87c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946120.818844:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27e87c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790946120.818886:0:17148:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1790946120.818890:0:17148:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790946120.819313:0:17148:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27e87c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946120.819339:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27e875 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330fce expref: 12 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946120.819358:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27e87c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330fce expref: 11 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946120.819367:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d4096cfda00) 00010000:00010000:1.0:1790946120.819370:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790946120.819373:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40bcbe0000, rc 0) 00000100:00100000:1.0:1790946120.819439:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8456ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+11:15567:x1877942616584064:12345-192.168.204.20@tcp:101:lctl.0 Request processed in 735us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946120.819446:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 29 00000100:00100000:3.0:1790946120.848702:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946120.849333:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616584192 00000100:00100000:2.0:1790946120.849344:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616584192 00000100:00100000:2.0:1790946120.849556:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 30 00000100:00100000:2.0:1790946120.849568:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+5:15568:x1877942616584192:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1790946120.849592:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946120.849619:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d7800/0xd9f4181e0d27e883 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330fd5 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946120.850093:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d7000/0xd9f4181e0d27e88a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946120.850553:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d7000/0xd9f4181e0d27e88a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946120.850572:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d7000/0xd9f4181e0d27e88a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946120.850630:0:17147:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790946120.850634:0:17147:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790946120.850657:0:17147:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d7000/0xd9f4181e0d27e88a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946120.851288:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d7800/0xd9f4181e0d27e883 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330fd5 expref: 7 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946120.851335:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d7000/0xd9f4181e0d27e88a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330fd5 expref: 6 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946120.851346:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d4096cfda00) 00010000:00010000:2.0:1790946120.851348:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790946120.851352:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40c21d7000, rc 0) 00000100:00100000:2.0:1790946120.851450:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+6:15568:x1877942616584192:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 1884us (2758us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946120.851460:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 30 00000100:00100000:0.0:1790946120.855599:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946120.856870:0:20141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616584320 00000100:00100000:3.0:1790946120.856886:0:20141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616584320 00000100:00100000:3.0:1790946120.856956:0:20141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 31 00000100:00100000:3.0:1790946120.856967:0:20141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+6:15568:x1877942616584320:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1790946120.857632:0:20141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946120.857657:0:20141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0000/0xd9f4181e0d27e891 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330fdc expref: -99 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.857863:0:20141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1200/0xd9f4181e0d27e898 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.857898:0:20141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1200/0xd9f4181e0d27e898 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.857909:0:20141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1200/0xd9f4181e0d27e898 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.857920:0:20141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0c00/0xd9f4181e0d27e89f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.857927:0:20141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0c00/0xd9f4181e0d27e89f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.857933:0:20141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0c00/0xd9f4181e0d27e89f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.858592:0:20141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e8a6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.858607:0:20141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e8a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.858615:0:20141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e8a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946120.858655:0:20141:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790946120.858659:0:20141:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790946120.858679:0:20141:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e8a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.858820:0:20141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1200/0xd9f4181e0d27e898 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.858842:0:20141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1200/0xd9f4181e0d27e898 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.858849:0:20141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1200/0xd9f4181e0d27e898 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.858856:0:20141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef1200 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790946120.858860:0:20141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1200/0xd9f4181e0d27e898 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.858868:0:20141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1200/0xd9f4181e0d27e898 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.858880:0:20141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d4096cfda00) 00010000:00010000:3.0:1790946120.858883:0:20141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946120.858887:0:20141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1200/0xd9f4181e0d27e898 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.858893:0:20141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1200/0xd9f4181e0d27e898 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.858909:0:20141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0c00/0xd9f4181e0d27e89f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.858915:0:20141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0c00/0xd9f4181e0d27e89f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.858921:0:20141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0c00/0xd9f4181e0d27e89f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.858925:0:20141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef0c00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790946120.858934:0:20141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0c00/0xd9f4181e0d27e89f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.858940:0:20141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0c00/0xd9f4181e0d27e89f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.858948:0:20141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d3f83415a00) 00010000:00010000:3.0:1790946120.858951:0:20141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946120.858955:0:20141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0c00/0xd9f4181e0d27e89f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.858961:0:20141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0c00/0xd9f4181e0d27e89f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.859062:0:20141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0000/0xd9f4181e0d27e891 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330fdc expref: 8 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.859078:0:20141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e8a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330fdc expref: 7 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.859159:0:20141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d3f83415600) 00010000:00010000:3.0:1790946120.859162:0:20141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790946120.859164:0:20141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4080030a00, rc 0) 00000100:00100000:3.0:1790946120.859596:0:20141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+7:15568:x1877942616584320:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 2628us (4005us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946120.859605:0:20141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 31 00000040:00080000:0.0:1790946120.864199:0:17919:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790946120.868984:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946120.869084:0:17158:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616584448 00000100:00100000:3.0:1790946120.869098:0:17158:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616584448 00000100:00100000:3.0:1790946120.869200:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00100000:3.0:1790946120.869212:0:17158:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+5:15568:x1877942616584448:12345-192.168.204.20@tcp:900:lfs.0 00000100:00100000:3.0:1790946120.869330:0:17158:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+5:15568:x1877942616584448:12345-192.168.204.20@tcp:900:lfs.0 Request processed in 120us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946120.869339:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00100000:1.0:1790946120.876568:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946120.876724:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616584704 00000100:00100000:3.0:1790946120.876733:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616584704 00000100:00100000:3.0:1790946120.876796:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 32 00000100:00100000:3.0:1790946120.876805:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+7:15568:x1877942616584704:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1790946120.876828:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946120.876857:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031e00/0xd9f4181e0d27e8ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330fe3 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946120.876955:0:17149:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1790946120.877250:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031e00/0xd9f4181e0d27e8ad lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330fe3 expref: 9 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.877264:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d4096cfda00) 00010000:00010000:3.0:1790946120.877267:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790946120.877273:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031e00/0xd9f4181e0d27e8ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330fe3 expref: 9 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.877294:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4080031e00, rc 0) 00000100:00100000:3.0:1790946120.877343:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+8:15568:x1877942616584704:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 539us (787us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1790946120.877349:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 32 00000100:00100000:2.0:1790946120.886920:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946120.886988:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616584960 00000100:00100000:1.0:1790946120.886998:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616584960 00000100:00100000:1.0:1790946120.887067:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 33 00000100:00100000:1.0:1790946120.887078:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4cedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+8:15568:x1877942616584960:12345-192.168.204.20@tcp:36:lfs.0 00010000:00010000:1.0:1790946120.887137:0:17148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946120.887204:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e8a6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330fdc expref: 8 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946120.887227:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d3f83415600) 00010000:00010000:1.0:1790946120.887232:0:17148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790946120.887254:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27e8bb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946120.887268:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27e8bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946120.887279:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27e8bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790946120.888760:0:17148:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000cf6a1620 reply state 00000000798ae5b4 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27e8bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946120.888785:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27e8bb lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946120.888792:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d3f83415600) 00010000:00010000:1.0:1790946120.888795:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1790946120.888798:0:17148:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1790946120.888806:0:17148:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1790946120.889049:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4cedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+9:15568:x1877942616584960:12345-192.168.204.20@tcp:36:lfs.0 Request processed in 1970us (2135us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1790946120.889066:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 33 00000100:00100000:0.0:1790946120.894377:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946120.894465:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616585216 00000100:00100000:1.0:1790946120.894485:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616585216 00000100:00100000:1.0:1790946120.894545:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2 00000100:00100000:1.0:1790946120.894554:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8456bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+9:15568:x1877942616585216:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:1.0:1790946120.894800:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8456bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+10:15568:x1877942616585216:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 246us (445us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1790946120.894807:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2 00000100:00100000:3.0:1790946120.899246:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946120.899387:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616585472 00000100:00100000:2.0:1790946120.899397:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616585472 00000100:00100000:2.0:1790946120.899454:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 34 00000100:00100000:2.0:1790946120.899471:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+10:15568:x1877942616585472:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1790946120.899505:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946120.899525:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6c00/0xd9f4181e0d27e8c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330fea expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946120.899600:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6600/0xd9f4181e0d27e8c9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946120.899614:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6600/0xd9f4181e0d27e8c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946120.899637:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6600/0xd9f4181e0d27e8c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946120.899666:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6400/0xd9f4181e0d27e8d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946120.899675:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6400/0xd9f4181e0d27e8d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946120.899682:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6400/0xd9f4181e0d27e8d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946120.899784:0:17147:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1790946120.899867:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6600/0xd9f4181e0d27e8c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946120.899876:0:17147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6600/0xd9f4181e0d27e8c9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946120.899883:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6600/0xd9f4181e0d27e8c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946120.899889:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d6600 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790946120.899893:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6600/0xd9f4181e0d27e8c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946120.899902:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6600/0xd9f4181e0d27e8c9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946120.899913:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d4096cfda00) 00010000:00010000:2.0:1790946120.899916:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946120.899920:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6600/0xd9f4181e0d27e8c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946120.899935:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6600/0xd9f4181e0d27e8c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946120.899949:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6400/0xd9f4181e0d27e8d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946120.899955:0:17147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6400/0xd9f4181e0d27e8d0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946120.899961:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6400/0xd9f4181e0d27e8d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946120.899966:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d6400 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790946120.899969:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6400/0xd9f4181e0d27e8d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946120.899975:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6400/0xd9f4181e0d27e8d0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946120.899982:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d3f83415a00) 00010000:00010000:2.0:1790946120.899984:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946120.899987:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6400/0xd9f4181e0d27e8d0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946120.899992:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6400/0xd9f4181e0d27e8d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946120.900022:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6c00/0xd9f4181e0d27e8c2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330fea expref: 12 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946120.900043:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d4096cfda00) 00010000:00010000:2.0:1790946120.900045:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790946120.900049:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6c00/0xd9f4181e0d27e8c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330fea expref: 12 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946120.900059:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40c21d6c00, rc 0) 00000100:00100000:2.0:1790946120.900118:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+11:15568:x1877942616585472:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 656us (890us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1790946120.900126:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 34 00000100:00100000:0.0:1790946120.912189:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946120.912478:0:20141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616585600 00000100:00100000:3.0:1790946120.912510:0:20141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616585600 00000100:00100000:3.0:1790946120.912578:0:20141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 35 00000100:00100000:3.0:1790946120.912588:0:20141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8456b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+11:15568:x1877942616585600:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1790946120.912612:0:20141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946120.912639:0:20141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031e00/0xd9f4181e0d27e8de lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330ff1 expref: -99 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.912734:0:20141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e8e5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.912749:0:20141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.912760:0:20141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946120.912787:0:20141:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790946120.912791:0:20141:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790946120.912811:0:20141:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.912838:0:20141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031e00/0xd9f4181e0d27e8de lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ff1 expref: 13 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.913001:0:20141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e8e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ff1 expref: 12 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946120.913011:0:20141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d3f83415600) 00010000:00010000:3.0:1790946120.913014:0:20141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790946120.913018:0:20141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4080030a00, rc 0) 00000100:00100000:3.0:1790946120.913312:0:20141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8456b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+12:15568:x1877942616585600:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 724us (1147us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946120.913321:0:20141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 35 00000100:00100000:0.0:1790946120.923567:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946120.923723:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616585728 00000100:00100000:1.0:1790946120.923735:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616585728 00000100:00100000:1.0:1790946120.923842:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 3 00000100:00100000:1.0:1790946120.923853:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8456b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+12:15568:x1877942616585728:12345-192.168.204.20@tcp:37:lfs.0 00000100:00100000:2.0:1790946120.943302:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8456b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+12:15568:x1877942616585728:12345-192.168.204.20@tcp:37:lfs.0 Request processed in 19442us (19734us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946120.943316:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 3 00000100:00100000:0.0:1790946120.949818:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946120.951660:0:17150:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616585984 00000100:00100000:2.0:1790946120.951673:0:17150:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616585984 00000100:00100000:2.0:1790946120.951745:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4 00000100:00100000:2.0:1790946120.951755:0:17150:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83d77850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+12:15568:x1877942616585984:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:2.0:1790946120.951978:0:17150:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83d77850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+13:15568:x1877942616585984:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 223us (2169us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1790946120.951987:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4 00010000:00010000:3.0:1790946121.002507:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946121.020745:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946121.020921:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616586112 00000100:00100000:2.0:1790946121.020933:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616586112 00000100:00100000:2.0:1790946121.021040:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 36 00000100:00100000:2.0:1790946121.021051:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8456bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca604fcf-845a-4ff8-977f-a1d27931fa85+11:15574:x1877942616586112:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:2.0:1790946121.021073:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946121.021108:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6c00/0xd9f4181e0d27e8ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330ff8 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946121.021217:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6400/0xd9f4181e0d27e8f3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946121.021244:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6400/0xd9f4181e0d27e8f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946121.021256:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6400/0xd9f4181e0d27e8f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946121.021268:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6600/0xd9f4181e0d27e8fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946121.021276:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6600/0xd9f4181e0d27e8fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946121.021283:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6600/0xd9f4181e0d27e8fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946121.021358:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27e901 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946121.021367:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27e901 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946121.021505:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27e901 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946121.021540:0:17147:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790946121.021544:0:17147:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790946121.021583:0:17147:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27e901 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946121.021602:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6400/0xd9f4181e0d27e8f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946121.021609:0:17147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6400/0xd9f4181e0d27e8f3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946121.021616:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6400/0xd9f4181e0d27e8f3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946121.021698:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d6400 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790946121.021702:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6400/0xd9f4181e0d27e8f3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946121.021711:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6400/0xd9f4181e0d27e8f3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946121.021722:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d4096cfda00) 00010000:00010000:2.0:1790946121.021725:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946121.021729:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6400/0xd9f4181e0d27e8f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946121.021735:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6400/0xd9f4181e0d27e8f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946121.021749:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6600/0xd9f4181e0d27e8fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946121.021754:0:17147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6600/0xd9f4181e0d27e8fa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946121.021760:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6600/0xd9f4181e0d27e8fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946121.021771:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d6600 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790946121.021774:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6600/0xd9f4181e0d27e8fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946121.021780:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6600/0xd9f4181e0d27e8fa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946121.021786:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d3f83415a00) 00010000:00010000:2.0:1790946121.021788:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946121.021791:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6600/0xd9f4181e0d27e8fa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946121.021796:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6600/0xd9f4181e0d27e8fa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946121.021942:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6c00/0xd9f4181e0d27e8ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ff8 expref: 13 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946121.021957:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27e901 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ff8 expref: 12 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946121.021964:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d3f83415600) 00010000:00010000:2.0:1790946121.021966:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1790946121.021969:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40c21d6800, rc 0) 00000100:00100000:0.0:1790946121.022195:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8456bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca604fcf-845a-4ff8-977f-a1d27931fa85+12:15574:x1877942616586112:12345-192.168.204.20@tcp:101:bash.0 Request processed in 1144us (1458us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946121.022204:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 36 00000100:00100000:3.0:1790946121.025766:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946121.026108:0:17158:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616586240 00000100:00100000:0.0:1790946121.026118:0:17158:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616586240 00000100:00100000:0.0:1790946121.026429:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:0.0:1790946121.026440:0:17158:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ca604fcf-845a-4ff8-977f-a1d27931fa85+5:15574:x1877942616586240:12345-192.168.204.20@tcp:900:bash.0 00000100:00100000:0.0:1790946121.026544:0:17158:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ca604fcf-845a-4ff8-977f-a1d27931fa85+5:15574:x1877942616586240:12345-192.168.204.20@tcp:900:bash.0 Request processed in 106us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946121.026552:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:2.0:1790946121.029156:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946121.029329:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616586496 00000100:00100000:1.0:1790946121.029339:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616586496 00000100:00100000:1.0:1790946121.029432:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 37 00000100:00100000:1.0:1790946121.029443:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4ced500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+12:15574:x1877942616586496:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:1.0:1790946121.029536:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946121.029557:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27e908 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222330fff expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.029654:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27e90f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.029670:0:17148:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e8e5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ff1 expref: 12 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.029755:0:17148:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27e90f lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.029788:0:17148:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e8e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ff1 expref: 12 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.029801:0:17148:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e8e5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ff1 expref: 12 pid: 20141 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946121.029814:0:17148:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff95c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17148:1877942638681344:192.168.204.20@tcp:104: 00000100:00100000:1.0:1790946121.030016:0:17148:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bcbcdc00 going to sleep for 11 seconds 00000100:00100000:0.0:1790946121.033880:0:17148:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff95c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17148:1877942638681344:192.168.204.20@tcp:104: 00010000:00010000:0.0:1790946121.033910:0:17148:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27e90f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946121.034025:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946121.034096:0:20188:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616586624 00000100:00100000:2.0:1790946121.034103:0:20188:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616586624 00010000:00010000:2.0:1790946121.034149:0:20188:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e8e5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ff1 expref: 13 pid: 20141 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946121.034219:0:20188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:2.0:1790946121.034228:0:20188:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+13:2404:x1877942616586624:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790946121.034243:0:20188:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946121.034250:0:20188:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e8e5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ff1 expref: 13 pid: 20141 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946121.034262:0:20188:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e8e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ff1 expref: 13 pid: 20141 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946121.034282:0:20188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e8e5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ff1 expref: 13 pid: 20141 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946121.034298:0:20188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d3f83415600) 00010000:00010000:2.0:1790946121.034303:0:20188:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27e90f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946121.034312:0:20188:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27e90f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946121.034320:0:20188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27e90f lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946121.034347:0:20188:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790946121.034401:0:20188:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+12:2404:x1877942616586624:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 173us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946121.034407:0:20188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 16 00010000:00010000:1.0:1790946121.034571:0:17148:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27e90f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.034580:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27e90f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.034604:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff200/0xd9f4181e0d27e916 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.034614:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff200/0xd9f4181e0d27e916 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.034622:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff200/0xd9f4181e0d27e916 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.035287:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff400/0xd9f4181e0d27e91d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.035304:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff400/0xd9f4181e0d27e91d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.035311:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff400/0xd9f4181e0d27e91d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790946121.035322:0:17148:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1790946121.035347:0:17148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27e90f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.035353:0:17148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27e90f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.035360:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27e90f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.035367:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe1400 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:1.0:1790946121.035371:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27e90f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.035379:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27e90f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.035388:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d3f83415600) 00010000:00010000:1.0:1790946121.035391:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946121.035395:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27e90f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.035401:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1400/0xd9f4181e0d27e90f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790946121.035412:0:17148:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f856a035 reply state 000000001365be9d transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff200/0xd9f4181e0d27e916 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.035429:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff200/0xd9f4181e0d27e916 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.035435:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9d4096cfd700) 00010000:00010000:1.0:1790946121.035438:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790946121.035440:0:17148:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790946121.035621:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0200/0xd9f4181e0d27e908 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330fff expref: 15 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.035638:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff400/0xd9f4181e0d27e91d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330fff expref: 14 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.035644:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d4096cfd000) 00010000:00010000:1.0:1790946121.035646:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1790946121.035649:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40813ff400, rc 0) 00000100:00100000:1.0:1790946121.035689:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4ced500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+15:15574:x1877942616586496:12345-192.168.204.20@tcp:101:bash.0 Request processed in 6248us (6541us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1790946121.035697:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 37 00000100:00100000:0.0:1790946121.048054:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946121.048381:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616586752 00000100:00100000:3.0:1790946121.048391:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616586752 00000100:00100000:3.0:1790946121.048855:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 38 00000100:00100000:3.0:1790946121.048867:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8456b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+15:15574:x1877942616586752:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:3.0:1790946121.048893:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946121.048913:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031e00/0xd9f4181e0d27e92b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222331006 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946121.048983:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e932 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946121.048996:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e932 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946121.049006:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e932 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946121.049050:0:17149:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1790946121.049054:0:17149:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790946121.049074:0:17149:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e932 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946121.049083:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e932 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946121.049106:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031e00/0xd9f4181e0d27e92b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331006 expref: 17 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946121.049164:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e932 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331006 expref: 16 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946121.049210:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d4096cfd000) 00010000:00010000:3.0:1790946121.049213:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790946121.049216:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4080030a00, rc 0) 00000100:00100000:3.0:1790946121.049293:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8456b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+16:15574:x1877942616586752:12345-192.168.204.20@tcp:101:bash.0 Request processed in 428us (1248us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946121.049299:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 38 00000100:00100000:2.0:1790946121.052333:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946121.052429:0:17150:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616587008 00000100:00100000:3.0:1790946121.052440:0:17150:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616587008 00000100:00100000:2.0:1790946121.052579:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00100000:2.0:1790946121.052588:0:17150:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4cef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ca604fcf-845a-4ff8-977f-a1d27931fa85+16:15574:x1877942616587008:12345-192.168.204.20@tcp:35:bash.0 00000100:00100000:2.0:1790946121.052859:0:17150:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4cef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ca604fcf-845a-4ff8-977f-a1d27931fa85+17:15574:x1877942616587008:12345-192.168.204.20@tcp:35:bash.0 Request processed in 271us (533us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1790946121.052867:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00100000:3.0:1790946121.055374:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638681472:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790946121.055443:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946121.055779:0:18671:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638681472 00000100:00100000:1.0:1790946121.055788:0:18671:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638681472 00000100:00100000:1.0:1790946121.055840:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790946121.055862:0:18671:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638681472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790946121.055892:0:18671:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1790946121.055932:0:18671:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638681472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946121.055939:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1790946121.055958:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790946121.056109:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638681472:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790946121.056124:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790946121.056129:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638681600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790946121.056152:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946121.056560:0:18670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638681600 00000100:00100000:2.0:1790946121.056566:0:18670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638681600 00000100:00100000:2.0:1790946121.056601:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790946121.056608:0:18670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638681600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790946121.056621:0:18670:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1790946121.056661:0:18670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638681600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946121.056667:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790946121.056682:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790946121.056690:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4cef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638681728:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790946121.056719:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790946121.056741:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790946121.056762:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638681600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790946121.058770:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638681728 00000100:00100000:3.0:1790946121.058784:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638681728 00000100:00100000:3.0:1790946121.058972:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790946121.058983:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4cefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638681728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790946121.059018:0:17153:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1790946121.059086:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4cefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638681728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (2365us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946121.059092:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790946121.060051:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4cef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638681728:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790946121.060462:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790946121.060475:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f835e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638681856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790946121.060534:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946121.060752:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790946121.060761:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638681984:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790946121.060789:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946121.060943:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4ceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:87d8d138-d2ce-4761-a98a-4e847b9142bd:3650:1877942638682112:0@lo:400:kworker.0 00000100:00100000:1.0:1790946121.060978:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946121.061052:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638681984 00000100:00100000:3.0:1790946121.061060:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638681984 00000100:00100000:3.0:1790946121.061109:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790946121.061118:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4cef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638681984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790946121.061148:0:17153:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1790946121.061227:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4cef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638681984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946121.061235:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790946121.061307:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638681984:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790946121.061447:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638682112 00000100:00100000:2.0:1790946121.061451:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638682112 00000100:00100000:2.0:1790946121.061478:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1790946121.061485:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f82388c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+24:3650:x1877942638682112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946121.061541:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f82388c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+24:3650:x1877942638682112:12345-0@lo:400:kworker.0 Request processed in 56us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946121.061547:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1790946121.061575:0:18670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638681856 00000100:00100000:2.0:1790946121.061579:0:18670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638681856 00000100:00100000:2.0:1790946121.061611:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790946121.061618:0:18670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638681856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790946121.061632:0:18670:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1790946121.061659:0:18670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638681856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946121.061665:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1790946121.061681:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790946121.061692:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4ceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1877942638682368:0@lo:400:kworker.0 00000100:00100000:2.0:1790946121.061718:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946121.061738:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1877942638682880:0@lo:400:kworker.0 00000100:00100000:2.0:1790946121.061757:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946121.061772:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1790946121.061777:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4cec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877942638682240:0@lo:400:kworker.0 00000100:00100000:2.0:1790946121.061794:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946121.061806:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1877942638682752:0@lo:400:kworker.0 00000100:00100000:2.0:1790946121.061822:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946121.061987:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4ceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1877942638682624:0@lo:400:kworker.0 00000100:00100000:1.0:1790946121.062014:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946121.062033:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4ceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:87d8d138-d2ce-4761-a98a-4e847b9142bd:3650:1877942638682112:0@lo:400:kworker.0 00000100:00100000:1.0:1790946121.062046:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790946121.062051:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4cec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1877942638682496:0@lo:400:kworker.0 00000100:00100000:1.0:1790946121.062071:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946121.062090:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638682880 00000100:00100000:1.0:1790946121.062094:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638682880 00000100:00080000:1.0:1790946121.062109:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790946121.062129:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638682240 00000100:00100000:1.0:1790946121.062132:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638682240 00000100:00100000:1.0:1790946121.062144:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638682752 00000100:00100000:1.0:1790946121.062147:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638682752 00000100:00080000:1.0:1790946121.062157:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790946121.062195:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638682624 00000100:00100000:1.0:1790946121.062199:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638682624 00000100:00080000:1.0:1790946121.062211:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790946121.062240:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638682496 00000100:00100000:1.0:1790946121.062244:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638682496 00000100:00080000:1.0:1790946121.062257:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790946121.062273:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790946121.062279:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1877942638682880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946121.062318:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1877942638682880:12345-0@lo:400:kworker.0 Request processed in 39us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946121.062325:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790946121.062347:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790946121.062365:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1877942638682240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946121.062397:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1877942638682240:12345-0@lo:400:kworker.0 Request processed in 44us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946121.062403:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790946121.062416:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790946121.062422:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1877942638682752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946121.062448:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1877942638682752:12345-0@lo:400:kworker.0 Request processed in 27us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946121.062454:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790946121.062467:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790946121.062473:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1877942638682624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946121.062516:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1877942638682624:12345-0@lo:400:kworker.0 Request processed in 43us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946121.062522:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1790946121.062547:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40b4ceea00 x1877942638682624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946121.062559:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4ceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1877942638682624:0@lo:400:kworker.0 00000100:00100000:1.0:1790946121.062579:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790946121.062585:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877942638682496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946121.062618:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877942638682496:12345-0@lo:400:kworker.0 Request processed in 33us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946121.062623:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790946121.062646:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4cec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1877942638682496:0@lo:400:kworker.0 00000100:00100000:3.0:1790946121.063048:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f835e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638681856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790946121.063277:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4cec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877942638682240:0@lo:400:kworker.0 00000100:00100000:0.0:1790946121.063299:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1877942638682752:0@lo:400:kworker.0 00010000:00080000:0.0:1790946121.063310:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f8265d180 x1877942638682880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946121.063319:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1877942638682880:0@lo:400:kworker.0 00000100:00100000:2.0:1790946121.063839:0:20141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638682368 00000100:00100000:2.0:1790946121.064021:0:20141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638682368 00000100:00100000:2.0:1790946121.064077:0:20141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790946121.064084:0:20141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1877942638682368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946121.064154:0:20141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1877942638682368:12345-0@lo:400:kworker.0 Request processed in 70us (2434us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946121.064322:0:20141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790946121.065043:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4ceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1877942638682368:0@lo:400:kworker.0 00000100:00100000:1.0:1790946121.172705:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946121.172858:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616587264 00000100:00100000:0.0:1790946121.172868:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616587264 00000100:00100000:0.0:1790946121.172926:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 39 00000100:00100000:0.0:1790946121.172935:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca604fcf-845a-4ff8-977f-a1d27931fa85+17:15584:x1877942616587264:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1790946121.172963:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946121.172987:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64e00/0xd9f4181e0d27e939 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c22233100d expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790946121.173101:0:17147:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1790946121.173781:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64e00/0xd9f4181e0d27e939 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233100d expref: 19 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946121.173797:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d4096cfda00) 00010000:00010000:0.0:1790946121.173800:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790946121.173804:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64e00/0xd9f4181e0d27e939 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233100d expref: 19 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946121.173828:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c64e00, rc 0) 00000100:00100000:0.0:1790946121.174115:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca604fcf-845a-4ff8-977f-a1d27931fa85+18:15584:x1877942616587264:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 1179us (1418us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1790946121.174142:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 39 00000100:00100000:0.0:1790946121.179383:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946121.179558:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616587520 00000100:00100000:1.0:1790946121.179569:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616587520 00000100:00100000:1.0:1790946121.179640:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00100000:1.0:1790946121.179650:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+18:15584:x1877942616587520:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:1.0:1790946121.179895:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+19:15584:x1877942616587520:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 246us (521us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1790946121.179903:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00100000:2.0:1790946121.215283:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946121.215707:0:20141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616587776 00000100:00100000:3.0:1790946121.215717:0:20141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616587776 00000100:00100000:3.0:1790946121.215831:0:20141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 40 00000100:00100000:3.0:1790946121.215842:0:20141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca604fcf-845a-4ff8-977f-a1d27931fa85+19:15587:x1877942616587776:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1790946121.215867:0:20141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946121.215889:0:20141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031e00/0xd9f4181e0d27e947 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222331014 expref: -99 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946121.215995:0:20141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0000/0xd9f4181e0d27e94e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946121.216009:0:20141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0000/0xd9f4181e0d27e94e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946121.216023:0:20141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0000/0xd9f4181e0d27e94e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946121.216034:0:20141:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1790946121.216473:0:20141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031e00/0xd9f4181e0d27e947 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331014 expref: 22 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946121.216536:0:20141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0000/0xd9f4181e0d27e94e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331014 expref: 21 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946121.216545:0:20141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d4096cfd000) 00010000:00010000:3.0:1790946121.216549:0:20141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790946121.216553:0:20141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40baef0000, rc 0) 00000100:00100000:3.0:1790946121.216614:0:20141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca604fcf-845a-4ff8-977f-a1d27931fa85+21:15587:x1877942616587776:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 774us (1341us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1790946121.216622:0:20141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 40 00000100:00100000:1.0:1790946121.221658:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946121.221704:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946121.221781:0:17134:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616588032 00000100:00100000:2.0:1790946121.221790:0:17134:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616588032 00000100:00100000:2.0:1790946121.221856:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:2.0:1790946121.221866:0:17134:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+21:2401:x1877942616588032:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790946121.221881:0:17134:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946121.221907:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0000/0xd9f4181e0d27e94e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331014 expref: 21 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946121.221928:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d4096cfd000) 00010000:00010000:2.0:1790946121.221932:0:17134:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790946121.221985:0:17134:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+20:2401:x1877942616588032:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 121us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946121.221994:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:3.0:1790946121.223012:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616587904 00000100:00100000:3.0:1790946121.223021:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616587904 00000100:00100000:3.0:1790946121.223061:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 41 00000100:00100000:3.0:1790946121.223069:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+20:15587:x1877942616587904:12345-192.168.204.20@tcp:54:lfs.0 00010000:00010000:3.0:1790946121.223125:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0c00/0xd9f4181e0d27e95c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946121.223153:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0c00/0xd9f4181e0d27e95c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946121.223164:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0c00/0xd9f4181e0d27e95c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946121.223595:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0c00/0xd9f4181e0d27e95c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946121.223605:0:17149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0c00/0xd9f4181e0d27e95c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946121.223631:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0c00/0xd9f4181e0d27e95c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946121.223637:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef0c00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790946121.223642:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0c00/0xd9f4181e0d27e95c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946121.223650:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0c00/0xd9f4181e0d27e95c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946121.223660:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d4096cfd000) 00010000:00010000:3.0:1790946121.223663:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790946121.223668:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0c00/0xd9f4181e0d27e95c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946121.223674:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0c00/0xd9f4181e0d27e95c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946121.223754:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+20:15587:x1877942616587904:12345-192.168.204.20@tcp:54:lfs.0 Request processed in 685us (2105us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946121.223762:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 41 00000100:00100000:1.0:1790946121.226012:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946121.226099:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616588288 00000100:00100000:2.0:1790946121.226111:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616588288 00000100:00100000:2.0:1790946121.226212:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:2.0:1790946121.226222:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+20:15587:x1877942616588288:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:2.0:1790946121.226657:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+21:15587:x1877942616588288:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 436us (655us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1790946121.226664:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:2.0:1790946121.426327:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946121.426676:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616588544 00000100:00100000:1.0:1790946121.426686:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616588544 00000100:00100000:1.0:1790946121.426789:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 42 00000100:00100000:1.0:1790946121.426799:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+21:15618:x1877942616588544:12345-192.168.204.20@tcp:101:cat.0 00010000:00010000:1.0:1790946121.426824:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946121.426845:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe400/0xd9f4181e0d27e963 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c22233101b expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.426949:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff600/0xd9f4181e0d27e96a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.426964:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff600/0xd9f4181e0d27e96a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.426975:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff600/0xd9f4181e0d27e96a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790946121.427004:0:17148:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1790946121.427150:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe400/0xd9f4181e0d27e963 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233101b expref: 24 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.427222:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff600/0xd9f4181e0d27e96a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233101b expref: 23 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.427698:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d4096cfd000) 00010000:00010000:1.0:1790946121.427701:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790946121.427705:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40813ff600, rc 0) 00000100:00100000:1.0:1790946121.427770:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+23:15618:x1877942616588544:12345-192.168.204.20@tcp:101:cat.0 Request processed in 972us (1454us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1790946121.427778:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 42 00000100:00100000:2.0:1790946121.431032:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946121.431070:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946121.431219:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616588800 00000100:00100000:3.0:1790946121.431241:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616588800 00000100:00100000:3.0:1790946121.431287:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 8 00000100:00100000:3.0:1790946121.431295:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+23:15618:x1877942616588800:12345-192.168.204.20@tcp:35:cat.0 00000100:00100000:3.0:1790946121.431569:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+24:15618:x1877942616588800:12345-192.168.204.20@tcp:35:cat.0 Request processed in 274us (543us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1790946121.431577:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 8 00000100:00100000:0.0:1790946121.433391:0:20188:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616588928 00000100:00100000:0.0:1790946121.433405:0:20188:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616588928 00000100:00100000:0.0:1790946121.433581:0:20188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1 00000100:00100000:0.0:1790946121.433591:0:20188:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ca604fcf-845a-4ff8-977f-a1d27931fa85+24:2403:x1877942616588928:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790946121.433607:0:20188:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946121.433632:0:20188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff600/0xd9f4181e0d27e96a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233101b expref: 24 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946121.433654:0:20188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d4096cfd000) 00010000:00010000:0.0:1790946121.433659:0:20188:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946121.433720:0:20188:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ca604fcf-845a-4ff8-977f-a1d27931fa85+23:2403:x1877942616588928:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 129us (2648us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946121.433737:0:20188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1 00000100:00100000:2.0:1790946121.480520:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946121.480633:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616589184 00000100:00100000:3.0:1790946121.480644:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616589184 00000100:00100000:3.0:1790946121.480706:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 43 00000100:00100000:3.0:1790946121.480717:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+23:15624:x1877942616589184:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:3.0:1790946121.480742:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946121.480765:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0c00/0xd9f4181e0d27e978 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222331022 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946121.480877:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1200/0xd9f4181e0d27e97f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946121.480894:0:17149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff400/0xd9f4181e0d27e91d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330fff expref: 24 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946121.480902:0:17149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e932 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331006 expref: 24 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946121.480910:0:17149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1200/0xd9f4181e0d27e97f lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946121.480945:0:17149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e932 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331006 expref: 24 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946121.480961:0:17149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e932 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331006 expref: 24 pid: 17149 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946121.480977:0:17149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17149:1877942638683008:192.168.204.20@tcp:104: 00010000:00010000:3.0:1790946121.481087:0:17149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff400/0xd9f4181e0d27e91d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330fff expref: 24 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946121.481106:0:17149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff400/0xd9f4181e0d27e91d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330fff expref: 24 pid: 17148 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946121.481116:0:17149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17149:1877942638683136:192.168.204.20@tcp:104: 00000100:00100000:3.0:1790946121.481153:0:17149:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f83f7c900 going to sleep for 11 seconds 00000100:00100000:2.0:1790946121.484499:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946121.484543:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946121.484643:0:17134:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616589312 00000100:00100000:1.0:1790946121.484652:0:17134:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616589312 00010000:00010000:1.0:1790946121.484692:0:17134:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e932 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331006 expref: 25 pid: 17149 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946121.484729:0:17134:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616589440 00000100:00100000:1.0:1790946121.484732:0:17134:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616589440 00010000:00010000:1.0:1790946121.484744:0:17134:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff400/0xd9f4181e0d27e91d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330fff expref: 26 pid: 17148 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946121.484767:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:1.0:1790946121.484776:0:17134:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+26:2403:x1877942616589312:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790946121.484790:0:17134:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946121.484809:0:17134:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e932 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331006 expref: 26 pid: 17149 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.484822:0:17134:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e932 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331006 expref: 26 pid: 17149 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.484845:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d4096cfd000) 00010000:00010000:1.0:1790946121.484850:0:17134:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1200/0xd9f4181e0d27e97f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.484858:0:17134:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1200/0xd9f4181e0d27e97f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.484864:0:17134:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946121.484916:0:17134:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+26:2403:x1877942616589312:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 140us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946121.484925:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:1.0:1790946121.484945:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 18 00000100:00100000:1.0:1790946121.484952:0:17134:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83d41050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+25:2403:x1877942616589440:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790946121.484959:0:17134:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946121.484964:0:17134:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff400/0xd9f4181e0d27e91d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330fff expref: 25 pid: 17148 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.484974:0:17134:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff400/0xd9f4181e0d27e91d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330fff expref: 25 pid: 17148 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.484985:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d4096cfd000) 00010000:00010000:1.0:1790946121.484988:0:17134:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1200/0xd9f4181e0d27e97f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.485002:0:17134:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1200/0xd9f4181e0d27e97f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.485009:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1200/0xd9f4181e0d27e97f lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.485027:0:17134:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946121.485046:0:17134:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83d41050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+25:2403:x1877942616589440:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 95us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946121.485052:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 18 00010000:00010000:3.0:1790946121.485641:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e932 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331006 expref: 24 pid: 17149 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946121.485658:0:17149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17149:1877942638683008:192.168.204.20@tcp:104: 00010000:00010000:3.0:1790946121.485670:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff400/0xd9f4181e0d27e91d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330fff expref: 23 pid: 17148 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946121.485679:0:17149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17149:1877942638683136:192.168.204.20@tcp:104: 00010000:00010000:3.0:1790946121.485697:0:17149:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1200/0xd9f4181e0d27e97f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946121.485705:0:17149:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1200/0xd9f4181e0d27e97f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946121.485712:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1200/0xd9f4181e0d27e97f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946121.485730:0:17149:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1790946121.485866:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0c00/0xd9f4181e0d27e978 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331022 expref: 24 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946121.485894:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1200/0xd9f4181e0d27e97f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331022 expref: 23 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946121.485901:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d4096cfd000) 00010000:00010000:3.0:1790946121.485904:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790946121.485906:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40baef1200, rc 0) 00000100:00100000:3.0:1790946121.485952:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+23:15624:x1877942616589184:12345-192.168.204.20@tcp:101:dd.0 Request processed in 5237us (5442us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1790946121.485959:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 43 00000100:00100000:2.0:1790946121.490466:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946121.490583:0:20141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616589568 00000100:00100000:3.0:1790946121.490594:0:20141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616589568 00000100:00100000:3.0:1790946121.490666:0:20141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 44 00000100:00100000:3.0:1790946121.490676:0:20141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca604fcf-845a-4ff8-977f-a1d27931fa85+23:15624:x1877942616589568:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:3.0:1790946121.490700:0:20141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946121.490720:0:20141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0000/0xd9f4181e0d27e98d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222331029 expref: -99 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946121.490756:0:20141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031e00/0xd9f4181e0d27e994 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946121.490770:0:20141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031e00/0xd9f4181e0d27e994 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946121.490781:0:20141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031e00/0xd9f4181e0d27e994 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946121.490898:0:20141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0000/0xd9f4181e0d27e98d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331029 expref: 25 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946121.490924:0:20141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031e00/0xd9f4181e0d27e994 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331029 expref: 24 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946121.490933:0:20141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d4096cfd000) 00010000:00010000:3.0:1790946121.490936:0:20141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790946121.490939:0:20141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4080031e00, rc 0) 00000100:00100000:3.0:1790946121.491003:0:20141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca604fcf-845a-4ff8-977f-a1d27931fa85+24:15624:x1877942616589568:12345-192.168.204.20@tcp:101:dd.0 Request processed in 328us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946121.491011:0:20141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 44 00000100:00100000:2.0:1790946121.493917:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946121.494554:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616589824 00000100:00100000:1.0:1790946121.494564:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616589824 00000100:00100000:1.0:1790946121.494656:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 45 00000100:00100000:1.0:1790946121.494667:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca604fcf-845a-4ff8-977f-a1d27931fa85+24:15624:x1877942616589824:12345-192.168.204.20@tcp:36:dd.0 00010000:00010000:1.0:1790946121.494876:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ffe00/0xd9f4181e0d27e99b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.494894:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ffe00/0xd9f4181e0d27e99b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.494903:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ffe00/0xd9f4181e0d27e99b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790946121.494944:0:17147:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1790946121.494967:0:17147:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a662efa3 reply state 0000000010f49b81 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ffe00/0xd9f4181e0d27e99b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.494979:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ffe00/0xd9f4181e0d27e99b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.495006:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d4096cfd000) 00010000:00010000:1.0:1790946121.495009:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790946121.495013:0:17147:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790946121.495103:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca604fcf-845a-4ff8-977f-a1d27931fa85+27:15624:x1877942616589824:12345-192.168.204.20@tcp:36:dd.0 Request processed in 438us (1196us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1790946121.495111:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 45 00000020:00080000:1.0:1790946121.495115:0:17147:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1790946121.500281:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946121.500603:0:20141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616589952 00000100:00100000:3.0:1790946121.500668:0:20141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616589952 00000100:00100000:3.0:1790946121.500755:0:20141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 46 00000100:00100000:3.0:1790946121.500765:0:20141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca604fcf-845a-4ff8-977f-a1d27931fa85+27:15624:x1877942616589952:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:3.0:1790946121.500796:0:20141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946121.500816:0:20141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e9a2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222331030 expref: -99 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946121.500868:0:20141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e9a2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331030 expref: 28 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946121.500882:0:20141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e9a2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331030 expref: 28 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946121.500899:0:20141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d4096cfd000) 00010000:00010000:3.0:1790946121.500902:0:20141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790946121.500917:0:20141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4080030a00, rc 0) 00000100:00100000:3.0:1790946121.500969:0:20141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca604fcf-845a-4ff8-977f-a1d27931fa85+28:15624:x1877942616589952:12345-192.168.204.20@tcp:101:dd.0 Request processed in 206us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946121.500976:0:20141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 46 00000040:00080000:1.0:1790946121.505195:0:17181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790946121.516507:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946121.516600:0:17134:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616590208 00000100:00100000:1.0:1790946121.516618:0:17134:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616590208 00000100:00100000:1.0:1790946121.516685:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2 00000100:00100000:1.0:1790946121.516695:0:17134:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+28:15624:x1877942616590208:12345-192.168.204.20@tcp:103:dd.0 00010000:00010000:1.0:1790946121.516709:0:17134:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946121.516731:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27e9a2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331030 expref: 28 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.516749:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d4096cfd000) 00010000:00010000:1.0:1790946121.516753:0:17134:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946121.516810:0:17134:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+27:15624:x1877942616590208:12345-192.168.204.20@tcp:103:dd.0 Request processed in 117us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946121.516818:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2 00000100:00100000:0.0:1790946121.521812:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946121.521888:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616590336 00000100:00100000:3.0:1790946121.521898:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616590336 00000100:00100000:3.0:1790946121.521998:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 47 00000100:00100000:3.0:1790946121.522008:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+27:15624:x1877942616590336:12345-192.168.204.20@tcp:58:dd.0 00010000:00010000:3.0:1790946121.522110:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0000/0xd9f4181e0d27e9a9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946121.522136:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0000/0xd9f4181e0d27e9a9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946121.522146:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0000/0xd9f4181e0d27e9a9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790946121.523917:0:17149:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790946121.524498:0:17149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1790946121.524734:0:17149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1790946121.524851:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+27:15624:x1877942616590336:12345-192.168.204.20@tcp:58:dd.0 Request processed in 2839us (3042us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946121.524861:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 47 00000100:00100000:3.0:1790946121.527970:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946121.528061:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616590464 00000100:00100000:1.0:1790946121.528072:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616590464 00000100:00100000:1.0:1790946121.528145:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 48 00000100:00100000:1.0:1790946121.528155:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+27:15624:x1877942616590464:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:1.0:1790946121.528227:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946121.528247:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff000/0xd9f4181e0d27e9b0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222331037 expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.528309:0:17148:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0000/0xd9f4181e0d27e9a9 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.528321:0:17148:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff000/0xd9f4181e0d27e9b0 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331037 expref: 28 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.528341:0:17148:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0000/0xd9f4181e0d27e9a9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.528354:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff000/0xd9f4181e0d27e9b0 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331037 expref: 28 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.528367:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d4096cfd000) 00010000:00010000:1.0:1790946121.528371:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790946121.528374:0:17148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff000/0xd9f4181e0d27e9b0 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331037 expref: 28 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946121.528382:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40813ff000, rc 0) 00000100:00100000:1.0:1790946121.528437:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+28:15624:x1877942616590464:12345-192.168.204.20@tcp:101:dd.0 Request processed in 284us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946121.528445:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 48 00000040:00080000:0.0:1790946121.887889:0:17919:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790946122.017261:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790946122.527389:0:17181:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1790946122.527413:0:17181:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790946122.527780:0:17181:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1790946122.527795:0:17181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1790946122.527933:0:17181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff96d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17181:1877942638683264:192.168.204.20@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790946122.528813:0:17181:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408554e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790946122.533539:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946122.533603:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616590592 00000100:00100000:0.0:1790946122.533612:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616590592 00000100:00100000:0.0:1790946122.533700:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 49 00000100:00100000:0.0:1790946122.533710:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca604fcf-845a-4ff8-977f-a1d27931fa85+29:15626:x1877942616590592:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790946122.533742:0:17147:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790946122.533884:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca604fcf-845a-4ff8-977f-a1d27931fa85+29:15626:x1877942616590592:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 Request processed in 175us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946122.533893:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 49 00000100:00080000:2.0:1790946122.534195:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790946122.534285:0:17181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff96d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17181:1877942638683264:192.168.204.20@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790946122.536679:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946122.537212:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616590720 00000100:00100000:1.0:1790946122.537222:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616590720 00000100:00100000:1.0:1790946122.537280:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 50 00000100:00100000:1.0:1790946122.537290:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+28:15626:x1877942616590720:12345-192.168.204.20@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1790946122.537367:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27e9b7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946122.537384:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27e9b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946122.537398:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27e9b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946122.537425:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27e9be lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946122.537434:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27e9be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946122.537441:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27e9be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946122.537475:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27e9c5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946122.537485:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27e9c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946122.537570:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27e9c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790946122.537614:0:17148:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1790946122.537618:0:17148:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790946122.537630:0:17148:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27e9c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946122.537640:0:17148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27e9b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946122.537646:0:17148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27e9b7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946122.537653:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27e9b7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946122.537844:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40813fe800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:1.0:1790946122.537849:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27e9b7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946122.537858:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27e9b7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946122.537870:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3f83415000) 00010000:00010000:1.0:1790946122.537872:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946122.537877:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27e9b7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946122.537883:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27e9b7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946122.537909:0:17148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27e9be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946122.537916:0:17148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27e9be lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946122.537922:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27e9be lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946122.537927:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40813ff800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:1.0:1790946122.537930:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27e9be lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946122.537935:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27e9be lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946122.537942:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9d4096cfd100) 00010000:00010000:1.0:1790946122.537944:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946122.537947:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27e9be lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946122.538090:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27e9be lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946122.538164:0:17148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27e9c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946122.538218:0:17148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27e9c5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946122.538225:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27e9c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946122.538236:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40813fea00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:1.0:1790946122.538240:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27e9c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946122.538246:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27e9c5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946122.538254:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d4096cfd000) 00010000:00010000:1.0:1790946122.538256:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946122.538260:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27e9c5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946122.538266:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27e9c5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946122.538359:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+28:15626:x1877942616590720:12345-192.168.204.20@tcp:34:lhsmtool_posix.0 Request processed in 1068us (1688us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946122.538368:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 50 00000100:00100000:3.0:1790946122.546632:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946122.546908:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616590976 00000100:00100000:0.0:1790946122.546919:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616590976 00000100:00100000:0.0:1790946122.547029:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 51 00000100:00100000:0.0:1790946122.547039:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+28:15626:x1877942616590976:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790946122.547060:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946122.547078:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27e9cc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c22233103e expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.547224:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27e9d3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.547241:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27e9d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.547253:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27e9d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790946122.547265:0:17149:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1790946122.547345:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27e9d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.547353:0:17149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27e9d3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.547360:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27e9d3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.547366:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65000 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790946122.547370:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27e9d3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.547377:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27e9d3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.547415:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d4096cfd000) 00010000:00010000:0.0:1790946122.547418:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790946122.547423:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27e9d3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.547430:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27e9d3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.547995:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27e9cc lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233103e expref: 30 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.548008:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3f83415000) 00010000:00010000:0.0:1790946122.548012:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790946122.548016:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27e9cc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233103e expref: 30 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.548028:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c65e00, rc 0) 00000100:00100000:0.0:1790946122.548114:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+29:15626:x1877942616590976:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 1060us (1477us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1790946122.548123:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 51 00000100:00100000:3.0:1790946122.551264:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946122.551344:0:20141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616591104 00000100:00100000:2.0:1790946122.551355:0:20141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616591104 00000100:00100000:2.0:1790946122.551426:0:20141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 52 00000100:00100000:2.0:1790946122.551445:0:20141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca604fcf-845a-4ff8-977f-a1d27931fa85+29:15626:x1877942616591104:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790946122.551681:0:20141:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790946122.551811:0:20141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca604fcf-845a-4ff8-977f-a1d27931fa85+29:15626:x1877942616591104:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 Request processed in 376us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946122.551818:0:20141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 52 00000100:00100000:2.0:1790946122.557124:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946122.557257:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616591360 00000100:00100000:1.0:1790946122.557267:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616591360 00000100:00100000:1.0:1790946122.557324:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 53 00000100:00100000:1.0:1790946122.557334:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca604fcf-845a-4ff8-977f-a1d27931fa85+29:15626:x1877942616591360:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790946122.557356:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946122.557377:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27e9e1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222331045 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790946122.558776:0:17147:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =28 00000004:00080000:1.0:1790946122.558787:0:17147:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+28 in llog 00000004:00080000:1.0:1790946122.558822:0:17147:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:1.0:1790946122.559922:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27e9e8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946122.559943:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27e9e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946122.560793:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27e9e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946122.561328:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27e9e1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331045 expref: 32 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946122.561351:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27e9e8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331045 expref: 31 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946122.561360:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d4096cfd100) 00010000:00010000:1.0:1790946122.561363:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790946122.561367:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40813ff800, rc 0) 00000100:00100000:1.0:1790946122.561478:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca604fcf-845a-4ff8-977f-a1d27931fa85+31:15626:x1877942616591360:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 4145us (4363us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1790946122.561487:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 53 00000100:00100000:3.0:1790946122.567622:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946122.567772:0:20141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616591616 00000100:00100000:2.0:1790946122.567784:0:20141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616591616 00000100:00100000:2.0:1790946122.567863:0:20141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 54 00000100:00100000:2.0:1790946122.567873:0:20141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca604fcf-845a-4ff8-977f-a1d27931fa85+31:15626:x1877942616591616:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790946122.567937:0:20141:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946122.568137:0:20141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff800/0xd9f4181e0d27e9e8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331045 expref: 31 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946122.568159:0:20141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d4096cfd100) 00010000:00010000:2.0:1790946122.568213:0:20141:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790946122.568239:0:20141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6000/0xd9f4181e0d27e9f6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946122.568269:0:20141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6000/0xd9f4181e0d27e9f6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946122.568279:0:20141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6000/0xd9f4181e0d27e9f6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946122.568294:0:20141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d7800/0xd9f4181e0d27e9fd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x63bed9ee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946122.568302:0:20141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d7800/0xd9f4181e0d27e9fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x63bed9ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946122.568309:0:20141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d7800/0xd9f4181e0d27e9fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x63bed9ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946122.568365:0:20141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6000/0xd9f4181e0d27e9f6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946122.568374:0:20141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6000/0xd9f4181e0d27e9f6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946122.568381:0:20141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6000/0xd9f4181e0d27e9f6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946122.568388:0:20141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d6000 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790946122.568392:0:20141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6000/0xd9f4181e0d27e9f6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946122.568400:0:20141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6000/0xd9f4181e0d27e9f6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946122.568426:0:20141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d3f83415600) 00010000:00010000:2.0:1790946122.568445:0:20141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946122.568451:0:20141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6000/0xd9f4181e0d27e9f6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946122.568458:0:20141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6000/0xd9f4181e0d27e9f6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946122.568480:0:20141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d7800/0xd9f4181e0d27e9fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x63bed9ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946122.568486:0:20141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d7800/0xd9f4181e0d27e9fd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x63bed9ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946122.568565:0:20141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d7800/0xd9f4181e0d27e9fd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x63bed9ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946122.568572:0:20141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d7800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790946122.568575:0:20141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d7800/0xd9f4181e0d27e9fd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x63bed9ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946122.568583:0:20141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d7800/0xd9f4181e0d27e9fd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x63bed9ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946122.568592:0:20141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x63bed9ee (ffff9d3f824e9400) 00010000:00010000:2.0:1790946122.568595:0:20141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946122.568598:0:20141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d7800/0xd9f4181e0d27e9fd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x63bed9ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946122.568605:0:20141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d7800/0xd9f4181e0d27e9fd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x63bed9ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946122.568842:0:20141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca604fcf-845a-4ff8-977f-a1d27931fa85+30:15626:x1877942616591616:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 968us (1228us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790946122.569081:0:20141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 54 00000100:00100000:3.0:1790946122.575060:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946122.576016:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616591744 00000100:00100000:0.0:1790946122.576029:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616591744 00000100:00100000:0.0:1790946122.576569:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 55 00000100:00100000:0.0:1790946122.576583:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+30:15626:x1877942616591744:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790946122.576610:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946122.576650:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27ea04 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c22233104c expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.576720:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27ea0b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.576733:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27ea0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.576745:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27ea0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.577026:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27ea04 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233104c expref: 32 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.577053:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27ea0b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233104c expref: 31 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.577063:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d40bc9af800) 00010000:00010000:0.0:1790946122.577067:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790946122.577073:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c65000, rc 0) 00000100:00100000:0.0:1790946122.577230:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+31:15626:x1877942616591744:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 649us (2179us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946122.577240:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 55 00000100:00100000:3.0:1790946122.582992:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946122.583413:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616592000 00000100:00100000:1.0:1790946122.583425:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616592000 00000100:00100000:1.0:1790946122.583498:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 56 00000100:00100000:1.0:1790946122.583508:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+31:15626:x1877942616592000:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790946122.585259:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27ea12 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946122.585303:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27ea12 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946122.585315:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27ea12 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790946122.585500:0:17148:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1790946122.585511:0:17148:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 573401342374ns, next at 574401339936ns, rc = 0 00000004:00010000:1.0:1790946122.585582:0:17148:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a4ead790 reply state 0000000074cac17d transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27ea12 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946122.585605:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27ea12 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946122.585613:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d40bc9af800) 00010000:00010000:1.0:1790946122.585616:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1790946122.585620:0:17148:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790946122.586399:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+33:15626:x1877942616592000:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 2887us (3414us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1790946122.586410:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 56 00000100:00100000:3.0:1790946122.595310:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946122.595634:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616592128 00000100:00100000:1.0:1790946122.595654:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616592128 00000100:00100000:1.0:1790946122.595727:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 57 00000100:00100000:1.0:1790946122.595745:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca604fcf-845a-4ff8-977f-a1d27931fa85+33:15626:x1877942616592128:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790946122.595778:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946122.595803:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27ea19 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222331053 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946122.595898:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27ea19 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331053 expref: 34 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946122.595915:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27ea19 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331053 expref: 34 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946122.595938:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d40bc9af800) 00010000:00010000:1.0:1790946122.595941:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790946122.595945:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40813fe800, rc 0) 00000100:00100000:1.0:1790946122.596027:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca604fcf-845a-4ff8-977f-a1d27931fa85+34:15626:x1877942616592128:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 289us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946122.596036:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 57 00000100:00100000:2.0:1790946122.601831:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946122.602015:0:19252:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616592256 00000100:00100000:0.0:1790946122.602026:0:19252:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616592256 00000100:00100000:0.0:1790946122.602114:0:19252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 20 00000100:00100000:0.0:1790946122.602125:0:19252:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ca604fcf-845a-4ff8-977f-a1d27931fa85+5:2404:x1877942616592256:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1790946122.602711:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790946122.604071:0:19252:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ca604fcf-845a-4ff8-977f-a1d27931fa85+6:2404:x1877942616592256:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 Request processed in 1939us (2240us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1790946122.604098:0:19252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 20 00000100:00100000:3.0:1790946122.608492:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946122.608602:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616592512 00000100:00100000:2.0:1790946122.608614:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616592512 00000100:00100000:2.0:1790946122.608688:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:2.0:1790946122.608700:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+34:15626:x1877942616592512:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790946122.609206:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+35:15626:x1877942616592512:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 Request processed in 505us (721us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1790946122.609216:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:3.0:1790946122.614433:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946122.614831:0:20141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616592768 00000100:00100000:2.0:1790946122.614843:0:20141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616592768 00000100:00100000:2.0:1790946122.615798:0:20141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 58 00000100:00100000:2.0:1790946122.615813:0:20141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ded500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca604fcf-845a-4ff8-977f-a1d27931fa85+35:15626:x1877942616592768:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790946122.615956:0:20141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ded500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca604fcf-845a-4ff8-977f-a1d27931fa85+35:15626:x1877942616592768:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 146us (1531us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946122.615972:0:20141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 58 00000100:00100000:1.0:1790946122.622636:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946122.623310:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616592896 00000100:00100000:0.0:1790946122.623321:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616592896 00000100:00100000:0.0:1790946122.623379:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 59 00000100:00100000:0.0:1790946122.623388:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+35:15626:x1877942616592896:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790946122.623418:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946122.623447:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27ea20 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c22233105a expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.623536:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64c00/0xd9f4181e0d27ea27 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.623552:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64c00/0xd9f4181e0d27ea27 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.623562:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64c00/0xd9f4181e0d27ea27 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790946122.623609:0:17149:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790946122.623627:0:17149:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64c00/0xd9f4181e0d27ea27 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.623653:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65e00/0xd9f4181e0d27ea20 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233105a expref: 37 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.623684:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64c00/0xd9f4181e0d27ea27 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233105a expref: 36 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.623694:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d40bc9af800) 00010000:00010000:0.0:1790946122.623711:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790946122.623715:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c64c00, rc 0) 00000100:00100000:0.0:1790946122.623786:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+36:15626:x1877942616592896:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 398us (1160us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946122.623794:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 59 00000100:00100000:2.0:1790946122.637934:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946122.643646:0:18667:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616593024 00000100:00100000:0.0:1790946122.643733:0:18667:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616593024 00000100:00100000:0.0:1790946122.643863:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 21 00000100:00100000:0.0:1790946122.643875:0:18667:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+6:2403:x1877942616593024:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790946122.643895:0:18667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946122.643917:0:18667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aaf3bb43/0xd9f4181e0d27ea2e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222331061 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790946122.643943:0:18667:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abfab4a, blocks: 0x0 00010000:00010000:0.0:1790946122.643973:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1790946122.643979:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946122.643988:0:18667:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aaf3bb43/0xd9f4181e0d27ea2e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331061 expref: 7 pid: 18667 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.644008:0:18667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000aaf3bb43/0xd9f4181e0d27ea2e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331061 expref: 7 pid: 18667 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.644031:0:18667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c65e00, rc 0) 00000100:00100000:0.0:1790946122.644100:0:18667:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+7:2403:x1877942616593024:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 227us (6177us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946122.644108:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 21 00000100:00100000:1.0:1790946122.646856:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946122.647000:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616593280 00000100:00100000:3.0:1790946122.647010:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616593280 00000100:00100000:3.0:1790946122.647108:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 60 00000100:00100000:3.0:1790946122.647118:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+36:15626:x1877942616593280:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790946122.647275:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+36:15626:x1877942616593280:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 156us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946122.647282:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 60 00000100:00100000:1.0:1790946122.655316:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946122.655436:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616593408 00000100:00100000:0.0:1790946122.655447:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616593408 00000100:00100000:0.0:1790946122.655606:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 61 00000100:00100000:0.0:1790946122.655618:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+36:15626:x1877942616593408:12345-192.168.204.20@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1790946122.663374:0:17127:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1790946122.663395:0:17127:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1790946122.663449:0:17127:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:0.0:1790946122.663571:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27e867 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.663584:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27e867 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.663593:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27e867 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.663599:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef1400 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790946122.663603:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27e867 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.663611:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27e867 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.663628:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d3f83415a00) 00010000:00010000:0.0:1790946122.663631:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946122.663636:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27e867 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.663642:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27e867 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.663665:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27e86e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.663688:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27e86e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.663694:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27e86e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.663699:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef0400 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790946122.663702:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27e86e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.663708:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27e86e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.663717:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d3f83415600) 00010000:00010000:0.0:1790946122.663719:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946122.663723:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27e86e lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.663729:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27e86e lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.663740:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27e8bb lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.663745:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff200/0xd9f4181e0d27e916 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.663756:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27e8bb lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.663758:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff200/0xd9f4181e0d27e916 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.663775:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27e8bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.663776:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff200/0xd9f4181e0d27e916 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.663794:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe1c00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790946122.663794:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40813ff200 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790946122.663800:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27e8bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.663807:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff200/0xd9f4181e0d27e916 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.663812:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27e8bb lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.663825:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d3f83415600) 00010000:00010000:3.0:1790946122.663828:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1790946122.663829:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff200/0xd9f4181e0d27e916 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.663841:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27e8bb lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.663842:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9d4096cfd700) 00010000:00010000:0.0:1790946122.663849:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946122.663854:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff200/0xd9f4181e0d27e916 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.663856:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe1c00/0xd9f4181e0d27e8bb lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.663869:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff200/0xd9f4181e0d27e916 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.663889:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ffe00/0xd9f4181e0d27e99b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.663896:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ffe00/0xd9f4181e0d27e99b lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.663903:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ffe00/0xd9f4181e0d27e99b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.663907:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40813ffe00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790946122.663910:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ffe00/0xd9f4181e0d27e99b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.663916:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ffe00/0xd9f4181e0d27e99b lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.663923:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d4096cfd000) 00010000:00010000:0.0:1790946122.663925:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946122.663934:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ffe00/0xd9f4181e0d27e99b lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.663941:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ffe00/0xd9f4181e0d27e99b lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.663953:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27ea12 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.663959:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27ea12 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.663965:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27ea12 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.663970:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40813fea00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790946122.663972:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27ea12 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.663978:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27ea12 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.663997:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d40bc9af800) 00010000:00010000:0.0:1790946122.664000:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790946122.664003:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27ea12 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.664008:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fea00/0xd9f4181e0d27ea12 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946122.664104:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790946122.664122:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83c35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638683392:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1790946122.664147:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+15:15626:x1877942616593408:12345-192.168.204.20@tcp:44:lhsmtool_posix.0 Request processed in 8529us (8990us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946122.664157:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 61 00000100:00100000:3.0:1790946122.664232:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946122.664278:0:18669:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638683392 00000100:00100000:3.0:1790946122.664286:0:18669:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638683392 00000100:00100000:3.0:1790946122.664336:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790946122.664346:0:18669:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bacef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638683392:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1790946122.664485:0:18669:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1790946122.664489:0:18669:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1790946122.664491:0:18669:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1790946122.664493:0:18669:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1790946122 -> 1790946122 00002000:00010000:3.0:1790946122.664496:0:18669:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1790946122.664532:0:18669:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bacef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3650:x1877942638683392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 188us (302us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1790946122.664539:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:3.0:1790946122.664577:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d3f83c35880/2, rc 0, transno 8589934596 00000100:00100000:3.0:1790946122.664583:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83c35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638683392:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1790946122.671155:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946122.671276:0:19252:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616593536 00000100:00100000:0.0:1790946122.671288:0:19252:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616593536 00000100:00100000:0.0:1790946122.671362:0:19252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 23 00000100:00100000:0.0:1790946122.671371:0:19252:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bacef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ca604fcf-845a-4ff8-977f-a1d27931fa85+7:2401:x1877942616593536:12345-192.168.204.20@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1790946122.671476:0:19252:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bacef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ca604fcf-845a-4ff8-977f-a1d27931fa85+7:2401:x1877942616593536:12345-192.168.204.20@tcp:16:lhsmtool_posix.0 Request processed in 105us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946122.671484:0:19252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 23 00000100:00100000:2.0:1790946122.677037:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946122.677354:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616593792 00000100:00100000:3.0:1790946122.677365:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616593792 00000100:00100000:3.0:1790946122.677431:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 62 00000100:00100000:3.0:1790946122.677442:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+15:15626:x1877942616593792:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790946122.677550:0:17148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946122.677580:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64c00/0xd9f4181e0d27ea27 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233105a expref: 15 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.677600:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d40bc9af800) 00010000:00010000:3.0:1790946122.677604:0:17148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790946122.677633:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0c00/0xd9f4181e0d27ea35 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.677647:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0c00/0xd9f4181e0d27ea35 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.677657:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0c00/0xd9f4181e0d27ea35 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790946122.677795:0:17148:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009f7f3e52 reply state 00000000b1066f7b transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0c00/0xd9f4181e0d27ea35 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.677808:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0c00/0xd9f4181e0d27ea35 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.677814:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d40bc9af800) 00010000:00010000:3.0:1790946122.677817:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790946122.677819:0:17148:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790946122.677931:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+16:15626:x1877942616593792:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 491us (903us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1790946122.677939:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 62 00000100:00100000:1.0:1790946122.683787:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946122.683858:0:18667:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616593920 00000100:00100000:0.0:1790946122.683868:0:18667:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616593920 00000100:00100000:0.0:1790946122.683958:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 24 00000100:00100000:0.0:1790946122.683969:0:18667:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+7:2403:x1877942616593920:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1790946122.684118:0:18667:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1790946122.684122:0:18667:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1790946121 00002000:00010000:0.0:1790946122.684124:0:18667:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1790946121 00002000:00010000:0.0:1790946122.684127:0:18667:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1790946122 -> 1790946121 00002000:00010000:0.0:1790946122.684129:0:18667:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1790946122.684227:0:18667:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+8:2403:x1877942616593920:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 Request processed in 260us (451us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1790946122.684235:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 24 00000100:00100000:2.0:1790946122.691078:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946122.691324:0:19563:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616594048 00000100:00100000:0.0:1790946122.691335:0:19563:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616594048 00000100:00100000:0.0:1790946122.691440:0:19563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 25 00000100:00100000:0.0:1790946122.691452:0:19563:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ca604fcf-845a-4ff8-977f-a1d27931fa85+8:2404:x1877942616594048:12345-192.168.204.20@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1790946122.691513:0:19563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008a9ba27d/0xd9f4181e0d27ea3c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.691551:0:19563:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946122.691556:0:19563:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946122.691562:0:19563:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a9ba27d/0xd9f4181e0d27ea3c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.691577:0:19563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a9ba27d/0xd9f4181e0d27ea3c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.691602:0:19563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008a9ba27d/0xd9f4181e0d27ea3c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.691612:0:19563:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a9ba27d/0xd9f4181e0d27ea3c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.691621:0:19563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a9ba27d/0xd9f4181e0d27ea3c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.691628:0:19563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65c00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:0.0:1790946122.691632:0:19563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a9ba27d/0xd9f4181e0d27ea3c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.691641:0:19563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a9ba27d/0xd9f4181e0d27ea3c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.691656:0:19563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a9ba27d/0xd9f4181e0d27ea3c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.691671:0:19563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a9ba27d/0xd9f4181e0d27ea3c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946122.691793:0:19563:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ca604fcf-845a-4ff8-977f-a1d27931fa85+8:2404:x1877942616594048:12345-192.168.204.20@tcp:1:lhsmtool_posix.0 Request processed in 343us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946122.691801:0:19563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 25 00000100:00100000:2.0:1790946122.706157:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946122.706369:0:20141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616594304 00000100:00100000:3.0:1790946122.706379:0:20141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616594304 00000100:00100000:3.0:1790946122.706453:0:20141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 63 00000100:00100000:3.0:1790946122.706488:0:20141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca604fcf-845a-4ff8-977f-a1d27931fa85+16:15626:x1877942616594304:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1790946122.706577:0:20141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27ea43 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.706596:0:20141:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031e00/0xd9f4181e0d27e994 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331029 expref: 16 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.706607:0:20141:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27ea43 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.706648:0:20141:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031e00/0xd9f4181e0d27e994 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331029 expref: 16 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.706664:0:20141:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031e00/0xd9f4181e0d27e994 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331029 expref: 16 pid: 20141 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946122.706680:0:20141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40baced180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20141:1877942638683520:192.168.204.20@tcp:104: 00000100:00100000:3.0:1790946122.706770:0:20141:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f83f7ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790946122.709995:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946122.710111:0:20141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40baced180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20141:1877942638683520:192.168.204.20@tcp:104: 00010000:00010000:3.0:1790946122.710136:0:20141:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27ea43 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946122.710842:0:20188:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616594432 00000100:00100000:2.0:1790946122.710850:0:20188:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616594432 00010000:00010000:2.0:1790946122.710888:0:20188:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031e00/0xd9f4181e0d27e994 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331029 expref: 17 pid: 20141 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946122.710949:0:20188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:2.0:1790946122.710958:0:20188:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ca604fcf-845a-4ff8-977f-a1d27931fa85+17:2403:x1877942616594432:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790946122.710975:0:20188:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946122.710981:0:20188:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031e00/0xd9f4181e0d27e994 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331029 expref: 17 pid: 20141 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946122.710993:0:20188:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031e00/0xd9f4181e0d27e994 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331029 expref: 17 pid: 20141 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946122.711013:0:20188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031e00/0xd9f4181e0d27e994 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331029 expref: 17 pid: 20141 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946122.711041:0:20188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d4096cfd000) 00010000:00010000:2.0:1790946122.711047:0:20188:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff000/0xd9f4181e0d27e9b0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331037 expref: 16 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946122.711056:0:20188:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27ea43 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946122.711064:0:20188:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27ea43 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946122.711070:0:20188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27ea43 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946122.711368:0:20188:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790946122.711422:0:20188:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ca604fcf-845a-4ff8-977f-a1d27931fa85+16:2403:x1877942616594432:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 465us (1436us total) trans 0 rc 0/0 00010000:00010000:3.0:1790946122.714720:0:20141:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27ea43 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.714739:0:20141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27ea43 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.714967:0:20141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27ea4a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.714993:0:20141:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27ea19 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331053 expref: 17 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.715002:0:20141:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27ea4a lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.715043:0:20141:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27ea19 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331053 expref: 17 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.715058:0:20141:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27ea19 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331053 expref: 17 pid: 17147 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946122.715073:0:20141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40baced180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20141:1877942638683648:192.168.204.20@tcp:104: 00000100:00100000:2.0:1790946122.715401:0:20188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:3.0:1790946122.716771:0:20141:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f83f7c000 going to sleep for 11 seconds 00000100:00100000:1.0:1790946122.726200:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946122.726439:0:17134:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616594560 00000100:00100000:2.0:1790946122.726449:0:17134:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616594560 00010000:00010000:2.0:1790946122.726503:0:17134:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27ea19 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331053 expref: 17 pid: 17147 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946122.726551:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 20 00000100:00100000:2.0:1790946122.726569:0:17134:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4087238700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+17:2404:x1877942616594560:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790946122.726585:0:17134:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946122.726592:0:17134:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27ea19 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331053 expref: 17 pid: 17147 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946122.726606:0:17134:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27ea19 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331053 expref: 17 pid: 17147 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946122.726631:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d40bc9af800) 00010000:00010000:2.0:1790946122.726636:0:17134:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27ea4a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946122.726648:0:17134:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27ea4a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946122.726655:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27ea4a lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946122.726676:0:17134:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790946122.726743:0:17134:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4087238700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+17:2404:x1877942616594560:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 182us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946122.726766:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 20 00010000:00010000:3.0:1790946122.727645:0:20141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813fe800/0xd9f4181e0d27ea19 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331053 expref: 16 pid: 17147 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946122.727667:0:20141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40baced180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20141:1877942638683648:192.168.204.20@tcp:104: 00010000:00010000:3.0:1790946122.727687:0:20141:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27ea4a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.727695:0:20141:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27ea4a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.727701:0:20141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27ea4a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790946122.727811:0:20141:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:3.0:1790946122.727940:0:20141:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:3.0:1790946122.727973:0:20141:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:3.0:1790946122.728047:0:20141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40baced180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:20141:1877942638683776:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1790946122.728097:0:20141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946122.728136:0:20141:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f83f7c300 going to sleep for 11 seconds 00000100:00100000:0.0:1790946122.728666:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638683776 00000100:00100000:0.0:1790946122.728675:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638683776 00000100:00100000:0.0:1790946122.728729:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790946122.728738:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40baced500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:20141:x1877942638683776:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1790946122.728855:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40baced500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:20141:x1877942638683776:12345-0@lo:1000:mdt00_003.0 Request processed in 119us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946122.728863:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790946122.729658:0:20141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40baced180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:20141:1877942638683776:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1790946122.729867:0:20141:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1790946122.729947:0:20141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40baced180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:20141:1877942638683904:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1790946122.729991:0:20141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946122.730023:0:20141:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f83f7c600 going to sleep for 11 seconds 00000100:00100000:2.0:1790946122.731584:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638683904 00000100:00100000:2.0:1790946122.731599:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638683904 00000100:00100000:2.0:1790946122.731671:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790946122.731682:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:20141:x1877942638683904:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1790946122.731871:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:20141:x1877942638683904:12345-0@lo:1000:mdt00_003.0 Request processed in 192us (1879us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1790946122.731879:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790946122.732329:0:20141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40baced180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:20141:1877942638683904:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1790946122.732376:0:20141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27ea4a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.732387:0:20141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27ea4a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.732394:0:20141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27ea4a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.732399:0:20141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef1400 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790946122.732404:0:20141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27ea4a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.732411:0:20141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27ea4a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.732426:0:20141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d40bc9af800) 00010000:00010000:3.0:1790946122.732429:0:20141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790946122.732450:0:20141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27ea4a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.732456:0:20141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1400/0xd9f4181e0d27ea4a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.732510:0:20141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0000/0xd9f4181e0d27e9a9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.732517:0:20141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0000/0xd9f4181e0d27e9a9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.732522:0:20141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0000/0xd9f4181e0d27e9a9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.732527:0:20141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef0000 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790946122.732529:0:20141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0000/0xd9f4181e0d27e9a9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.732535:0:20141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0000/0xd9f4181e0d27e9a9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.732542:0:20141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d4096cfd000) 00010000:00010000:3.0:1790946122.732545:0:20141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790946122.732563:0:20141:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff000/0xd9f4181e0d27e9b0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331037 expref: 19 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.732578:0:20141:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff000/0xd9f4181e0d27e9b0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331037 expref: 19 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.732587:0:20141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff000/0xd9f4181e0d27e9b0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331037 expref: 19 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.732662:0:20141:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff000/0xd9f4181e0d27e9b0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331037 expref: 19 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946122.732678:0:20141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f833f0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20141:1877942638684032:192.168.204.20@tcp:105: 00000100:00100000:3.0:1790946122.732752:0:20141:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f83f7c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790946122.736112:0:20141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f833f0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20141:1877942638684032:192.168.204.20@tcp:105: 00010000:00010000:3.0:1790946122.736143:0:20141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0000/0xd9f4181e0d27e9a9 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.736153:0:20141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0000/0xd9f4181e0d27e9a9 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.736227:0:20141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40814a2e00/0xd9f4181e0d27ea51 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.736243:0:20141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40814a2e00/0xd9f4181e0d27ea51 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.736255:0:20141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40814a2e00/0xd9f4181e0d27ea51 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.736266:0:20141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40814a2e00/0xd9f4181e0d27ea51 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.736273:0:20141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40814a2e00/0xd9f4181e0d27ea51 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.736280:0:20141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40814a2e00/0xd9f4181e0d27ea51 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.736306:0:20141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40814a2e00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790946122.736310:0:20141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40814a2e00/0xd9f4181e0d27ea51 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.736317:0:20141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40814a2e00/0xd9f4181e0d27ea51 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.736330:0:20141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d4096cfd000) 00010000:00010000:3.0:1790946122.736332:0:20141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946122.736336:0:20141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40814a2e00/0xd9f4181e0d27ea51 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.736342:0:20141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40814a2e00/0xd9f4181e0d27ea51 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.736353:0:20141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27ea43 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.736359:0:20141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27ea43 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.736365:0:20141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27ea43 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.736369:0:20141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef0400 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790946122.736372:0:20141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27ea43 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.736378:0:20141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27ea43 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.736395:0:20141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d4096cfd000) 00010000:00010000:3.0:1790946122.736397:0:20141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790946122.736400:0:20141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27ea43 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.736406:0:20141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0400/0xd9f4181e0d27ea43 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20141 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946122.736579:0:20141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca604fcf-845a-4ff8-977f-a1d27931fa85+19:15626:x1877942616594304:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 30093us (30430us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1790946122.736590:0:20141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 63 00000020:00080000:3.0:1790946122.736596:0:20141:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1790946122.737123:0:17181:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1790946122.737128:0:17181:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790946122.737145:0:17181:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1790946122.737152:0:17181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1790946122.748967:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946122.749120:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616594688 00000100:00100000:2.0:1790946122.749130:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616594688 00000100:00100000:2.0:1790946122.749240:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:2.0:1790946122.749251:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83d76450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+19:15624:x1877942616594688:12345-192.168.204.20@tcp:49:dd.0 00000100:00100000:2.0:1790946122.749385:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83d76450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+19:15624:x1877942616594688:12345-192.168.204.20@tcp:49:dd.0 Request processed in 134us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946122.749393:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:0.0:1790946122.751874:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946122.752314:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616594944 00000100:00100000:2.0:1790946122.752325:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616594944 00000100:00100000:2.0:1790946122.752381:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:2.0:1790946122.752392:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+19:15626:x1877942616594944:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1790946122.752903:0:17151:0:(mdd_object.c:4180:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1790946122.753006:0:17151:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1790946122.753044:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6000/0xd9f4181e0d27ea58 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946122.753060:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6000/0xd9f4181e0d27ea58 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946122.753092:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6000/0xd9f4181e0d27ea58 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946122.753218:0:17151:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6000/0xd9f4181e0d27ea58 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946122.753226:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6000/0xd9f4181e0d27ea58 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946122.753233:0:17151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6000/0xd9f4181e0d27ea58 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946122.753255:0:17151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790946122.753276:0:17136:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790946122.753283:0:17136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6000/0xd9f4181e0d27ea58 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.753289:0:17136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d6000 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:0.0:1790946122.753293:0:17136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6000/0xd9f4181e0d27ea58 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.753300:0:17136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6000/0xd9f4181e0d27ea58 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.753312:0:17136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d40bc9af800) 00010000:00010000:0.0:1790946122.753320:0:17136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790946122.753325:0:17136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6000/0xd9f4181e0d27ea58 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.753330:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6000/0xd9f4181e0d27ea58 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.753342:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946122.753344:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946122.753345:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946122.753350:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+21:15626:x1877942616594944:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 Request processed in 960us (1489us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1790946122.753360:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 11 00000020:00080000:2.0:1790946122.753365:0:17151:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1790946122.759778:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946122.759991:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616595072 00000100:00100000:3.0:1790946122.760002:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616595072 00000100:00100000:3.0:1790946122.760065:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 64 00000100:00100000:3.0:1790946122.760077:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4cef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+21:15624:x1877942616595072:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:3.0:1790946122.760107:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946122.760131:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40814a2e00/0xd9f4181e0d27ea5f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222331068 expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.760215:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40814a2c00/0xd9f4181e0d27ea66 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.760233:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40814a2c00/0xd9f4181e0d27ea66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.760246:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40814a2c00/0xd9f4181e0d27ea66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.760372:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40814a2e00/0xd9f4181e0d27ea5f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331068 expref: 23 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.760392:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40814a2c00/0xd9f4181e0d27ea66 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331068 expref: 22 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946122.760401:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d4096cfd000) 00010000:00010000:3.0:1790946122.760404:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790946122.760408:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40814a2c00, rc 0) 00000100:00100000:3.0:1790946122.760477:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4cef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+22:15624:x1877942616595072:12345-192.168.204.20@tcp:101:dd.0 Request processed in 402us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946122.760484:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 64 00000100:00100000:3.0:1790946122.977404:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946122.977559:0:18672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616595200 00000100:00100000:0.0:1790946122.977570:0:18672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616595200 00000100:00100000:0.0:1790946122.977665:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:0.0:1790946122.977676:0:18672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ca604fcf-845a-4ff8-977f-a1d27931fa85+8:2404:x1877942616595200:12345-192.168.204.20@tcp:4:dd.0 00010000:00010000:0.0:1790946122.977716:0:18672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f04c140/0xd9f4181e0d27ea6d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.977739:0:18672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000aaf3bb43/0xd9f4181e0d27ea2e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331061 expref: 8 pid: 18667 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.977749:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946122.977752:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946122.977757:0:18672:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f04c140/0xd9f4181e0d27ea6d lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.977803:0:18672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000aaf3bb43/0xd9f4181e0d27ea2e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331061 expref: 8 pid: 18667 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.977819:0:18672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000aaf3bb43/0xd9f4181e0d27ea2e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331061 expref: 8 pid: 18667 timeout: 673 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946122.977849:0:18672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f835ea300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:18672:1877942638684160:192.168.204.20@tcp:104: 00000100:00100000:0.0:1790946122.977940:0:18672:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4084878480 going to sleep for 11 seconds 00000100:00100000:0.0:1790946122.979899:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946122.980797:0:18672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f835ea300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:18672:1877942638684160:192.168.204.20@tcp:104: 00010000:00010000:0.0:1790946122.980825:0:18672:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009f04c140/0xd9f4181e0d27ea6d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946122.981779:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946122.981871:0:17132:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616595456 00000100:00100000:0.0:1790946122.981880:0:17132:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616595456 00010000:00010000:0.0:1790946122.981923:0:17132:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000aaf3bb43/0xd9f4181e0d27ea2e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331061 expref: 9 pid: 18667 timeout: 673 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946122.981985:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 21 00000100:00100000:0.0:1790946122.981994:0:17132:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4cece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ca604fcf-845a-4ff8-977f-a1d27931fa85+9:2402:x1877942616595456:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790946122.982010:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946122.982035:0:17132:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000aaf3bb43/0xd9f4181e0d27ea2e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331061 expref: 9 pid: 18667 timeout: 673 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.982049:0:17132:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000aaf3bb43/0xd9f4181e0d27ea2e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331061 expref: 9 pid: 18667 timeout: 673 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.982087:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aaf3bb43/0xd9f4181e0d27ea2e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331061 expref: 9 pid: 18667 timeout: 673 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.982395:0:17132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946122.982399:0:17132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946122.982407:0:17132:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009f04c140/0xd9f4181e0d27ea6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.982417:0:17132:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f04c140/0xd9f4181e0d27ea6d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946122.982471:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946122.982529:0:17132:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4cece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ca604fcf-845a-4ff8-977f-a1d27931fa85+8:2402:x1877942616595456:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 536us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946122.982539:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 21 00010000:00010000:1.0:1790946122.982780:0:18672:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009f04c140/0xd9f4181e0d27ea6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946122.982790:0:18672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f04c140/0xd9f4181e0d27ea6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946122.986432:0:18674:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1790946122.986449:0:18674:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1790946122.988104:0:18674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616595328 00000100:00100000:2.0:1790946122.988118:0:18674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616595328 00000100:00100000:2.0:1790946122.988825:0:20302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1 00000100:00100000:2.0:1790946122.988838:0:20302:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ca604fcf-845a-4ff8-977f-a1d27931fa85+8:2403:x1877942616595328:12345-192.168.204.20@tcp:4:dd.0 00010000:00010000:2.0:1790946122.988874:0:20302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ffcaf1c/0xd9f4181e0d27ea74 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946122.988897:0:20302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946122.988902:0:20302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946122.988909:0:20302:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ffcaf1c/0xd9f4181e0d27ea74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946122.988932:0:20302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ffcaf1c/0xd9f4181e0d27ea74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946123.040350:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790946123.101470:0:19480:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:0.0:1790946123.101491:0:19480:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:1.0:1790946123.103317:0:18672:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:1.0:1790946123.103329:0:18672:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1790946121 -> 1790946123 00002000:00010000:1.0:1790946123.103332:0:18672:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1790946121 -> 1790946123 00002000:00010000:1.0:1790946123.103335:0:18672:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:1.0:1790946123.103357:0:18672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f04c140/0xd9f4181e0d27ea6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946123.103372:0:18672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f04c140/0xd9f4181e0d27ea6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946123.103383:0:18672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f04c140/0xd9f4181e0d27ea6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946123.103391:0:18672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c64a00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:1.0:1790946123.103397:0:18672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f04c140/0xd9f4181e0d27ea6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946123.103408:0:18672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f04c140/0xd9f4181e0d27ea6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946123.103433:0:18672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f04c140/0xd9f4181e0d27ea6d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946123.103468:0:18672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f04c140/0xd9f4181e0d27ea6d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946123.103629:0:18672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ca604fcf-845a-4ff8-977f-a1d27931fa85+7:2404:x1877942616595200:12345-192.168.204.20@tcp:4:dd.0 Request processed in 125949us (126228us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1790946123.103648:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 0 00000001:00080000:2.0:1790946123.159552:0:19480:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:0.0:1790946123.159758:0:20302:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:0.0:1790946123.159764:0:20302:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:0.0:1790946123.159780:0:20302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ffcaf1c/0xd9f4181e0d27ea74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946123.159795:0:20302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ffcaf1c/0xd9f4181e0d27ea74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946123.159805:0:20302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ffcaf1c/0xd9f4181e0d27ea74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946123.159812:0:20302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d7800 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:0.0:1790946123.159829:0:20302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ffcaf1c/0xd9f4181e0d27ea74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946123.159839:0:20302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ffcaf1c/0xd9f4181e0d27ea74 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946123.159861:0:20302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ffcaf1c/0xd9f4181e0d27ea74 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946123.159867:0:20302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ffcaf1c/0xd9f4181e0d27ea74 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946123.159989:0:20302:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ca604fcf-845a-4ff8-977f-a1d27931fa85+5:2403:x1877942616595328:12345-192.168.204.20@tcp:4:dd.0 Request processed in 171148us (180093us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1790946123.160000:0:20302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1 00010000:00010000:2.0:1790946124.064567:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790946124.738354:0:20339:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1790946125.087603:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946125.665002:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790946125.665028:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f835ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638684288:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790946125.665099:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946125.665281:0:19952:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638684288 00000100:00100000:0.0:1790946125.665290:0:19952:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638684288 00000100:00100000:0.0:1790946125.665355:0:19952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790946125.665365:0:19952:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638684288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790946125.665393:0:19952:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1790946125.665451:0:19952:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638684288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946125.665458:0:19952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1790946125.665938:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790946125.665977:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f835ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638684288:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790946125.889833:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946125.889912:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946125.889949:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946125.889996:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946125.890023:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946125.890034:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616595840 00000100:00100000:0.0:1790946125.890046:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616595840 00000100:00100000:3.0:1790946125.890072:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946125.890098:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946125.890116:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616596352 00000100:00100000:0.0:1790946125.890121:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616596352 00000100:00100000:3.0:1790946125.890125:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946125.890149:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946125.890190:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616595712 00000100:00100000:0.0:1790946125.890195:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616595712 00000100:00100000:3.0:1790946125.890197:0:20141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616596224 00000100:00100000:3.0:1790946125.890203:0:20141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616596224 00000100:00100000:0.0:1790946125.890234:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 59 00000100:00100000:3.0:1790946125.890246:0:20141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 60 00000100:00100000:0.0:1790946125.890249:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+5:2403:x1877942616595840:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790946125.890259:0:20141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84e27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+5:2403:x1877942616596352:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790946125.890715:0:20141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84e27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+5:2403:x1877942616596352:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 458us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946125.890723:0:20141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 60 00000100:00100000:3.0:1790946125.890741:0:20141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 61 00000100:00100000:3.0:1790946125.890747:0:20141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84e25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca604fcf-845a-4ff8-977f-a1d27931fa85+22:2403:x1877942616595712:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790946125.894429:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616595584 00000100:00100000:2.0:1790946125.894445:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616595584 00000100:00100000:2.0:1790946125.894501:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 166 00000100:00100000:2.0:1790946125.894509:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f82388850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65e62bd4-414e-42c8-885a-5648a45a13a4+13:2403:x1877942616595584:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790946125.895414:0:20141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84e25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca604fcf-845a-4ff8-977f-a1d27931fa85+22:2403:x1877942616595712:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 4650us (5338us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946125.895427:0:20141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 61 00000100:00100000:3.0:1790946125.895461:0:20141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 62 00000100:00100000:3.0:1790946125.895472:0:20141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84e26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+6:2403:x1877942616596224:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790946125.895516:0:20141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84e26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+6:2403:x1877942616596224:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 49us (5391us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946125.895522:0:20141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 62 00000100:00100000:3.0:1790946125.895557:0:18669:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616596096 00000100:00100000:3.0:1790946125.895562:0:18669:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616596096 00000100:00100000:3.0:1790946125.895609:0:18669:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616596608 00000100:00100000:3.0:1790946125.895613:0:18669:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616596608 00000100:00100000:0.0:1790946125.896313:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+5:2403:x1877942616595840:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 6065us (6396us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946125.896315:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f82388850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65e62bd4-414e-42c8-885a-5648a45a13a4+13:2403:x1877942616595584:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 1798us (6486us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946125.896329:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 59 00000100:00100000:2.0:1790946125.896334:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 166 00000100:00080000:0.0:1790946125.896362:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790946125.896369:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790946125.896372:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790946125.896383:0:18666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616595968 00000100:00100000:2.0:1790946125.896390:0:18666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616595968 00000100:00100000:0.0:1790946125.896394:0:18667:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616596480 00000100:00100000:0.0:1790946125.896411:0:18667:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616596480 00000100:00100000:2.0:1790946125.896445:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:2.0:1790946125.896454:0:18666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f833f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ca604fcf-845a-4ff8-977f-a1d27931fa85+5:2403:x1877942616596096:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790946125.896491:0:18666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f833f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ca604fcf-845a-4ff8-977f-a1d27931fa85+5:2403:x1877942616596096:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 38us (6541us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946125.897797:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 14 00000100:00100000:0.0:1790946125.897818:0:18667:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84e25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+5:2403:x1877942616595968:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790946125.897877:0:18667:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84e25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+5:2403:x1877942616595968:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 69us (7779us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946125.897886:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 14 00000100:00100000:0.0:1790946125.897914:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15 00000100:00100000:0.0:1790946125.897921:0:18667:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408471b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+5:2403:x1877942616596480:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790946125.899216:0:18667:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408471b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+5:2403:x1877942616596480:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 1285us (9056us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946125.899231:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15 00000100:00080000:0.0:1790946125.899277:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790946125.899282:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790946125.899585:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:2.0:1790946125.899755:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:3.0:1790946125.899800:0:18669:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84e25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+5:2403:x1877942616596608:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790946125.899878:0:18669:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84e25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+5:2403:x1877942616596608:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 88us (9854us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946125.899885:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 16 00010000:00010000:3.0:1790946126.117295:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946126.175494:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790946126.175523:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4cec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638684416:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790946126.175613:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946126.175763:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638684416 00000100:00100000:2.0:1790946126.175772:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638684416 00000100:00100000:2.0:1790946126.175819:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790946126.175829:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638684416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790946126.175871:0:17153:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790946126.175924:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638684416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946126.175931:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790946126.175976:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638684544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790946126.176005:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946126.176056:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4cec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638684416:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790946126.176081:0:18671:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638684544 00000100:00100000:2.0:1790946126.176085:0:18671:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638684544 00000100:00100000:2.0:1790946126.176119:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790946126.176126:0:18671:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638684544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790946126.176139:0:18671:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1790946126.176199:0:18671:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638684544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946126.176205:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1790946126.176222:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790946126.176247:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638684544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790946126.176665:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4ceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877942638685056:0@lo:400:kworker.0 00000100:00100000:0.0:1790946126.176698:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946126.176728:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4cef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1877942638685568:0@lo:400:kworker.0 00000100:00100000:0.0:1790946126.176749:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946126.176768:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1790946126.176774:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4ceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638684928:0@lo:400:kworker.0 00000100:00100000:0.0:1790946126.176796:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946126.176811:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4ced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1877942638685440:0@lo:400:kworker.0 00000100:00100000:0.0:1790946126.176831:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946126.176846:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1877942638685952:0@lo:400:kworker.0 00000100:00100000:0.0:1790946126.176866:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946126.176890:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638685056 00000100:00100000:0.0:1790946126.176894:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638685056 00000100:00100000:0.0:1790946126.176917:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638685568 00000100:00100000:0.0:1790946126.176920:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638685568 00000100:00100000:0.0:1790946126.176936:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638685440 00000100:00100000:0.0:1790946126.176939:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638685440 00000100:00100000:0.0:1790946126.176948:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638685952 00000100:00100000:0.0:1790946126.176950:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638685952 00000100:00100000:0.0:1790946126.176963:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790946126.176968:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1877942638685056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946126.177008:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1877942638685056:12345-0@lo:400:kworker.0 Request processed in 39us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946126.177013:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790946126.177041:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790946126.177048:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1877942638685568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946126.177095:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1877942638685568:12345-0@lo:400:kworker.0 Request processed in 47us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946126.177100:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790946126.177112:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790946126.177118:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1877942638685440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946126.177142:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1877942638685440:12345-0@lo:400:kworker.0 Request processed in 25us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946126.177147:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790946126.177156:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790946126.177163:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1877942638685952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946126.177229:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1877942638685952:12345-0@lo:400:kworker.0 Request processed in 67us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946126.177235:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790946126.177253:0:19563:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638684928 00000100:00100000:0.0:1790946126.177256:0:19563:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638684928 00000100:00100000:0.0:1790946126.177281:0:19563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790946126.177287:0:19563:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638684928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946126.177316:0:19563:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638684928:12345-0@lo:400:kworker.0 Request processed in 30us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946126.177321:0:19563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790946126.177534:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:0.0:1790946126.177539:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d3f83c35880, transno 8589934596 00000100:00100000:2.0:1790946126.177610:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f835ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638684672:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790946126.177641:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946126.177659:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4cec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638685184:0@lo:400:kworker.0 00000100:00100000:2.0:1790946126.177673:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946126.177685:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1877942638685696:0@lo:400:kworker.0 00000100:00100000:2.0:1790946126.177700:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946126.177716:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1790946126.177731:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4cec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:87d8d138-d2ce-4761-a98a-4e847b9142bd:3649:1877942638684800:0@lo:400:kworker.0 00000100:00100000:2.0:1790946126.177755:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946126.177779:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638685312:0@lo:400:kworker.0 00000100:00100000:2.0:1790946126.177798:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946126.177811:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1877942638685824:0@lo:400:kworker.0 00000100:00100000:2.0:1790946126.177826:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946126.177846:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638684800 00000100:00100000:2.0:1790946126.177850:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638684800 00000100:00100000:2.0:1790946126.177874:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1790946126.177879:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f82388050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+24:3649:x1877942638684800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946126.177907:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f82388050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d8d138-d2ce-4761-a98a-4e847b9142bd+24:3649:x1877942638684800:12345-0@lo:400:kworker.0 Request processed in 29us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946126.177912:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1790946126.177935:0:18666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638685312 00000100:00100000:2.0:1790946126.177938:0:18666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638685312 00000100:00100000:2.0:1790946126.177962:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790946126.177967:0:18666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638685312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946126.177994:0:18666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638685312:12345-0@lo:400:kworker.0 Request processed in 27us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946126.177999:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790946126.178020:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638684672 00000100:00100000:2.0:1790946126.178023:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638684672 00000100:00100000:2.0:1790946126.178050:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638685184 00000100:00100000:2.0:1790946126.178053:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638685184 00000100:00100000:2.0:1790946126.178063:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790946126.178068:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3649:x1877942638684672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790946126.178092:0:17152:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1790946126.178131:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3649:x1877942638684672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946126.178137:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790946126.178149:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790946126.178154:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638685184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946126.178206:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638685184:12345-0@lo:400:kworker.0 Request processed in 52us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946126.178212:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790946126.178229:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638685696 00000100:00100000:2.0:1790946126.178232:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638685696 00000100:00100000:2.0:1790946126.178256:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638685824 00000100:00100000:2.0:1790946126.178259:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638685824 00000100:00100000:2.0:1790946126.178275:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790946126.178281:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877942638685696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946126.178312:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877942638685696:12345-0@lo:400:kworker.0 Request processed in 31us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946126.178317:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790946126.178328:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790946126.178334:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1877942638685824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946126.178359:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1877942638685824:12345-0@lo:400:kworker.0 Request processed in 25us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946126.178375:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1790946126.178401:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790946126.178406:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790946126.178408:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790946126.178434:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4cec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:87d8d138-d2ce-4761-a98a-4e847b9142bd:3649:1877942638684800:0@lo:400:kworker.0 00000100:00100000:2.0:1790946126.178446:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638685312:0@lo:400:kworker.0 00000100:00100000:2.0:1790946126.178466:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1877942638685824:0@lo:400:kworker.0 00000100:00100000:2.0:1790946126.178480:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f835ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638684672:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790946126.178487:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4cec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638685184:0@lo:400:kworker.0 00010000:00080000:2.0:1790946126.178497:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f8441ca80 x1877942638685696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946126.178506:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1877942638685696:0@lo:400:kworker.0 00000004:00080000:0.0:1790946126.180329:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:0.0:1790946126.180374:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4ceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638684928:0@lo:400:kworker.0 00000100:00100000:0.0:1790946126.180417:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4ced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1877942638685440:0@lo:400:kworker.0 00010000:00080000:0.0:1790946126.180448:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f8441ed80 x1877942638685952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946126.180460:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1877942638685952:0@lo:400:kworker.0 00000100:00100000:0.0:1790946126.180473:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4ceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877942638685056:0@lo:400:kworker.0 00000100:00100000:0.0:1790946126.180484:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4cef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1877942638685568:0@lo:400:kworker.0 00000100:00100000:3.0:1790946126.180895:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638686080:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790946126.180962:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946126.181518:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f835e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638686208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790946126.181555:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946126.181642:0:18671:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638686080 00000100:00100000:0.0:1790946126.181650:0:18671:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638686080 00000100:00100000:0.0:1790946126.181697:0:18671:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638686208 00000100:00100000:0.0:1790946126.181700:0:18671:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638686208 00000100:00100000:0.0:1790946126.181716:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790946126.181723:0:18671:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84e25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638686080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790946126.181754:0:18671:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1790946126.181973:0:19952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790946126.181982:0:19952:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4cef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638686208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790946126.181993:0:19952:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1790946126.182044:0:19952:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4cef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638686208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946126.182052:0:19952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790946126.184367:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f835e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638686208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790946126.184771:0:18671:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84e25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638686080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3046us (3806us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946126.184781:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790946126.184853:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638686080:0@lo:13:osp-pre-1-1.0 Debug log: 41807 lines, 41807 kept, 0 dropped, 0 bad.